uh and then get off the problem. Uh because
uh you have uh uh politicians uh uh anymore 6
35 data warehouse is probably the largest data warehouses public
. Uh walmart sells almost$300 million per day,
detailed records about this. Um Yahoo stores 200 satellites
. Very hard to get numbers from countries like that
. Uh Was that we have 220 cluster? Uh
huh, interesting. They are going to counter balance
the defenders which suggests that if I came clusters and
datasets are, you know, they are present in
many of their customers. So the factors that drive
the growth of the data. First of all,
we can sort of so they will invite the sixth
sense Uh the low scale, the most sense of
scale. And even if you're looking at some uh
enterprise storage is still 30%, so it's not very
expensive and it's going down uh as a result,
while in the past companies that have generally data because
of the top stories today, we are keeping all
the data in the hope that something uh and the
other reason is that, well, some of the
data, uh some of the very large data uh
include information about events occurring in the real world sales
uh transactions. Most of them are machines they record
between the data, uh event very computer systems,
which very much. Uh So then the question is
, what are we gonna do with all these days
? Uh and I'll give an example of what can
be done uh with the data. So uh this
is for example, there are many other, it
turns out that uh data analysis uh analyzing large amounts
of data can provide insight into uh many, many
questions. Uh What questions should you ask? What
is the first thing? Uh So I'm sure that
many people in the room and ask themselves had this
problem before. Uh but also if you have a
company that runs an online dating service, it is
very easy for you to understand what are the factors
that influence whether people are? So, one of
these companies are moving you from some numbers and the
people of these three questions uh predict whether relationship will
be successful. So these questions are you like for
me, have you ever traveled around another country alone
, and we will be going to chuck it all
? And these are the questions that uh and the
reason is that the data shows that if you may
not need to agree on these questions, then you're
four times more likely to be a good match uh
as opposed to the right questions they have. Uh
And this is interesting because these questions are companies to
they're not something that a psychology major might come up
with. Uh in fact, uh they have better
predictive power. Then they talked to the real question
we are trying to uh getting some some uh insight
about uh about trying the details about the anniversary of
the United States, uh the world stories that if
you are going the moments leading companies, you can
no longer rely on psychology of. Uh and you
also have to, this is some of the data
and uh in fact most of the only basic services
now, they are hiring lots of, a lot
of two million years uh have the skills to build
a program united. We've seen similar trends in the
history of uh industrial development in the turn of the
20th century. Those factories, higher electrical engineers and
maintain their own private political generators because basically was special
for their business. But it does not widely available
for the kind of the part and today the sentence
existence uh played a similar for for many this company
. But the problem with this is this is that
it's usually um difficult to be fairly. It's usually
hard to try out new ideas for the identification and
there are three main challenge for the. Yeah.
So the first challenge is that the data uh hard
. So if you have the the tables at the
end of its life uh the first four roads for
response to the operations that you have to perform when
you're not like one month megabytes of data on the
local host or a local area network and get the
latest for four billion won a are on the order
of human. Now if your operations have involved post
uh that are in the same data center but not
on the same land, then you already have to
design is and then if your operations have to move
data across each other, then you have another cooperation
forward. So we don't want this. Whatever you
can have the effect this system whenever you're dealing with
very large dataset, you're trying to perform the operation
. Only advantage. Where do they have planned for
? The second problem is that uh is the largest
of the data. You need the hardware and software
infrastructure for uh for uh if you run the numbers
to see that if you want to actually one terabyte
of data and uh you want to go with 11
of this in in one minute. Uh even you
know, those many second agencies are not going to
get there and you will need to distribute data over
multiple. Uh Then once you receive the data,
you also need to use the tools programming uh that
are able to deal with complications. Uh from a
different perspective. Perhaps the biggest challenge is that uh
once you've done an experiment very hard part of this
to remember to use in order to uh to determine
whether uh has scientists because when you're trying to reproduce
its very much you have to share not the growth
of the group technique but also the data that was
interviewed on. And uh well the meta data on
uh how they are uh Especially in the security deal
uh where data sets are sensitive because include uh sometimes
include private information such as the advocate or you are
else. Uh They they are sharing the doctor.
It's very hard to verify the validity of. Uh
huh. So you know what I tell you so
far is that data analytics can provide you with remarkable
insight about very problem. Um But at the same
time experimenting with daytime techniques uh and this brings me
to the main point of my dog. Uh which
is why so why for the group mind intelligence,
different environment and uh when is a combination of uh
around the world uh uh system a system that we
have to build uh for they were using your resources
are available to researchers united. So, in a
nutshell, the goal possible party search is to uh
ensure that researchers are able to conduct repeatable experiments.
SPF on the other. Uh And because most exposed
researchers now data that uh 20 terabytes, a few
data collected millions of dollars. And I want to
make this clear that this is not data that uh
was originated in a recent projects that humanity is that
uh uh These are the company's culture rules. This
is the data that semantics, products and services are
available uh because this is proprietary and it's critical to
business, we cannot allow the raw data uh leave
the premises. Um So we request that why the
access on site uh to uh California internment. Uh
it's also a good thing because we have provisions uh
system that can analyze the uh amount of time and
I will give some uh and because we have built
the system from the ground up in the name of
ensuring uh repeatability experiments, we are archiving all the
data sets that are used every experiment so that they
are they are available to work recently in the future
, like to compare the results. Uh And we
also uh huh we also uh adopt a strategy while
using other experimental sciences of maintaining a book that describes
this Parliament uh destroyed the procedure. And in terms
of the so in the dark out how point data
system. How uh ensure uh so the first point
that out to me about the data that we are
providing access to that data. But it's not it's
not uh a representative. So we have uh something
strategy for uh for uh taking the data set collected
by business uh including some sort of uh why uh
this has the desired effect. That example smaller uh
data becomes smaller, uh moving around, uh part
of the company. Uh uh It is uh great
organization. Uh We have uh ensured that the distribution
of uh huh in wine mirror uh distribution to uh
show uh now it's really relevant or whatever. Uh
huh. And you think of this is uh district
for lossy compression which is uh sort of like what
jpeg or BMP are able to do that. They
are able to achieve very high professional place uh while
preserving the most important property of the original. Uh
This uh bar chart also shows that whatever semantics,
let's not be representative for the so this is another
thing that should be a time when your experiment and
when you're trying uh selection bias, whatever we have
declined representative uh guarantee that uh I will give you
a few examples of the kind of data that we
have uh wine. There are many, I don't
have time to uh uh We're still uh right now
. Uh I will just describe for the events that
uh relevant to understand the life cycle of fiber because
we have taken all of the uh one of the
uh one of the interesting data set that we have
a violent reputation. And this data files five people
down. Uh This is part of our insight program
feature of uh that tries to give you a really
worrying about the militia report. Many of the uh
huh I live in those boxes. So the way
that you tell us uh uh service with a download
computer exchange provides uh a bunch of files. Uh
you're you're not expecting a historic uh you know what
you're doing. So uh that those files are online
uh uh a thing for uh what files here on
the internet? Uh huh. Machine. Uh huh
. Five around with help from and with this very
simple uh information you can do uh the study of
how parts probably around around the world. Uh For
example, uh you can uh you see interesting into
by conflict of about during our education around the world
. So you can see that in spite of uh
activity uh explanation located the uh and also uh patterns
uh started our study uh because uh it's false.
Uh what's the difference between uh malicious files and uh
£90 just from the propagation time. So uh as
all the results that I will present here in the
store. Uh this is this is only a preliminary
results. I will show you uh, there are
problems in research research directions in order to incite.
Uh uh the figures also showed uh two times before
and after something. Uh administrators. The fact that
even after uh are very well so well, the
recognition tells you about 30 stages of uh files propagation
before he discovered. Uh finalize uh anti virus element
tells you about the later stages after anti virus vendors
have a I think insurance when I step extract whatever
it takes the threat, uh, suspicion that position
uh with more detailed data such as what is the
signature of Vietnam uh, operating system was targeted process
. Uh what was the internet location where the impact
for this? We receive the data for both uh
both states and uh preliminary study of this uh,
dataset recently, uh work uh where we try to
determine whether uh we are safer today than we were
. Uh It is very important to be careful when
you analyze the data. Whatever we received a submission
. Uh, submission doesn't mean that the hope with
respect if I did not have reliable data coming in
are infected out there. It means to keep block
uh infection. Uh So we defined the metric called
the watermark. Uh that is essentially the uh,
the number of the average number of attacks against the
post that might have resulted in an infection uh in
the actual device software. Uh This is uh uh
this is a pretty amazing to Social Security that is
called the attack surface. Uh you can see that
for the newer versions of the uh, the operating
systems, the attack watermarking. Uh uh it doesn't
mean that the newer versions are not uh however,
this shows that there are fewer threats that get to
initial lines of defense is uh, this is uh
, so in other words, there are two of
the act uh, use uh however, at the
same time, uh, criminals have also been busy
and the data suggests that they uh they focus on
opportunities. So, uh, the number of viruses
almost correlated with uh, the number of available uh
, platform. Uh we also see another sense that
uh, the number of viruses develop or older operating
uh, time. Uh both these uh uh significant
uh basically we uh this this is a preliminary study
shows that there are two uh, To going on
uh, systems are using their services. On the
other hand, the criminals are uh uh, over
two years in December 2009. Uh Huh. Uh
When should you buy a problem? Because because it
doesn't mean that the operating system is not gonna uh
So, I mean that those attacks might still be
successful if you uh don't our product. Uh let's
say that all the uh all the uh machine in
the world. Uh the uh okay, mm hmm
. Essentially, there are two sides still giving friend
and uh because it is difficult to understand we are
in today or not. Uh but I'm trying to
do my friend to say with uh we decided that
this preliminary data shows that using using one you get
frank last week. Yeah. Uh they said that
we have uh uh uh we have uh develop uh
plastic, isn't it? Unlike this uh technique called
pr provide graphically clustering with multiple right here analysis in
order to identify looking multiple features of the uh phantom
recall. There is a specific span campaign. Uh
They all belong. Uh You can see that he's
uh always technique was able to identify with major progress
uh presenting spanning 2000 development. The labels here,
we're actually many designed by the semantic business do uh
that uh and three. Uh The interesting point is
that first of all, it's always too young lady
technique was able to identify the investors and at the
same time uh that a large number of uh some
samples that were unclassified shared a similar feature with the
uh uh prevent involvement last year. We take them
down. So chances are those testified uh samples.
Uh So this is an example of what uh analysis
of these are. Uh So uh well that doesn't
describe so far, even information uh next to information
about what malicious uh uh We also have national uh
these are boundaries uh go back on that now there
uh we also did a preliminary study of the data
that is one of the uh have a summer job
actually want uh semantic pollution in 2000 and 11.
Uh uh Look at uh analyzing both static features derived
by statically analyzing uh huh Teachers of the behavior so
derived from A. C. I. Uh Finally
uh by the casting technique uh on the one hand
is able to uh cluster uh some. So now
we're together determine if various samples I part of the
same family member but also is able to distinguish what
are characteristic uh features that characterize that highlights what is
specific. Uh huh. So you just for example
we have many other data. So we have historical
uh information on value or else that are putting out
there. We have another data set that is similar
to the fiery reputation which helps us not what we
know so much about our but uh these programs are
installed and that practice or performance degradation are uh very
difficult. That has a lot of information about uh
what program is running when uh you know, when
things are getting we also have received from our mobile
duties which is mobile, uh huh about resource consumption
, a replication. Uh We also have many cases
for a subset of the recollection. Uh we also
know that the number of uh facilitating uh Uh that
to me is that this is uh uh for example
authority over 100 and similarly the other people uh so
this brings me to uh the second part of the
top where I describe the system and uh partitions by
now uh people are wanting how you cannot make up
well this is the process that we have described.
Uh So first of all you have to start a
nondisclosure uh one day a which allows you to send
data catalog has four different institutions of uh They had
one at a local talk to explain uh more details
. And there are some of the properties data cents
. Uh And then uh you have to write a
one page proposal that describe the data that you need
for experiments and watch the hypothesis with. Uh and
then it's time uh contract. This is also very
likely contract that that provision and a lot of you
publish very uh after that uh Based on your proposal
we find the reference data set that has the data
from the experiment and then you have to have one
side for the T. V. And run the
actual experiment there longer or uh the data from the
data and you have to uh update. Uh However
when you don't have to wait for extracting data.
So at the end of the experiment about experiment uh
run the experiment and we give you the results data
. Uh in the end you will require a 20
. And in the Acknowledgments section required that states explicitly
whether you allow researchers to produce. Uh so worried
about property. Uh first of all you have signed
a cooperation project. Uh this had this information uh
we see all the copies of products. Uh Huh
. Uh require that. Uh So this is how
experiments are conducted. Uh data uh mentioned is loaded
in the database that can perform uh provisions to perform
operations channel. Uh huh. All times. And
this uh little access from virtual machine. So when
you come comparative public machine can uh if you want
to experiment financial down there. Uh This is a
system because all the malicious code examples are stored in
what we call the red lab. Uh isolated experts
is not connected to the american. Uh It has
a very strict regulations about what you can bring in
and what you can take off. So if you
walk in there your cell phone uh in order to
make things easier we can provide you with. So
apparently they were using a universal database called uh we
can provide a uh virtual machine. Uh Last original
machine with databases. Uh You can start developing your
uh we also uh essentially the white uh huh.
All the criminal the additional uh when you have a
fight. And uh another really important point is that
during the experiment she will not have internet activity.
Uh Because if you're to uh your interact with services
or result of any nature uh service uh requests um
for interact with any other kind of country resources then
determined not because those uh things are very transient nature
. So that will require that all data uh either
in the VM or in the database for the other
. Uh huh. Uh One of the most interesting
aspect is that you can uh from multiple separate operations
. Uh We've done this uh study uh for understanding
the sources and prevalence of the attacks. Uh the
attack uh whatever uh vulnerability exploded before the vulnerability to
go uh because it is not known it is very
hard to figure out if there is that they're only
after. Uh because of that very little knowledge about
what are the characteristics of the uh probably are what
the president what their education, their reservation uh the
other information data why provide the needed trump? Because
we have information of files and create files on the
internet before they were actually uh detective uh maybe be
malicious. So therefore we can you can determine the
time when a father uh when uh or it was
disclosed and uh we can compute the administration uh whether
we we still need to figure out which vulnerabilities correspondence
which follow the a and that's where correlations from place
. Uh We start from uh tragic war which is
a public website that's maintain describes all the viruses that
all the virus detection that phone and it also had
a case uh possibilities with that. See the numbers
uh privacy's there. So let's say that you start
the thing with those abilities. You can do uh
this virus can all uh while I have, the
detective has been all with uh and then using a
copy of these files you can uh violent agitation,
uh how many machines were effective and it didn't study
the ability with another uh winner of uh huh Here
and uh again studies preliminary look at uh so right
now we discover that the more uh uh we also
uh after they have been still for how long you
have uh uh figure here is one example uh before
uh so for those uh uh you think this correlation
that describe uh slide, you can see that for
uh of course that's discover how many homes we're being
infected with this for uh when the second vary from
his first year on the internet. Uh you can
also see the pattern, such as the fact that
this is not a world that was created by that
was not a very few of these are actual results
down the dollar will start a good network sharing propagated
and none of these results are all these all data
. Majority from the report of uh cover appointment.
Uh One you have to think so this year uh
was uh derived by analyzing Peter by the media.
Uh This analysis requires quite where it begins. Uh
and this is a very uh explain the uh all
the uh however, this is no this is enough
for defeating, But it's not enough for refuge uh
refugees 70,000. Uh the main uh I mean,
the main reason why I like this process fails.
Okay, enough information on how in the world.
Many of you think trading uh available for research has
been criticized for uh you have uh the data uh
questions uh where they uh and also for those who
are uncertain allows you to uh from the assessment of
the information for you. Give you an example the
prime time that our side whatever submission is uh they
are assigned on uh you know, they're not reliable
because uh uh about the uh also sign on the
gate where the where uh you can uh you can
uh whether uh how the activities that all the data
, all the information that you need in order to
produce uh research conclusions cannot be. Uh Mhm We
always need uh therefore uh dr approach of maintaining a
book which documents the hypothesis very much in the data
and the teacher. Uh so uh probably information of
your proposals to proposals uh also required that once it
can be uh we're working on uh infrastructure for uh
especially uh documenting all this thought process behind why uh
variables, independent variables looking for. Uh this.
Uh I think that that I also want to highlight
a few opportunities for uh just a few examples,
uh not uh not costing but there is a particular
uh of our security uh online, uh have a
representative of our international information uh that any researchers can
use uh not has been a tradition in security are
especially uh information, they are not shared. A
very hard verified. Uh huh. Similarly, we
can be very for south reliability, uh examination of
vulnerabilities, highlighting the fact that the that the capital
are you don't know someone numbers are not, but
this emphasizes the fact that when researching in uh deductive
, uh it is important to uh testing that is
on the boston matter in the world. Uh otherwise
developing uh techniques that might not be uh there's a
great opportunity, different ways of uh especially highlights,
we first of all that uh eliminates dimension on uh
sources generational effect. I think the problem graphs,
data uh can be used uh also uh work on
uh to start uh Germany uh various variants. So
now we're has evolved one today, uh machine learning
. Uh There is not uh graph uh uh between
uh department draft machines. Uh huh uh Colonel uh
also provisions uh excuse me. Uh So returning to
the challenges or currently, uh these are really uh
so while the data is part has developed uh representing
example uh and all that uh president on uh this
allows us to get to the very start from today
, our kingdom California. So uh we are providing
the blackboard for uh occupation and it's not the production
system, uh experiment. Uh huh Go ahead.
And uh provide the opportunity. Uh We also have
uh to ensure that uh experiment uh first of all
, the archive of the uh the fact that we
control the experimental process of the election to the end
itself. Uh huh. I do want to mention
uh cooperation in communities that have so perhaps uh that
I mentioned before, uh sort of like the idea
again and uh one for the duration of one year
uh over the past, it's a new program over
the past four years. Uh participate. Uh huh
We also provide letters of cooperation for your uh where
where we especially go over your nature. We can
think that you think that uh approaches relevant for the
industry and why has uh data. Uh We also
participate in joint proposals were not eligible for funding but
you're eligible for. Uh We have uh we have
a number of successful proposals uh around the uh other
other uh these are my collaborators, those uh because
I have a plan, I was the one thing
you absolutely looked like prior research. So I started
working uh long time ago, I used to work
on the creation of a ship. Uh So when
to the main contribution that I was that I showed
that when you have so many ports on the shift
and you need a temper and ensuring that the silicon
is not no longer sufficient, you need to have
some relation for bold colors. Also work on both
color. A little where uh my constitution here longer
mechanisms for transparency. United Station and when he says
uh uh with you, with uh software, all
the software our face. Um This is where I
uh like uh reactions were wrote one paper, 11
2010 people after watching uh having dinner together. Uh
The main results from this research uh meeting on time
uh country Hi uh conclusion I told you about one
which is a platform, this experimentation uh dataset and
also can uh totally data that is collected from profitable
business. Uh On the other hand, logical conduct
experiments. And uh we have to ensure that uh
thank you very much. Uh huh. Powers by
the blind. So we know that. Uh huh
And we see that the whole party wine uh talking
the virus when we reach one more member of uh
uh and uh and that and so uh have been
blinded vertical, you expected? Huh uh uh uh
We do but at this point we don't actually have
uh so we actually look at that would be a
really good data. Is there somewhere we have a
uh as far as trojans and uh Information Steelers and
uh longer problem between uh I just want to make
sure I understood the application process for getting access to
say that after we put together a proposal, it
sounds like you said something along lines, we open
start to be accepting your needs and I'm just it
seems to me that that maybe introduces a little man
that's not transparent that we can't actually enable information quality
assessment. Uh We don't have to uh this is
just to help you out for uh uh this option
because you have to realize that you have to come
outside and you have to give the uh to pick
up. Uh You know, we offer to do
all the sort of the fact that we live in
order to identify various versions of the operating system because
you can me what names show up in the uh
technology when you see your core operating system. Uh
but yeah, uh that is what you want to
do, uh define your data one. Uh We
uh we do but it's not to mention its needles
in the main uh we do have uh antivirus for
uh but it is an example of the scale while
I think the has some uh order of 1,000,000 viruses
. Uh huh. So do you want you can
provide software and the power of a parallel thing I
just want to know. Uh huh. Yes.
Uh We certainly can do. But so what we
have infrastructure uh is uh well we have the green
from carol database about parallel on multiple segments or multiple
. Uh It's very easy to use and you know
what to do. Uh huh. And that's something
we can talk about. You want to make sure
that nobody else. Uh But it's just think about
the uh to access uh They imagine I know a
little activity intelligence for us. Uh huh. Okay
. Okay. Mhm.