Full transcript
Transcript
platform captionsPlease welcome to the stage. NVIDIA
Founder and CEO, Jensen Huang.
I am very happy to be back. Thank you NTU for letting us use your
stadium. The last time I was here,
I received a degree from NTU.
And I gave the “Run Don't Walk” speech. And today
we have a lot to cover. So I cannot walk, I must
run. We have a lot to cover. I have many things
to tell you. I'm very happy to be here in Taiwan.
Taiwan is the home of our treasured partners. This
is, in fact, where everything NVIDIA does begins.
Our partners and ourselves take it to
the world. Taiwan and our partnership
has created the world's AI infrastructure.
Today, I want to talk to you about several
things. One. What is happening and
the meaning of the work that we do
together. What is generative AI? What is its
impact on our industry and on every industry?
A blueprint for how we will go forward
and engage this incredible opportunity.
And what's coming next? Generative AI and its
impact. Our blueprint. And what comes next?
These are really, really exciting times. A restart
of our computer industry. An industry that you
have forged, an industry that you have created and
now you're prepared for the next major journey.
But before we start. NVIDIA lives
at the intersection of computer
graphics, simulations, and artificial intelligence.
This is our soul. Everything that I
show you today is simulation. It's
math. It's science. It's computer
science. It's amazing.
Computer architecture. None of it's animated and
it's all homemade. This is NVIDIA’s soul,
and we put it all into this virtual
world we called Omniverse. Please enjoy.
I want to speak to you in Chinese. But
I have so much to tell you. I have to
think too hard to speak Chinese. So
I have to speak to you in English.
At the foundation of everything that you
saw was two fundamental technologies.
Accelerated computing and artificial
intelligence. Running inside the Omniverse.
Those two technologies, those two
fundamental forces of computing,
are going to reshape the computer industry.
The computer industry is now some 60 years
old. In a lot of ways, everything that we do
today was invented the year after my birth in
1964. The IBM system 360 introduced central
processing units. General purpose computing.
The separation of hardware and software through
an operating system. Multitasking IO subsystems
DMA, all kinds of technologies that we use today.
Architectural compatibility. Backwards
compatibility. Family compatibility. All of the
things that we know today about computing, largely
described in 1964. Of course, the PC revolution
democratized computing and put it in the hands
and the houses of everybody. And then in 2007,
the iPhone introduced mobile computing and put
the computer in our pocket. Ever since everything
is connected and running all the time through the
mobile cloud, this last 60 years, we saw several.
Just several. Not that many, actually. Two or
three major technology shifts. Two or three
tectonic shifts in computing where
everything changed and we're about
to see that happen again. There are two
fundamental things that are happening.
The first is that the processor, the
engine by which the computer industry
runs on the central processing unit, the
performance scaling has slowed tremendously.
And yet the amount of computation we have to do
is still doubling very quickly, exponentially.
If processing requirement is the data
that is that we need to process continues
to scale exponentially. But performance
does not. We will experience computation
inflation. And in fact we're seeing that
right now as we speak. The amount of data
center power that's used all over the
world is growing quite substantially.
The cost of computing is growing.
We are seeing computation inflation.
This of course, cannot continue. The data is going
to continue to increase exponentially and
CPU performance scaling will never return.
There is a better way. For almost two decades now,
we've been working on accelerated
computing. CUDA augments a CPU offloads and
accelerates the work that a specialized
processor can do much, much better.
In fact, the performance is so extraordinary
that it is very clear now as CPU scaling
has slowed and substantially
stopped, we should accelerate everything.
I predict that every application that is
processing intensive will be accelerated,
and surely every data center will be
accelerated in the near future. Now,
accelerated computing is very
sensible. It's very common sense.
If you take a look at an application
and here the 100t means 100 units of time, it
could be 100 seconds, it could be 100 hours.
And in many cases, as you know,
we're now working on artificial
intelligence applications that run for 100 days.
The 1t is code that requires sequential
processing, where single threaded CPUs are
really quite essential. Operating systems.
Control logic are really essential to have one
instruction executed after another instruction.
However, there are many algorithms. Computer
graphics is one that you can operate completely
in parallel. Computer graphics. Image processing,
physics simulations. Combinatorial
optimizations, graph processing,
database processing, and of course, the
very famous linear algebra of deep learning.
There are many types of algorithms that are
very conducive to acceleration through parallel
processing. So we invented an architecture
to do that by adding the GPU to the CPU,
the specialized processor can take something
that takes a great deal of time and accelerate
it down to something that is incredibly
fast. And because the two processors can
work side by side, they're both autonomous
and they're both separate independent.
That is, we can accelerate what used to
take 100 units of time down to one unit
of time. While the speed up is incredible.
It almost sounds unbelievable. It almost
sounds unbelievable. But today I'll
demonstrate many examples for you.
The benefit is quite extraordinary, a
100 times speedup, but you only increase
the power by about a factor of three and
you increase the cost by only about 50%.
We do this all the time in the PC
industry. We add a GPU, a $500 GPU,
GeForce GPU to a $1,000 PC, and the
performance increases tremendously.
We do this in a data center, $1 billion data
center. We add $500 million worth of GPUs,
and all of a sudden it becomes an AI factory.
This is happening all over the world today.
Well, the savings are quite extraordinary.
You're getting 60 times performance per dollar,
100 times speedup. You only increase your power
by 3X, 100 times speedup you only increase
your cost by 1.5X. The savings are incredible. All
the savings are measured in dollars. It is very
clear that many, many companies spend hundreds of
millions of dollars processing data in the cloud.
If it was accelerated, it is not unexpected that
you could save hundreds of millions of dollars.
Now, why is that? Well, the reason for that is
very clear. We've been experiencing inflation
for so long in general purpose computing. Now
that we finally came to this, we're finally
determined to accelerate. There's an enormous
amount of captured loss that we can now regain,
a great deal of captured, retained waste,
that we can now relieve out of the system.
And that will translate into savings,
savings in money, savings in energy.
And that's the reason why you've heard me
say. The more you buy, the more you save.
And now I've shown you the mathematics. It
is not accurate, but it is correct. Okay,
that's called CEO math. CEO math is not
accurate, but it is correct. The more you buy,
the more you save. Well, accelerated computing
does deliver extraordinary results, but it
is not easy. Why is it that it saves so much
money? But people haven't done it for so long.
The reason for that is because it's incredibly
hard. There is no such thing as a software that
you can just run through a C Compiler, and
all of a sudden that application runs 100
times faster. That is not even logical. If
it was possible to do that. They would have
just changed the CPU to do that. You
in fact have to rewrite the software.
That's the hard part. The software has to
be completely rewritten so that you could
refactor and re-express the algorithms that was
written on a CPU so that it could be accelerated,
offloaded, accelerated, and run in parallel. That
computer science exercise is insanely hard. Well,
we've made it easy for the world
over the last 20 years. Of course,
the very famous cuDNN, the deep learning
library, and the process of neural networks.
We have a library for AI physics that you could
use for fluid dynamics and many other applications
where the neural network has to obey the laws
of physics. We have a great new library called
Ariel that is a CUDA accelerated 5G radio, so
that we can software define and accelerate the
telecommunications networks. The way that we've
software-defined the world's networking, internet.
And so the ability for us to accelerate that
allows us to turn all of telecom into essentially
the same type of platform, a computing platform
just like we have in the cloud. cuLITHO is a
computational lithography platform that allows
us to, process the most computationally intensive
parts of chip manufacturing, making the
mask. TSMC is in the process of going to
production with cuLITHO, saving enormous amounts
of energy and enormous amounts of money.
But the goal for TSMC is to accelerate
their stack so that they're prepared for
even further advances in algorithm and
more computation for deeper and deeper,
narrow and narrow transistors. Parabricks
is our gene sequencing library. It is the
highest throughput library in the world for gene
sequencing, cuOPT an incredible library for
combinatorial optimization, route planning,
optimization, the traveling salesman problem.
Incredibly complicated.
Scientists have largely concluded that you
needed a quantum computer to do that. We created
an algorithm that runs on accelerated computing
that runs lightning fast 23 world
records. We hold every single major
world record today. cuQUANTUM is
an emulation system for a quantum
computer. If you want to design a quantum
computer, you need a simulator to do so.
If you want to design quantum algorithms,
you need a quantum emulator to do so. How
would you do that? How would you
design these quantum computers?
Create these quantum algorithms. If
the quantum computer doesn't exist,
well, you use the fastest computer in the
world that exists today, and we call it,
of course, NVIDIA CUDA. And on that we have
an emulator that simulates quantum computers.
It is used by several hundred thousand
researchers around the world. It is
integrated into all the leading frameworks for
quantum computing, and it's used in scientific
supercomputer supercomputing centers all over
the world. cuDF is an unbelievable library for
data processing. Data processing consumes the
vast majority of cloud spend today. All of it
should be accelerated. cuDF accelerates
the major libraries used in the world.
SPARC many of you probably use SPARC in
your companies. Pandas. a new one called
polar. And of course, network X, which is a graph
processing, database library.
And so these are just some examples. There
are so many more. Each one of them had to be
created so that we can enable the ecosystem
to take advantage of accelerated computing.
If we hadn't created cuDNN, CUDA alone
wouldn't have been able, wouldn't have
been possible for all of the deep
learning scientists around the world
to use. Because CUDA and the algorithms
that are used in TensorFlow and PyTorch,
the deep learning algorithms, the separation
is too far apart. It's almost like trying
to do computer graphics without OpenGL. It's
almost like doing data processing without SQL.
These domain specific libraries are really the
treasure of our company. We have 350 of them.
These libraries are what it takes, and what has
made it possible for us to have such open, so many
markets. I'll show you some other examples today.
Well, just last week, Google announced
that they've put cuDF in the
cloud and accelerated pandas.
Pandas is the most popular data science library in
the world. Many of you here probably already use
pandas. It's used by 10 million data scientists
in the world, downloaded 170 million times each
month. It is the Excel that is the spreadsheet
of data scientists. Well, with just one click,
you can now use Pandas in Colab, which is Google's
cloud data centers platform accelerated by cuDF.
The speedup is really
incredible. Let's take a look.
That was a great demo, right? Didn't take long.
When you accelerate data processing
that fast, demos don't take long.
Okay, well, CUDA has now achieved
what people call a tipping point.
But it's even better than that. CUDA has
now achieved a virtuous cycle. This rarely
happens. If you look at history and all the
computing architecture, computing platforms,
in the case of microprocessor CPUs,
it has been here for 60 years.
It has not been changed for 60 years. At
this level, this way of doing computing,
accelerated computing has been around. Creating
a new platform is extremely hard because it's a
chicken and egg problem. If there are
no developers that use your platform,
then of course there will be no users. But if
there are no users, there are no installed base.
If there are no installed base, developers
aren't interested in it. Developers want
to write software for a large install base, but a
large install base requires a lot of applications
so that users would create an install base. This
chicken or the egg problem has rarely been broken,
and it's taken us 20 years. One domain library
after another, one acceleration library another.
And now we have 5 million developers
around the world. We serve every
single industry from health care, financial
services, of course, the computer industry,
automotive industry. Just about
every major industry in the world,
just about every field of science, because there
are so many customers for our architecture,
OEMs and cloud service providers are
interested in building our systems.
System makers, amazing system makers like
the ones here in Taiwan, are interested in
building our systems, which then takes
and offers more systems to the market,
which of course creates greater opportunity
for us, which allows us to increase our scale,
R&D scale which speeds up the
application even more. Well,
every single time we speed up the
application, the cost of computing goes down.
This is that slide I was showing you
earlier. 100X speed up translates to 97%,
96%, 98% savings. And so when we go from 100X speed up
to 200X, speed up to 1000X, speed up the savings,
the marginal cost of computing continues to
fall. Well, of course, we believe that by
reducing the cost of computing incredibly, the
market developers, scientists, inventors will
continue to discover new algorithms that consume
more and more and more computing so that one day.
Something happens that a phase shift happens, that
the marginal cost of computing is so low that a
new way of using computers emerges. In fact,
that's what we're seeing now. Over the years,
we have driven down the marginal cost
of computing. In the last ten years,
in one particular algorithm by a million times.
Well, as a result, it is now very logical and
very common sense to train large language
models with all of the data on the internet.
Nobody thinks twice. This idea that you could
create a computer that could process so much
data to write its own software. The emergence
of artificial intelligence was made possible
because of this complete belief that if we
made computing cheaper and cheaper and cheaper,
somebody is going to find a great use. Well,
today, CUDA has achieved the virtuous cycle.
Installed base is growing.
Computing cost is coming down,
which causes more developers to come up with
more ideas. Which drives more demand. And now
we're in the beginning of something very,
very important. But before I show you that,
I want to show you what is not possible
if not for the fact that we created CUDA,
that we created the modern version of generative,
the modern big bang of AI, generative AI.
What I'm about to show you would not be possible.
This is Earth-2. The idea that we would create
a digital twin of the Earth. That we would
go and simulate the earth so that we could
predict the future of our planet to better
avert disasters, or better understand the
impact of climate change so that we can adapt
better so that we could change our habits.
Now, this digital twin of Earth is probably one
of the most ambitious projects that the world's
ever undertaken. And we're taking large steps
every single year, and I'll show you results
every single year. But this year we made
some great breakthroughs. Let's take a look.
On Monday, the storm moves north again in
approach Taiwan. There are big uncertainties
regarding its path. Different paths will
have different levels of impact on Taiwan.
Someday, in the near future, we will have
continuous weather prediction at every
square kilometer on the planet. You will always know
what the climate's going to be. You will always
know. And this will run continuously.
Because we've trained the AI. And the
AI requires so little energy. And so this is just
an incredible achievement. I hope you enjoyed it.
The truth is that was a Jensen AI.
That was not me. I wrote it,
but a Jensen AI had to say it.
That is a miracle,
that is a miracle indeed.
However, in 2012,
something very important happened.
Because of our dedication to advancing CUDA,
Because of our dedication to continuously
improve the performance to drive the
cost down, researchers discovered,
AI researchers discovered CUDA in 2012.
That was NVIDIA's first contact with AI.
This was a very important day. We had the
good wisdom to work with the scientists to
make it possible for deep learning to happen,
and AlexNet achieved the course. A tremendous
computer vision breakthrough. But the great
wisdom was to take a step back and understand
what was the background? What is the foundation
of deep learning? What is this long term impact?
What is its potential? And we realized that
this technology has great potential to scale an
algorithm that was invented and discovered decades
ago. All of a sudden, because of more data,
larger networks, and very importantly, a lot
more compute, all of a sudden, deep learning
was able to achieve what no human algorithm
was able to. Now imagine if it were to scale
up the architecture, even larger networks, more
data, and more compute, what could be possible.
So we dedicated ourselves to reinvent everything.
After 2012, we changed the architecture of our GPU
to add tensor cores. We invented NVLink. That
was ten years ago now. cuDNN, TensorRT, NCCL.
We bought Mellanox, TensorRT-LLM, the Triton
Inference Server, and all of it came together
on a brand new computer. Nobody understood,
nobody asked for it, nobody understood it.
And in fact, I was certain nobody wanted to buy
it. And so we announced it at GTC and OpenAI,
a small company in San Francisco, saw it,
and they asked me to deliver one to them.
I delivered the first DGX to the world's first
AI Supercomputer, to OpenAI in 2016. Well,
after that, we continued to scale from
one AI Supercomputer, one AI appliance.
We scaled it up to large supercomputers
even larger by 2017, the world discovered
transformers so that we could
train enormous amounts of data
and recognize and learn patterns that are
sequential over large spans of time. It
is now possible for us to train these
large language models to understand and
achieve a breakthrough in natural language
understanding. And we kept going after that.
We built even larger ones.
And then in November 2022, trained on thousands,
tens of thousands of NVIDIA GPUs and a very
large AI Supercomputer. OpenAI announced
ChatGPT 1 million users after five days,
1 million after five days, 100 million after
two months. The fastest growing application in
history. And the reason for that is very simple.
It is just so easy to use, and it was so magical to use.
To be able to interact with a computer like it's
human, instead of being clear about what you want.
It's like the computer understands your meaning.
It understands your intention. Oh, I think here
it, asked, the closest night, market night. As you
know, the night market is very important to me.
So when I was young, I was, I think I was
four and a half years old. I used to love
going to the night market, because
I just love watching people and,
so we went. My parents used
to take us to the night market.
And I love going, and one day, my face,
you guys might see that I have a large scar on
my face. My face was cut because somebody was
washing their knife, and I was a little
kid. But my memories of the night market
is, so deep because of that. And I used to love
it, I just still love going to the night market.
And I just need to tell you guys that the night
market is really good because there's a lady,
she's been working there for 43 years. She's
the fruit lady. And it's in the middle of
the middle between the two. Go find her.
Okay.
She's really terrific. I think it'll
be funny after this. All of you go to
see her. She. Every year she's doing better and
better. And her cart has improved. And. Yeah,
I just love watching her succeed.
Anyways. Anyways, ChatGPT came along and,
and something is very important in the
slide. Here, let me show you something.
This slide. Okay. And this slide. The fundamental
difference is this - until ChatGPT revealed it to
the world. AI was all about perception, natural
language understanding, computer vision,
speech recognition. It's all about perception and
detection. This was the first time the world saw
a generative AI. It produced tokens one token
at a time. And those tokens were words. Some
of the tokens, of course, could now be images or
charts or tables, songs, words, speech, videos.
Those tokens could be anything that you
could learn the meaning of. It could be
tokens of chemicals, tokens of proteins, genes
you saw earlier in Earth-2. We were generating
tokens of the weather. We can learn physics.
If you can learn physics, you could teach an
AI model physics. The AI model could learn the
meaning of physics and it can generate physics.
We were scaling down to one kilometer,
not by using filtering. It was generating.
And so we can use this method to
generate tokens for almost anything,
almost anything of value. We can generate
steering wheel control for a car. We can
generate articulation for a robotic
arm. Everything that we can learn,
we can now generate. We have now arrived
not at the AI Era, but a Generative AI Era.
But what's really important is this.
This computer that started out as a
supercomputer has now evolved into a
data center, and it produces one thing.
It produces tokens. It's an AI factory.
This AI factory is generating, creating,
producing something of great value,
a new commodity. In the late 1890s,
Nikola Tesla invented an AC generator. We invented
an AI generator. The AC generator generates electrons.
NVIDIA's AI generator generates tokens.
Both of these things have large market
opportunities. It's completely fungible in
almost every industry. And that's why it's
a new industrial revolution. We have now
a new factory producing a new commodity
for every industry. That is of an extraordinary
value. And the methodology for doing this is
quite scalable. And the methodology
of doing this is quite repeatable.
Notice how quickly so many different AI models,
Generative AI models are being invented literally
daily. Every single industry is now piling
on. For the very first time, the IT industry,
which is $3 trillion, $3 trillion, IT
industry is about to create something that
can directly serve $100 trillion of industry,
no longer just an instrument for information
storage or data processing, but a factory for
generating intelligence for every industry.
This is going to be a manufacturing industry,
not a manufacturing industry of computers,
but using the computers in manufacturing.
This has never happened before. Quite an
extraordinary thing. What started
with accelerated computing, led to AI,
led to generative AI, and now an industrial
revolution. Now the impact to our industry is
also quite significant. Of course,
we could create a new commodity,
a new product we call tokens for many industries.
But the impact to ours is also quite profound.
For the very first time, as I was saying earlier,
in 60 years, every single layer of computing has
been changed from CPUs. General purpose computing
to accelerated GPU computing, where the computer
needs instructions. Now computers process
LLMs, large language models, AI models,
and whereas the computing model of the past is
retrieval based, almost every time you touch your
phone, some pre-recorded text or prerecorded
image or prerecorded video is retrieved.
For you and recomposed based on a recommender
system to present it to you based on your
habits. But in the future, your computer will
generate as much as possible, retrieve only
what's necessary. And the reason for that is
because generated data requires less energy to
go fetch information. Generated data also is more
contextually relevant. It will encode knowledge.
It will improve your understanding
of you. And instead of,
"get that information for me" or "get
that file for me", you just say that, "ask me
for an answer", and instead of a tool, instead
of your computer being a tool that we use,
the computer will now generate skills.
It performs tasks. And instead of an
industry that is producing software which was
a revolutionary idea in the early 90s, remember
the idea that Microsoft created for packaging
software revolutionized the PC industry?
Without packaged software,
what would we use the PC to do?
It drove this industry, and now we
have a new factory, a new computer,
and what we will run on top of this is a
new type of software and we call it NIMs
NVIDIA Inference Microservices. Now what happens
is the NIM runs inside this factory and this
NIM is a pre-trained model. It's an AI. Well,
this AI is of course quite complex in itself.
But the computing stack that runs AI's
are insanely complex. When you go and
use ChatGPT underneath their stack is a whole
bunch of software. Underneath that prompt is
a ton of software, and it's incredibly
complex because the models are large,
billions to trillions of parameters.
It doesn't run on just one computer
or runs on multiple computers. It has to
distribute the workload across multiple GPUs.
Tensor parallelism. Pipeline parallelism
data parallel all kinds of parallelism.
Expert parallelism. All kinds of parallelism.
Distributing the workload across multiple GPUs.
Processing it as fast as possible. Because if
you are in a factory, if you run a factory, your
throughput directly correlates to your revenues.
Your throughput directly correlates to quality of
service, and your throughput directly correlates
to the number of people who can use your service.
We are now in a world where data center
throughput utilization is vitally important.
It was important in the past, but not vitally
important. It was important in the past,
but people don't measure it today. Today, every parameter
is measured. Start time, up time, utilization,
throughput, idle time, you name it because
it's a factory. When something is a factory,
it's operations directly correlate to the
financial performance of the company and
so we realize that this is incredibly
complex for most companies to do.
So what we did was we created
this AI in a box and a container,
an incredible amount of software. Inside
this container is CUDA, cuDNN, TensorRT,
Triton for inference services. It is cloud
native so that you could auto scale in a
Kubernetes environment. It has management
services and hooks so that you can monitor
your AIs. It has common APIs, standard API
so that you can literally chat with this box.
You download this NIM and you can talk to
it. So long as you have CUDA on your computer,
which is now, of course, everywhere.
It's in every cloud available from every
computer maker. It is available in hundreds
of millions of PCs. When you download this,
you have an AI and you can chat
with it like ChatGPT. All of the
software is now integrated. 400
dependencies, all integrated into one.
We tested this NIM, each one of these
pre-trained models against all kinds,
our entire install base that's in the
cloud. All the different versions of Pascal
and Ampere's and hoppers and all kinds
of different versions. I even forget some.
NIMs. Incredible invention.
This is one of my favorites.
And of course, as you know, we now have the
ability to create large language models and
pre-trained models of all kinds. And
we have all of these various versions,
whether it's language based or
vision based or imaging based,
or we have versions that are available
for health care, digital biology.
We have versions that are digital humans
that I'll talk to you about and the way
you use this, just come to AI.NVIDIA.com
and today we just posted
up in Hugging Face the Llama 3 NIM fully
optimized. It's available there for you
to try and you can even take it with
you. It's available to you for free.
And so you could run it in the cloud, run in
any cloud. You could download this container,
put it into your own data center, and you
could host it, make it available for your
customers. We have, as I mentioned, all kinds
of different domains of physics. Some of it
is for semantic retrieval called RAGs, vision
languages, all kinds of different languages.
And the way that you use it is
connecting these microservices
into large applications. One of the most important
applications in the coming future, of course,
is customer service agents. Customer service
agents are necessary in just about every single
industry. It represents trillions of dollars
of customer service around the world. Nurses
are customer service agents. In some ways, some of
them are non-prescription or non diagnostics-based
nurses are essentially customer service, customer
service for retail for quick service foods,
financial services, insurance. Just tens and
tens of millions of customer service can now
be augmented by language models and augmented by
AI. And so these boxes that you see are basically
NIMs. Some of the NIMs are reasoning agents.
Given a task, figure out what the mission is.
Break it down into a plan. Some of the
NIMs retrieve information. Some of the
NIMs might go and do search. And some of the
NIMs, might use a tool like cuOPT that I
was talking about earlier that could use
a tool that could be running on SAP. And
so it has to learn a particular language called
ADAP maybe some names have to do SQL queries.
And so all of these NIMS are experts that are
now assembled as a team. So what's happening?
The application layer has been changed. What used
to be applications written with instructions are
now applications that are assembling teams,
assembling teams of AIs. Very few people know
how to write programs. Almost everybody knows
how to break down a problem and assemble teams.
Every company I believe in the future
will have a large collection of NIMs,
and you would bring down the experts that you
want. You connect them into a team. And you don't
even have to figure out exactly how to connect
them. You just give the mission to an agent,
to a NIM to figure out who to break
the tasks down and who to give it to,
and that that central the leader of
the of the application, if you will,
the leader of the team would break down the
task and give it to the various team members.
The team members would perform their task,
bring it back to the team leader. The team
leader would reason about that and present
information back to you. Just like humans,
this is in our near future. This is the way
applications are going to look. Now of course
we could interact with these large, these AI
services with text prompts and speech prompts.
However, there are many applications
where we would like to interact with
what is otherwise a human-like form. We call
them digital humans. NVIDIA has been working
on digital human technology for some
time. Let me show it to you. And well,
before I do that, hang on
a second before I do that,
okay? Digital humans have the potential of being
a great interactive, interactive agent with you.
They are much more engaging. They can
be much more empathetic. And of course,
we have to cross this incredible chasm, this
uncanny chasm of realism so that the digital
humans would appear much more natural. This is, of
course, our vision. This is a vision of where we
love to go. but let me show you where we are.
Great to be in Taiwan. Before I head out to
the night market, let's dive into some
exciting frontiers of digital humans.
Imagine a future where computers
interact with us just like humans can.
Hi, my name is Sophie and I am a digital
human brand ambassador for Unique.
This is the incredible reality of digital humans.
Digital humans will revolutionize industries from
customer service to advertising and gaming. The
possibilities for digital humans are endless.
Using the scans you took of your
current kitchen with your phone…
They will be AI interior designers, helping
generate beautiful photo realistic suggestions
and sourcing the materials and furniture.
…. we have generated several design
options for you to choose from.
They'll also be AI customer service agents, making
the interaction more engaging and personalized
for digital health care workers who will check on
patients. Providing timely, personalized care.
I did forget to mention to the doctor that I
am allergic to penicillin, so it's
still okay to take the medication.
The antibiotics you've been
prescribed, ciprofloxacin and
metronidazole don't contain penicillin, so
it's perfectly safe for you to take them.
And they'll even be AI brand ambassadors. Setting
the next marketing and advertising trends.
Hi, I'm Imma, Japan's first virtual model.
New breakthroughs in generative AI and computer
graphics let digital humans see, understand
and interact with us in human-like ways.
From what I can see, it looks like you're in
some kind of recording or production setup.
The foundation of digital humans are
AI models built on multilingual speech
recognition and synthesis, and LLMs that
understand and generate conversation.
The AI's connect to another generative AI to
dynamically animate a lifelike 3D mesh of a
face. And finally, AI models that reproduce
lifelike appearances, enabling real time path
traced subsurface scattering to simulate the
way light penetrates the skin, scatters and
exits at various points, giving skin its soft and
translucent appearance. NVIDIA ACE is a suite
of digital human technologies packaged as easy to
deploy, fully optimized microservices or NIMs.
Developers can integrate ACE NIMs into
their existing frameworks, engines,
and digital human experiences. Nemotron,
SLM and LLM NIMs to understand our intent
and orchestrate other models. Riva speech NIMs
for interactive speech and translation. Audio
to face and gesture NIMs for facial and body
animation. And Omniverse RTX with DLSS for
neural rendering of skin and hair. ACE NIMs run on
NVIDIA GDN, a global network of NVIDIA accelerated
infrastructure that delivers low latency
digital human processing to over 100 regions.
Pretty incredible. Well, those ACE run in
the cloud, but it also runs on PCs. We had
the good wisdom of including Tensor core GPUs
in all of RTX. So we've been shipping AI GPUs
for some time. Preparing ourselves for this day.
The reason for that is very simple. We always knew
that in order to create a new computing
platform, you need install base first.
Eventually, the application will come. If you
don't create the install base, how could the
application come? And so if you build it,
they might not come. But if you build it,
if you don't build it, they cannot come.
And so we installed every single RTX GPU
with Tensor core processing. And now we have
100 million GeForce RTX AI PCs in the world.
And we're shipping 200. And this Computex we're
featuring four new amazing laptops. All of them
are able to run AI. Your future laptop,
your future PC will become an AI. It'll
be constantly helping you, assisting you in the
background. The PC will also run applications
that are enhanced by AI. Of course, all your
photo editing you're writing and your tools.
All the things that you use will
all be enhanced by AI and your
PC will also host applications with
digital humans that are AIs. And so
there are different ways that AIs will
manifest themselves and become used
in PCs. But PCs will become a very important
AI platform. And so where do we go from here?
I spoke earlier about the
scaling of our data centers,
and every single time we scaled,
we found a new phase change.
When we scale from DGX into large AI
supercomputers. We enabled Transformers
to be able to train on enormously large data sets.
Well, what happened was in the beginning, the data
was human supervised. It required human labeling
to train AIs. Unfortunately, there is only so
much you can human-label. Transformers made it
possible for unsupervised learning to happen.
Now Transformers just look at an enormous amount
of data, or look at an enormous amount of video
and look at more enormous amount of images. And
it can learn from studying, enormous amount of
data, find the patterns and relationships
itself. Well, the next generation of AI
needs to be physically based. Most of the AI
today don't understand the laws of physics.
It's not grounded in the physical world. In
order for us to generate images and videos
and 3D graphics and many physics phenomenons,
we need AIs that are physically based and
understand the laws of physics. Well, the
way that you could do that is, of course,
learning from video is one source. Another
way is synthetic data simulation data.
And another way is using computers to learn
with each other. This is really no different
than using AlphaGo. Having AlphaGo play
itself self-play. And between the two
capabilities, the same capabilities play each
other for a very long period of time. They
emerge even smarter. And so you're going to
start to see this type of AI emerging. Well,
if the AI data is synthetically generated
and using reinforcement learning,
it stands to reason that the rate of
data generation will continue to advance.
And every single time data generation
grows, the amount of computation that
we have to offer needs to grow with it.
We are about to enter a phase where AIs can
learn the laws of physics and understand and
be grounded in physical world data. And so
we expect that models will continue
to grow and we need larger GPUs.
Well, Blackwell was designed for this generation.
This is Blackwell and it has several very
important technologies. one of course,
is just the size of the chip. We took two of
the largest, a chip that is as large as you
can make it at TSMC. And we connected two of
them together with a ten terabytes per second
link between the world's most advanced
SerDes, connecting these two together.
We then put two of them on a computer node
connected with a Grace CPU, the Grace CPU
could be used for several things. In the training
situation, it could be used. It could be used for
fast checkpoint and restart. In the case of
inference and generation, it could be used for
storing context memory so that the AI has memory
and understands the context of the conversation
you would like to have. It's our second
generation transformer engine. Transformer
engine allows us to adapt dynamically to
a lower precision based on the precision
and the range necessary for that
layer of computation. This is our
second generation GPU that has secure
AI so that you could ask your service
providers to protect your AI from being
either stolen from theft or tampering.
This is our fifth generation NVLink. NVLink
allows us to connect multiple GPUs together,
and I'll show you more of that in a second.
And this is also our first generation with a
reliability and availability engine. This
RAS system allows us to test every single
transistor flip flop memory on chip, memory off
chip so that we can, in the field, determine
whether a particular chip is failing. The
MTBF, or, the mean time between failure,
of a supercomputer with 10,000
GPUs is measured in hours.
The mean time between failure of a supercomputer
with 100,000 GPUs is measured in minutes, and so
the ability for a supercomputer to run for a long
period of time and train a model that could last
for several months is practically impossible.
If we don't invent technologies to enhance
its reliability. Reliability would, of course,
enhances uptime, which directly affects the cost.
And then lastly, decompression engine
data processing is one of the most
important things we have to do. We added a data
compression engine decompression engine so that
we can pull data out of storage 20 times
faster than what's possible today. Well,
all of this represents Blackwell, and I think we
have one here that's in production during GTC.
I showed you Blackwell in a prototype state.
The other side?
This is why we practice.
Ladies and gentlemen, this is Blackwell.
Blackwell is in production.
Incredible amounts of technology.
This is our production board.
This is the most complex,
highest performance computer
the world's ever made.
This is the Grace CPU. And these are, you
can see each one of these Blackwell dies,
two of them connected together. You see that
it is the largest die, the largest chip the
world makes. And then we connect two of
them together with a ten terabyte per
second link. Okay. And that makes the Blackwell
computer. And the performance is incredible.
Take a look at this. So, you see, you see,
the computational, the FLOPs, the AI FLOPs,
for each generation has increased by a
thousand times in eight years. Moore's
law in eight years is something along
the lines of, oh, I don't know, maybe 40,
60. And in the last eight years, Moore's law has
gone a lot, lot less. And so just to compare,
even Moore's Law as best of times
compared to what Blackwell could do.
So the amount of computations is incredible.
And whenever we bring the computation high,
the thing that happens is the cost goes down. And
I'll show you what we've done is we've increased
through its computational capability, the energy
used to train a GPT-4, 2 trillion parameter,
8 trillion tokens. The amount of energy
that is used has gone down by 350 times.
Well, Pascal would have taken 1,000 gigawatt
hours. 1,000 gigawatt hours means that it would
take a gigawatt data center. The world doesn't
have a gigawatt data center, but if you had a
gigawatt data center, it would take a month. If
you had a 100 watt, 100 megawatt data center,
it would take about a year. And so nobody
would. Of course, create such a thing.
And, and that's the reason why these large
language models ChatGPT was impossible
only eight years ago. By us driving
down, the increasing the performance,
the energy efficient, while keeping and
improving energy efficiency along the way,
we've now taken with Blackwell what used
to be 1,000 gigawatt hours to three,
an incredible advance, three gigawatt
hours. If it's a, 10,000 GPUs,
for example, it would only take a 10,000 GPUs.
I guess it would take a few days, ten days or
so. So the amount of advance in just eight years
is incredible. Well, this is for inference. This
is for token generation. Our token generation
performance has made it possible for us to drive
the energy down by 45,000 times, 17,000
joules per token. That was Pascal 17,000 joules.
It's kind of like two light bulbs running
for two days. It would take two light bulbs
running for two days. Amounts of energy, 200W
running for two days to generate one token of
GPT-4. It takes about three tokens to
generate one word. And so the amount of
energy used necessary for Pascal to
generate GPT-4 and have a
ChatGPT experience with you was practically
impossible. But now we only use 0.4 joules
per token, and we can generate tokens at
incredible rates and very little energy. Okay,
so Blackwell is just an enormous leap.
Well, even so, it's not big enough.
And so we have to build even larger machines.
And so the way that we build it is called DGX.
So this is our Blackwell chips.
And it goes into DGX systems.
That's why we should practice.
So this is a DGX Blackwell. This is air cooled
and has eight of these GPUs inside. Look at the
size of the heat sinks on these GPUs. About
15kW, 15,000W and completely air cooled.
This version supports x86. And it goes into
the infrastructure that we've been shipping
hoppers into. However, if you would like to
have liquid cooling, we have a new system.
And this new system, it's based on this
board and we call it MGX for modular. And
this modular system you won't be able to see
this. Can they see this? Can you see this?
And so this is the MGX system. And here's
the two, Blackwell boards of this one
node has four Blackwell chips, these four
Blackwell chips. This is liquid cooled.
Nine of them, nine of them. Well,
72 of these, 72 of these GPUs,
72 of these GPUs are then connected
together with a new NVLink. This is NVLink
Switch, Fifth generation. And the NVLink Switch
is a technology miracle. This is the most advanced
switch the world's ever made. The data rate
is insane. And these switches connect every
single one of these Blackwells to each other
so that we have one giant 72 GPU Blackwell.
Well, the benefit. The benefit
of this is that in one domain,
one GPU domain, this now looks like one GPU.
This one GPU has 72 versus the last generation
of eight. So we increased it by nine times
the amount of bandwidth we've increased by 18
times the AI FLOPs. We've increased by 45 times.
And yet the amount of power is only ten times.
This is 100kW and that is ten kilowatts.
And that's for one. Now of course, well,
you can always connect more of these together.
And I'll show you how to do that in a second.
But what's the miracle is this chip, this
NVLink chip. People are starting to awaken
to the importance of this NVLink chip as it
connects all these different GPUs together.
Because the large language models are so large, it
doesn't fit on just one GPU, doesn't fit on one,
just just one node. It's going to take the entire
rack of GPUs like this new DGX that I that I was
just standing next to, to hold a large language
model that are tens of trillions of parameters,
large NVLink switch and it solves a technology
miracle is 50 billion transistors, 74 ports at
400 gigabits each, 4 links cross-sectional
bandwidth of 7.2 terabytes per second.
But one of the important things is that
it has mathematics inside the switch,
so that we can do reductions, which is really
important in deep learning right on the chip.
And so this is what, this is what a DGX
looks like now. And a lot of people ask
us, you know, they say, and there's this,
there's this confusion about what NVIDIA
does and, and, how is it possible that
NVIDIA became so big building GPUs?
And so there's an impression that this is what
a GPU looks like. Now, this is a GPU. This is
one of the most advanced GPUs in the world.
But this is a gamer GPU. But you and I know
that this is what a GPU looks like. This is one
GPU. Ladies and gentlemen DGX GPU. You know.
The back of this GPU is the NVLink spine.
The NVLink spine is 5,000 wires, two miles.
And it's right here. This is an NVLink spine and
it connects 72 GPUs to each other. This
is an electrical mechanical miracle. The
transceivers make it possible for us to
drive the entire length in copper. And as a
result, this switch, the NVLink switch
driving the NVLink spine in copper makes
it possible for us to save 20kW in one rack.
20kW can now be used for processing. Just an
incredible achievement. So
this is the NVLink spine.
And even this is not big
enough, even this is not big enough
for an AI factory. So we have to connect it
all together with very high speed networking.
Well, we have two types of networking.
We have InfiniBand, which has been used
in Supercomputing and AI factories all over the
world, and it is growing incredibly fast for us.
However, not every data center can handle
InfiniBand because they've already invested
their ecosystem in Ethernet for too long, and
it does take some specialty and some expertise
to manage InfiniBand switches and InfiniBand
networks. And so what we've done is we've brought
the capabilities of InfiniBand to the Ethernet
architecture, which is incredibly hard. And the
reason for that is this Ethernet was designed for
high average throughput because every single node,
every single computer's connected to
a different person on the internet.
And most of the communications is the data center
with somebody on the other side of the internet.
However, deep learning and AI factories, the GPUs
are not communicating with people on the internet.
Mostly it's communicating with each other.
They're communicating with each other because
they're all collecting partial products, and
they have to reduce it and then redistribute it.
Chunks of partial products reduction,
redistribution. That traffic is incredibly bursty,
and it is not the average throughput that matters.
It's the last arrival that matters. Because if
you're reducing collecting partial products
from everybody, if I'm trying to take all of your...
[Speaks in Chinese]
so it's not the average throughput
it's whoever gives me the answer last,
okay. Ethernet has no provision for
that. And so there are several things
that we had to create. We created an
end to end architecture so that the
NIC and the switch can communicate. And
we applied four different technologies to
make this possible. Number one NVIDIA
has the world's most advanced RDMA.
And so now we have the ability to have a network
level RDMA for Ethernet. That is incredibly great.
Number two, we have congestion control. The
switch does telemetry at all times incredibly
fast. And whenever the
NICs are sending too much information,
we can tell them to back off so
that it doesn't create hotspots.
Number three, adaptive routing. Ethernet needs to
transmit and receive in order. We see congestions
or we see ports that are not currently being
used. Irrespective of the ordering. We will
send it to the available ports and Bluefield on
the other end, reorders it so that it comes back
in order. That adaptive routing is incredibly
powerful. And then lastly, noise isolation.
There's more than one model being trained or
something happening in the data center at all
times, and their noise and their traffic could
get into each other and causes jitter. And so
when it's when the noise of one training
model, one model training causes the last
arrival to end up too late, it really slows
down the training. Well, overall, remember you
have built a $5 billion or a $3 billion data
center, and you're using this for training.
If the utilization, network utilization
was 40% lower and as a result, the training
time was 20% longer, the $5 billion data center
is effectively like a $6 billion data center.
So the cost impact is quite high.
Ethernet with Spectrum-X basically
allows us to improve the performance so
much that the network is basically free.
And so this is really quite an achievement.
We have a whole pipeline of Ethernet products
behind us. This is Spectrum-X800. It is 51.2
terabits per second and 256 Radix. The next
one coming is 512 Radix is one year from now,
512 Radix and that's called Spectrum-X800
Ultra. And the one after that is Spectrum-X1600.
But the important idea is this X800 is designed
for tens of thousands, tens of thousands of
GPUs. X800 Ultra is designed for hundreds of
thousands of GPUs, and X1600 is designed for
millions of GPUs. The days of millions of GPU
data centers are coming, and the reason for that
is very simple. Of course, we want to train much
larger models, but very importantly in the future,
almost every interaction you have with the
internet or with a computer will likely have a
generative AI running in the cloud somewhere,
and that generative AI is working with you,
interacting with you, generating videos or
images or text, or maybe a digital human.
And so you're interacting with your computer
almost all the time. And there's always a
generative AI connected to that. Some of it
is on prem, some of it is on your device,
and a lot of it could be in the cloud.
These generative AIs will also do a lot
of reasoning capability instead of just one
shot answers. They might iterate on answers.
So that it'd improve the quality of the
answer before they give it to you. And so
the amount of generation we're going to do in
the future is going to be extraordinary. Let's
take a look at all of this put together now,
tonight, this is our first nighttime keynote.
I want to thank all of you for coming out tonight
at 7:00. And so what I'm about to show you
has a new vibe. Okay, there's a new vibe. This is
kind of the nighttime keynote vibe, so enjoy this.
Now, you can't do that in a morning keynote.
I think that style of keynote has never been
done in Computex ever. Might be the last.
Only NVIDIA can pull off
that. Only I could do that.
Blackwell, of course. is the first generation
of NVIDIA platforms that was launched at the
beginning, right as the world knows, the
generative AI era is here. Just as the world
realized the importance of AI factories, just as
the beginning of this new industrial revolution,
we have so much support from nearly every OEM,
every computer maker, every CSP, every GPU,
cloud, sovereign clouds, even telecommunication
companies, enterprises all over the world.
The amount of success, the amount
of adoption, the amount of, of,
enthusiasm for Blackwell is just really off the
charts. And I want to thank everybody for that.
We're not stopping there. During this, during the
time of this incredible growth, we want to make
sure that we continue to enhance performance,
continue to drive down cost, cost of training,
cost of inference, and continue to scale out
AI capabilities for every company to embrace.
The further performance we
drive up, the greater the cost decline.
Hopper platform, of course, was the most
successful data center processor probably
in history. And this is just an incredible,
incredible success story. However, Blackwell
is here and every single platform, as you'll
notice, are several things. You got the CPU,
you have the GPU, you have NVLink, you have the
NIC and you have the switch, the NVLink switch,
connects all of the GPUs together as large
of a domain as we can and whatever we can do,
we connect it with large, very
large and very high speed switches.
Every single generation, as you'll see, is
not just a GPU, but it's an entire platform.
We build the entire platform, we integrate the
entire platform into an AI factory supercomputer,
however, then we aggregate it and offer it to the
world. And the reason for that is because all of
you could create interesting and innovative
configurations and all kinds of different
styles and fit, different data centers, and
different customers in different places.
Something for edge, something for telco. And all
of the different innovations are possible if we
made the systems open and make it possible for
you to innovate. And so we design it integrated,
but we offer it to you disintegrated so that
you could create modular systems. The Blackwell
platform is here. Our company is on a one year
rhythm where our basic philosophy is very simple:
build the entire data center scale disaggregated
and sell to you in parts on a one year rhythm.
And we push everything that technology limits.
Whatever TSMC process technology we'll push it
to the absolute limits. Whatever packaging
technology, push it to the absolute limits,
whatever memory technology, push it
to absolute limits, SerDes technology,
optics, technology, everything is pushed
to the limit. Well, and then after that,
do everything in such a way so that all of
our software runs on this entire install base.
Software inertia is the single
most important thing in computers.
When a computer is backwards compatible
and is architecturally compatible with all the
software that has already been created. Your
ability to go to market is so much faster.
And so the velocity is incredible when we
can take advantage of the entire install
base of software has already been created. Well,
Blackwell is here next year is Blackwell Ultra,
just as we had H100 and H200, you'll probably
see some pretty exciting new generations from
us for Blackwell Ultra again as we push the
limits and the next-generation Spectrum switch.
As I mentioned. Well, this is the very
first time that this next click has been
made. And I'm not sure yet whether
I'm going to regret this or not.
We have code names in our company and we
try to keep them very secret. Oftentimes,
most of the employees don't even know, but our
next generation platform is called Rubin, the
Rubin platform. The Rubin platform- I'm not going
to spend much time on it. I know what's going
to happen. You're going to take pictures of it,
and you're going to go look at the fine prints.
And feel free to do that. So we have the Rubin
platform, and one year later we have the Rubin
Ultra platform. All of these chips that I'm
showing you here are all in full development,
100% of them. And the rhythm is one
year at the limits of technology.
All are architecturally compatible. So
this is basically what NVIDIA is building.
And all of the richest of software on
top of it. So in a lot of ways the last
12 years from that moment of ImageNet and
us realizing that the future of computing
was going to radically change to today is
really exactly as I was holding up earlier,
GeForce pre 2012 and NVIDIA today. The
company has really transformed tremendously,
and I want to thank all of our partners here
for supporting us every step along the way.
This is the NVIDIA Blackwell platform.
Let me talk about what's next.
The next wave of AI is physical AI.
AI that understands the laws of physics, AI that can
work among us. And so they have to understand
the world model so that they understand how to
interpret the world, how to perceive the world.
They have to, of course, have excellent cognitive
capabilities so they can understand us, understand
what we asked and perform the tasks. In the future,
Robotics is a much more pervasive
idea. Of course, when I say robotics,
there's a humanoid robotics that's usually the
representation of that. But that's not at all
true. Everything is going to be robotic.
All of the factories will be robotic,
the factories will orchestrate robots,
and those robots will be building products
that are robotic. Robots interacting with
robots, building products that are robotic.
Well, in order for us to do that, we need to make
some breakthroughs. And let me show you the video.
The era of robotics has arrived. One day,
everything that moves will be autonomous.
Researchers and companies around the world
are developing robots powered by physical AI.
Physical AIs are models that can understand
instructions and autonomously perform complex
tasks in the real world. Multimodal LLMs are
breakthroughs that enable robots to learn,
perceive, and understand the world
around them and plan how they'll act.
And from human demonstrations, robots can now
learn the skills required to interact with the
world using gross and fine motor skills. One
of the integral technologies for advancing
robotics is reinforcement learning. Just
as LLMs need RLHF or reinforcement learning
from human feedback. To learn particular
skills, generative physical AI can learn
skills using reinforcement learning from
physics feedback in a simulated world.
These simulation environments are where robots
learn to make decisions by performing actions
in a virtual world that obeys the
laws of physics. In these robot gyms,
a robot can learn to perform complex
and dynamic tasks safely and quickly,
refining their skills through millions of
acts of trial and error. We built NVIDIA
Omniverse as the operating system
where physical AI's can be created.
Omniverse is a development platform for
virtual world simulation, combining real time,
physically based rendering from physics simulation
and generative AI technologies. In Omniverse,
robots can learn how to be robots. They learn how
to autonomously manipulate objects with precision,
such as grasping and handling objects,
or navigate environments autonomously,
finding optimal paths while avoiding
obstacles and hazards. Learning in
Omniverse minimizes the sim-to-real gap and
maximizes the transfer of learned behavior.
Building robots with generative physical AI
requires three computers: NVIDIA AI supercomputers
to train the models; NVIDIA Jetson Orin and next
generation Jetson Thor Robotics supercomputer to
run the models; and NVIDIA Omniverse, where
robots can learn and refine their skills
in simulated worlds. We build the platforms,
acceleration libraries and AI models needed by
developers and companies and allow them to use
any or all of the stacks that suit them best.
The next wave of AI is here. Robotics powered
by physical AI will revolutionize industries.
This isn't the future. This is happening now.
There are several ways that we're going to serve
the market. First, we're going to create
platforms for each type of robotic system,
one for robotic factories and warehouses,
one for robots that manipulate things,
one for robots that move and one for robots
that are humanoid. And so each one of these
robotics platform is like almost
everything else we do a computer acceleration
libraries and pre-trained models, computers,
acceleration libraries, pre-trained models.
And we test everything. We train everything
and integrate everything inside Omniverse,
where Omniverse is, as the video was saying,
where robots learn how to be robots. Now,
of course, the ecosystem of
robotic warehouses is really,
really complex. It takes a lot
of companies, a lot of tools,
a lot of technology to build a modern warehouse.
And warehouses are increasingly robotic.
But one of these days will be fully robotic.
And so in each one of these ecosystems,
we have SDKs and APIs that are connected into
the software industry, SDKs and APIs connected
into edge AI industry and companies. And then
also, of course, systems that are designed for
PLCs and robotic systems for the ODMs. It's then
integrated by integrators, created for ultimately,
building warehouses, for customers. Here we have
an example of Kenmac building a robotic warehouse
for Giant Group.
And then here, now let's talk about factories.
Factories have a completely different ecosystem.
And Foxconn is building some of the world's most
advanced factories, their ecosystem again, edge
computers and robotics software for designing the
factories, the workflows, programming the robots,
and of course, PLC computers that orchestrate
the digital factories and the AI factories.
We have SDKs that are connected into
each one of these ecosystems as well.
This is happening all over Taiwan. Foxconn
has built digital twins of their factories.
Delta is building digital twins of their
factories. By the way, half is real,
half is digital, half is Omniverse.
Pegatron is building digital twins
of their robotic factories.
Wistron is building digital twins
of their robotic factories. And this is really
cool. This is a video of Foxconn's new factory.
Let's take a look.
Demand for NVIDIA accelerated computing
is skyrocketing.
As the world modernizes traditional
data centers into generative AI factories.
Foxconn, the world's largest
electronics manufacturer,
is gearing up to meet this demand by building
robotic factories with NVIDIA Omniverse in AI.
Factory planners use Omniverse
to integrate facility and equipment data
from leading industry applications like
Siemens, Teamcenter X and Autodesk Revit.
In the digital twin, they optimize floor
layout and line configurations and locate
optimal camera placements to monitor future
operations within NVIDIA Metropolis-powered
vision AI. Virtual integration saves planners
on the enormous cost of physical change orders.
During construction, the Foxconn
teams use the digital twin as the
source of truth to communicate and
validate accurate equipment layout.
The Omniverse digital twin is also the robot gym,
where Foxconn developers train and test NVIDIA
Isaac AI applications for robotic perception and
manipulation, and Metropolis AI applications for
sensor fusion. In Omniverse, Foxconn simulates
two robot AIs before deploying runtimes to
Jetson computers. On the assembly line, they
simulate Isaac Manipulator libraries and AI
models for automated optical inspection for object
identification, defect detection, and trajectory planning.
To transfer HGX systems to the test pods,
they simulate Isaac Perceptor powered robot AMRs
as they perceive and move about their environment
with 3D mapping and reconstruction.
With Omniverse, Foxconn builds their robotic factories
that orchestrate robots running on NVIDIA
Isaac to build NVIDIA AI supercomputers,
which in turn train Foxconn's robots.
So a robotic factory is designed with three
computers. Train the AI on NVIDIA AI.
You have the robot running on the PLC systems
for orchestrating the factories. And then you,
of course, simulate everything inside
Omniverse. While the robotic arm and
the robotic AMRs are also the same way.
Three computer systems. The difference is
the two Omniverses will come together,
so they'll share one virtual space.
When they share one virtual space,
that robotic arm will become inside
the robotic factory. And again three computers.
And we provide
the computer the acceleration layers
and pre-trained, pre-trained models.
We've connected NVIDIA Manipulator
and NVIDIA Omniverse with Siemens,
the world's leading industrial automation
software and systems company. This is
really a fantastic partnership and they're
working on factories all over the world.
SIMATIC Pick AI now integrates Isaac Manipulator
and SIMATIC Pick AI operates ABB, Kuka, Yaskawa,
Fanuc, Universal Robotics, and TechMan. And so
Siemens is a fantastic integration. We have all
kinds of other integrations. Let's take a look.
ArcBest is integrating Isaac Perceptor into
Vaux Smart Autonomy Robots
for enhanced object recognition
and human motion tracking in material handling.
BYD Electronics is integrating Isaac,
Manipulator and Perceptor into their AI
robots to enhance manufacturing efficiencies for
global customers. idealworks is building Isaac
Perceptor into their iw.os software for AI robots in
factory logistics. Intrinsic, an Alphabet company,
is adopting Isaac Manipulator into their flow
state platform to advance robot grasping.
Gideon is integrating Isaac Perceptor into
Trey AI powered forklifts to advance AI enabled
logistics. Argo Robotics is adopting
Isaac Perceptor into Perception Engine
for advanced vision based AMRs. Solomon
is using Isaac Manipulator AI models in
their AccuPick 3D software for industrial
manipulation tech. TechMan Robot is adopting
Isaac Sim and Manipulator into TMflow,
accelerating automated optical inspection.
Teradyne Robotics is integrating Isaac
Manipulator into PolyScope X for Cobots
and Isaac Perceptor into MiR AMRs. Vention is
integrating Isaac Manipulator into machine
logic for AI manipulation robots.
Robotics is here.
Physical AI is here.
This is not science fiction, and it's
being used all over Taiwan and just really,
really exciting. And that's the factory,
the robots inside. And of course all the
products are going to be robotics. There are
two very high volume robotics products. One,
of course, is the self-driving car or cars that
have a great deal of autonomous capability.
NVIDIA again builds the entire
stack. Next year we're going to
go to production with the Mercedes fleet.
And after that, in 2026, the JLR fleet,
we offer the full stack to the world. However,
you're welcome to take whichever parts,
whichever layer of our stack, just
as the entire drive stack is open.
The next high volume robotics product that's
going to be manufactured by robotic factories
with robots inside will likely be humanoid
robots. And this has made great progress in
recent years in both the cognitive capability
because of foundation models and also the world
understanding capability that we're in the
process of developing. I'm really excited
about this area because obviously the easiest
robot to adapt in the world are humanoid robots,
because we built a world for us.
We also have the vast, the most amount
of data to train these robots than other types of
robots, because we have the same physique. And so
the amount of training data we can provide
through demonstration capabilities and video
capabilities is going to be really great. And so
we're going to see a lot of progress in this area.
Well, I think we have some
robots that we like to welcome.
There we go, about my size.
And we have some friends to join us. So the
future of robotics is here.
The next wave of AI. And of course, you know,
Taiwan builds computers with keyboards. You build
computers for your pocket, you build computers
for data centers in the cloud. In the future,
you're going to build computers that walk
and computers that roll, you know, around.
And, so these are all just computers.
And as it turns out, the technology is
very similar to the technology of building,
all of the other computers that you already
build today. So this is going to be a
really extraordinary journey for us.
I've made one last video, if you don't mind,
something that we really enjoyed
making. And let's run it.
Thank you.
I love you guys. Thank you.
Thank you all for coming. Have a great Computex.
Thank you.