LongCut logo

Jensen Huang: NVIDIA & Samsung Build AI Factory to Transform Global Intelligent Manufacturing | N18G

By CNBC-TV18

Summary

## Key takeaways - **AI Is Rebuilding 60 Years of Computing**: For the first time in 60 years, every layer of the computing stack is being fundamentally changed by AI and accelerated computing. Over a trillion dollars of existing computer infrastructure now needs to be transitioned to this new platform. [09:07], [09:20] - **AI Performs Work, It's Not Just a Tool**: Unlike past software like Excel or web browsers, which are tools humans use, AI performs work. This distinction allows AI to address a hundred-trillion-dollar market of global industries, far larger than the traditional IT tools industry. [10:57], [11:20] - **AI Requires 'Factories' to Generate Intelligence**: Artificial intelligence is the first technology that needs a factory to continuously transform energy into intelligence. These AI factories will become essential national infrastructure, built by every country, much like electricity or the internet. [11:34], [12:19] - **AI Became Profitable This Year**: The recent acceleration in AI is because the intelligence it produces is now so good that customers are paying for it, creating 'profitable tokens'. This has kicked off a virtuous cycle where profits fund more factories, which create better AI, attracting more users. [15:17], [15:48] - **Korea's Unique Opportunity in Physical AI**: Korea is extraordinarily positioned for the next wave of robotics, or physical AI. It is one of very few countries that possess the three essential qualities to succeed: software expertise, deep technical and scientific capability, and a strong manufacturing base. [17:03], [17:32] - **Nvidia to Add 250,000 GPUs in Korea**: Through expanded partnerships with Samsung, SK Group, Hyundai, and Neighbor, Nvidia announced it will build 250,000 more GPUs in Korea. This investment will make Korea one of the largest AI infrastructure countries in the world. [20:56], [21:03]

Topics Covered

  • How AI is Fundamentally Reshaping the Entire Computing Stack
  • AI Performs Work, Not Tools, Addressing a $100 Trillion Economy
  • Why Every Nation Must Build AI Factories Like Utilities
  • How AI's Profitability Created a Virtuous Cycle of Growth
  • Korea's Unique Position to Lead the Physical AI Revolution

Full Transcript

Thank you.

>> Thank you. Do I do it from here?

>> At the center. Wherever you want,

actually.

>> Okay.

>> Are you going to stand there? You're

going to help me.

>> If you need my help,

>> yes.

>> Will you?

[Applause]

>> Nice to see all of you. Nice to see all

of you. Uh, ku chicken is very good.

I enjoyed Chime with my friends and uh

it is the best way to enjoy Korea. I

enjoyed it very much. Uh thank you for

the opportunity to to address you today.

Uh and first of all, congratulations on

on such an incredibly successful APEC.

It tells you something about uh the the

ability for Korea uh to attract to unite

and of course uh chairman Tony Ch's

incredible work to organize what is what

is a historic ape and so I want to

congratulate you for that. Um

the industry as you know

the computer industry that Nvidia is

part of is going through a fundamental

transformation

and every single industry because

computers are effect and impact every

single industry. It is the single most

important instrument of humanity today.

Every single industry is being impacted

as a result of a platform shift we call

artificial intelligence.

Our journey, our journey started over 30

years ago to invent a new way of doing

computing.

The computing approach that we created

and invented is called accelerated

computing. We acknowledge, we recognized

years ago to create a new computing

model to solve problems normal computers

cannot. It has another benefit that when

Moors law runs out of steam, it could be

the path forward for the computer

industry. 33 years later, as we continue

to be able to create more transistors

with every generation of process

technology and even though transistors

performance and power benefits have

slowed tremendously,

we can now continue to expand computing

for as far as we can see because of

accelerated computing. We are now seeing

a platform shift. This platform shift is

was the reason creating the GPU and

inventing the model we call CUDA.

However,

a GPU alone is just a chip. This new

computing approach requires tremendous

amounts of algorithms software to be

developed. We call it CUDA X libraries.

Very few people talk about this, but

this is Nvidia's treasure. These

libraries make it possible for us to

apply accelerated computing to

computational lithography, the work that

we do with Samsung or in deep learning

and robotics, the work that we do with

many companies here that I'll talk

about. It allows us to do quantum

physics. It allows us to do quantum

computing, molecular dynamics, fluid

dynamics,

robotics, of course, artificial

intelligence. These libraries open new

markets for our company. These libraries

are precisely the reason why Nvidia's

computing approach is now available all

over the world in so many different

industries.

But it started from a very humble

beginning. And so I made a short video

for you to give you a feeling for what

Nvidia's technology can do today. It has

been 33 years. In fact, I've been coming

to Korea. Nvidia came to Korea 30 years

ago. We invented the video game industry

together.

I introduced GeForce here to Korea 25

years ago. And last night we had a big

celebration with the esports gamers and

PC gamers here in Korea. It was

incredibly fun to celebrate GeForce 25,

25 years of GeForce. And so I made you a

short video that but as you're watching

this remember

nothing is animated. Everything is

simulated. Everything I will show you is

mathematics. Mathematics. Computer

algorithms that make it possible for us

to do what I'm about to show you. Please

run with me.

>> Ready? Go.

[Music]

[Music]

[Music]

Welcome.

[Music]

[Music]

[Music]

over here.

Heat.

Heat. Heat.

[Music]

[Music]

[Music]

[Applause]

It is incredible. It is incredible how

far technology has come. And what you

saw just now is fundamentally a new

computing approach. One of them is

called accelerated computing. But you

are also seeing artificial intelligence.

Artificial intelligence is of course

affecting every single industry. And

most people think artificial

intelligence is a chatbot as they

should. GBT chat GBT revolutionized

artificial intelligence and put it into

the hands of everybody. However,

artificial intelligence is many things

and I'm going to tell you what it means

to you, what it means to the industry

that we're in so that you have a feeling

for how you can engage artificial

intelligence.

First of all, artificial intelligence is

a whole new computing platform.

The old way of doing software with

handwritten software, hand coding to new

way of doing software where the computer

learns by itself where we train the

computer, we train the model for it to

perform the task we want it to perform.

Artificial intelligence

and AI runs on GPUs whereas handcoded

software runs on CPUs. this entire

software stack from the necessary the

the needs of energy chips the

infrastructure all of the software

associated with its systems the AI

models and the applications on top every

single layer of computing has been

fundamentally changed just think the

computer industry has been largely the

same for 60 years and now with AI and

accelerated computing every single layer

of the computing stack is being changed

All of the computers we've created in

the past, a trillion dollars, maybe more

of computers needs to now be

transitioned, shifted to the new

computing platform.

The second thing to know about AI is

that although transformers

is incredibly successful and very

important, there are many AI models.

There's AI models for languages. But

remember, there's all kinds of

information we want to use AI to solve.

It could be AI for chemicals, proteins,

physics, quantum physics, different

fields of science, even AI for robotics,

AI that understands the physical world.

AI is quite diverse. The number of

algorithms necessary to encompass all of

the world's different AIs is incredibly

vast.

GBT and chat bots is one of them. But

the beautiful thing is with all these

different AI models, we can therefore

revolutionize many applications in many

industries which is the reason why we

are seeing AI affecting literally every

single industry in the world. There are

no industries where intelligence is

fundamentally not necessary.

The observation

and this is a very important very

important idea that the Technology of

the past, software of the past is a tool

that humans use. Excel is a tool. Web

browsers are tools. PowerPoints are

tools. These are very important tools.

But these are tools used by humans. It's

no different than a car that is used by

humans. Is no different than

screwdrivers and hammers that are tools

used by humans. But AI is work.

AI performs work. which is the reason

why everybody realized that AI has the

ability to address the largest

technology industry in history. The

tools industry, the IT industry we know

of the past is a few trillion dollars.

The AI industry can AI can address a

hundred trillion dollars of the world's

industries, make it more productive,

help the GDP growth. And then one more

idea.

Artificial intelligence unlike software

artificial intelligence needs a factory.

This is the first technology that

requires that transforms energy and on a

continuous basis applying a computer

computers that Nvidia builds these GPU

AI supercomputers to generate

intelligence for everybody to use.

single token is generated based on the

context of the time and based on the

questions that you have for the AI. What

that means is the world is going to have

an enormous number of these AI factories

and because AI is going to be integrated

into every single application into every

industry.

AI infrastructure will be built by every

single country

just like electricity just like internet

and now artificial intelligence. AI

factories will be built all over the

world. It is one of the reasons why this

is so consequential to every single

country. It is the reason why it is so

consequential to the conversation we're

having today. AI is an industrial

revolution. It changes the computing

software stack. The software is work not

tools. It addresses extremely large

industries and it requires factories.

Well, in the last couple of years, we've

seen extraordinary progress, and this is

the system that makes it possible. This

is the latest Nvidia system called Grace

Blackwell. This is one giant GPU. It

weighs two tons, has 1 and a half

million parts. It consumes 120,000

watts, 120 kilowatts, and it produces

tokens or produces intelligence at an

incredible speed. This is what a GPU

looks like today. People think that

Nvidia GPUs are like a gaming GPU, but

these GPUs are really massive. Entire

supercomputers interact.

Probably the the question that most

people ask me is what changed this year.

You might have seen that although AI has

been growing quickly, video has been

growing quickly, but in the last 6

months, it seems the growth has really

accelerated

quite substantially. There's a reason

for that.

In the last couple years, AI has made

tremendous progress because we can now

reason and think and solve problems that

we have never been trained before to

solve.

AI now has what's called three scaling

laws. We teach it like a child to

remember, memorize information. We also

teach it called post training how to

perform new skills, how to reason and

how to

And then during inference time, the AIs

today don't just respond with memorized

answers, but it responds by thinking

first. The quality of the answers has

improved tremendously in this last year.

As a result, more people are using it

because the answers are better. You can

use it to solve more problems. When the

answers are better, more people use it.

When more people use it, the amount of

computation necessary continues to grow.

So the way you teach an AI, the

computation is quite substantial. The

way you use an AI today, the amount of

computation is quite substantial. But

the important thing is this. Because

these tokens, these intelligence that

are being produced are so good now,

customers are paying for it. The tokens

have become profitable tokens.

This year AI became profitable. And when

something becomes profitable, you want

to manufacture more of it. Just like

when you're man manufacturing chips and

wafers and DRAM, if the manufacturing of

those chips were profitable, you want to

build more factories to create more

chips. Now that the AI is profitable, we

want to create more factories to

generate more AI. We have now achieved

what is called a virtual cycle. The AIs

get better, more people use it, more

people use it, makes more profit, create

more factories, which allows us to

create even better AIs, which allows

more people to use it. The virtual cycle

of AI has been arrived as it was.

And this is what's this is the reason

why you're seeing the world's capex

going so fast. There are two

fundamentally things fundamental things

that are happening. The first is a

transition as I mentioned from general

purpose computing to accelerated

computing. Mo's law has really run out

of steam. So we need another way of

doing computation. And accelerated

computing is the foundation layer for

that. On top of accelerated computing,

AI has now achieved the virtual cycle,

which is the reason why all of a sudden

we're seeing the amount of capex that

companies are building is growing so

substantially. This is going to happen

here in Korea as well.

Well, the reason why I think this is

such an extraordinary time for Korea is

of course during a platform transition,

it's vital to any technology industry.

It's vital to any industrial nation.

However, for Korea, this is a

extraordinary opportunity because in

very few countries in the world

do you have three fundamental essential

necessary qualities in order to succeed.

The first is you need software. Software

expertise is one of those skills that

Korea has abundance of deep technical

and deep technical and science

capability and third manufacturing

capabilities. When you combine software

and AI technology and manufacturing, you

have the opportunity to really take

advantage of robotics. This is the next

generation of physical AI. And you can

see NVIDIA working in the robotics field

all over the place. This is human and

robotics that we're doing with Figure.

This is the work that we're doing with

Caterpillar turning themselves into a

robotics um industrial company. This is

agility logistics robots. This is

Johnson and Johnson surgical robots, but

the technology has now reached a level

where we are starting to see robotic

systems all over the place. We're also

seeing entire factories become robots.

This is a factory that Nvidia is

building in the United States for our

own AI supercomputers and we're working

with technology companies throughout the

world in order to create a robotic

factory. The entire factory is a giant

robot and inside this robotic factory.

It will orchestrate

robots that are working together with

humans with all of us and they're going

to produce products like self-driving

cars that are robots. So robots,

orchestrating robots, building products

that are robotic. This is the future of

artificial intelligence. And I think

that this is an area that is just so

incredible for Korea because you have

all of the capabilities. You have the

deep technical capabilities. You have

software capability and artificial

intelligence capability. And you also

have such an incredible manufacturing

base, industrial base. Well, this week

we're announcing

several really terrific partnerships,

extension of our partnerships. We have

already I've been working here for so

many years. We have so many different

friends. Neighbor, for example, was one

of our earliest partners. And they

partnered with us to create the world's

third large language model. And that

large language model was Korean. And

they were one of the first customers of

ours in building a supercomput here in

Korea. This week we announced that

neighbor Nvidia will expand our GPU

infrastructure here in Korea by 60,000

GPUs. We're working with Samsung in

manufacturing. Of course, they are the

first partner Nvidia had in building

memory technology to help me invent the

AI supercomputer that is now powering

the world's AI.

We manufacture HBMs here. We've uh of

course uh partnered with Samsung on

manufacturing chips, but now we're going

to advance AI together, build AI factory

together, build digital twins for their

factories together, expansion of our

partnership tremendously, and we're

going to build 50,000 GPU AI factories

with Samsung, working with SK, the SK

group, of course, with HPM memory, but

also in in creating digital twins of

their factories. And we're going to

build 50,000 GPU AI factories with

SK SK group uh for their AI factories

and then Hyundai we partner with them to

build autonomous vehicles but their

factory will become digital twins and

inside these factories will become

robotic factories orchestrating robots

building cars that are robotic and

they're building 50,000 GPUs for their

AI factory total. This week we announced

that we will build 250,000 more GPUs

here in Korea, making Korea one of the

largest GPU or AI infrastructure

countries in the world. And then

finally, it's really vital that we build

the ecosystem, not just the AI

infrastructure of Korea, but the

ecosystem of Korea. So that we partner

with AI researchers here with Korea

universities, amazing universities like

Kais, all the startups that are here to

create an environment necessary for them

to benefit from AI so that there's a

rich ecosystem of AI startups here,

working with the government, working

with uh education, working with the

established companies. This is an

extraordinary time. I want to thank all

of you for welcoming Nvidia with open

arms over the last 30 years. This is the

beginning of a new journey. You were

part of my journey as we were building

Nvidia. I'm honored and grateful that

we're going to be part of your journey

as Korea now becomes an AI nation and

you uh pursue your uh uh your endeavors

to be part of the AI frontier. Thank you

very much.

[Music]

of India.

[Music]

For more news and updates, all you need

to do is follow CNBC TV18 on all of our

digital platforms.

Loading...

Loading video analysis...