Elevate your enterprise data technology and strategy at Transform 2021.
Conversations with Nvidia CEO Jensen Huang are always blunt and illuminating because he still likes to have freewheeling chats with the press. During the recent online-only Computex event, he held a briefing with the press where he talked about the companys recent announcements and then took a lot of questions.
I asked him about the metaverse, the universe of virtual worlds that are all interconnected, like in novels such asSnow CrashandReady Player One. And he gave a detailed answer. Huang addressed a wide range of issues. He talked about Nvidias pending bid to buy Arm for $40 billion, as well as Nvidias effort to create Grace, an Arm-based CPU.
He also addressed progress on Nvidias own Omniverse, dubbed a metaverse for engineers. Huang talked about Nvidias presence in the Chinese market, the companys efforts to discourage miners from buying all of its GPUs, Nvidias data processing units (DPUs), and Moores Laws future and building fabs, competition from Advanced Micro Devices in graphics processing units (GPUs), and Nvidias reaction to the global semiconductor shortage.
I was part of a group of journalists who quizzed Huang. Heres an edited transcript of the group interview.
Above: Nvidia GeForce RTX 3080 Ti is its new card.
Image Credit: GamesBeat
Jensen Huang: Today Im coming to you from Nvidias new building, called Voyager. This is our new facility. It was started about 2-and-a-half years ago. For the last year-and-a-half, Ive not seen it. Todays my first day on campus. Literally, for our event today, this is my first day on campus. Its beautiful here. This facility is going to be the home of 3,500 Nvidians. Its designed as a city inside a building. If you look behind me, its a sprawling city, and its a very large open space. Its largely naturally lit. In fact, right now, as we speak, theres a light in front of me, but everything behind us is barely lit. The reason for that is because there are all these panels in the sky that let light in.
We simulated this entire building using raytracing on our supercomputer DGX. The reason we did that is so we can balance the amount of light that comes in and the amount of energy, or otherwise heat, that we have to remove with air conditioning. The more light you bring in, the more AC you have to use. The less light you bring in, the more lighting you have to use. We have to simulate that fine balance.
The roof of this building is angled in just the right way such that the morning sun doesnt come straight in, and the afternoon sun doesnt come straight in. The slope of the roof line, the slope of the windows along the side, youll see everything was designed in such a way as to balance between natural light, which is comfortable for the eyes, and not having to use as much air conditioning as otherwise necessary. At the moment, no AC at all. This is the first day weve been in here. Its incredibly comfortable.
Using a supercomputer to simulate architecture, I think this is going to happen for all buildings in the future. Youre going to design a building completely in virtual reality. The building is also designed to accommodate many robots. Youll notice the hallways are very wide. In the future we imagine robots roaming the hallways carrying things to people, but also for telepresence, virtual presence. You can upload yourself into a robot and sit at your desk in your VR or AR headset and roam around the campus.
Youre the first in the world to be here. Welcome all of you, and I thank you for joining me today. I also want to send my thoughts and recognize that in Taiwan, COVID cases are growing again. Im very sorry about that. I hope all of you are safe. I know that Taiwan was so rigorous in keeping the infection rates down, and so Im terribly sorry to see it go up now. I know they can get it under control, and soon all of us will be able to see each other in person.
Let me say a couple of words about the announcement. We announced two basic things. In GeForce gaming, where Taiwan is the central hub of where our add-in card partners and many of our leading laptop partners are based, and the home of, the epicenter if you will, the GeForce ecosystem. It all starts there. Its manufactured and assembled and integrated, and it goes to the market through our add-in card partners and laptop builders.
Above: Nvidias RTX is used in more than 130 games.
Image Credit: Nvidia
The GeForce business is doing incredibly well. The invention of RTX has been a home run. It has reset and redefined computer graphics, completely reinvented modern computer graphics. Its a journey that started more than 10 years ago, and a dream that started 35 years ago. It took that long for us to invent the possibility of doing real-time raytracing, which is really hard to do. It wasnt until we were able to fuse our hardware accelerated raytracing core with the Tensor core GPU, AI processing, and a bunch of new rendering algorithms, that we were able to bring real-time raytracing to reality. RTX has reinvented computer graphics in the marketplace. RTX 30, the 30 family, the Ampere architecture family, has been fantastic.
We announced several things. We announced that we upgraded the RTX 30 family with the 3080Ti and the 3070Ti. Its our regularly planned once per year upgrade to our high end GPUs. We also, with the partnership with all of our laptop partners, our AICs, launched 140 different laptops. Our laptop business is one of the fastest growing businesses in our company. This year we have twice as many notebooks going into the marketplace as we did with Turing, our last generation, RTX 20. This is one of the fastest growing businesses. The laptop business is the fastest growing segment of PCs. Nvidia laptops are growing at seven times the rate of the overall laptop business. It gives a sense of how fast RTX laptops are growing.
If you think about RTX laptops as a game console, its the largest game console in the world. There are more RTX laptops shipped each year than game consoles. If you were to compare the performance of a game console to an RTX, even an RTX 3060 would be 30-50% faster than a PlayStation 5. We have a game console, literally, in this little thin notebook, which is one of the reasons its selling so well. The same laptop also brings with it all of the software stacks and rendering stacks necessary for design applications, like Adobe and Autodesk and all of these wonderful design and creative tools. The RTX laptop, RTX 3080Ti, RTX 3070Ti, and a whole bunch of new games, that was one major announcement.
The second thrust is enterprise, datacenters. As you know, AI is software that can write software. Using machines you can write software that no human possibly can. It can learn from an enormous amount of data using an algorithm in an approach called deep learning. Deep learning isnt just one algorithm. Deep learning is a whole bunch of algorithms. Some for image recognition, some for recognizing 2D to 3D, some for recognizing sequences, some for reinforcement learning in robotics. Theres a whole bunch of different algorithms that are associated with deep learning. But theres no question that we can now write software that weve not been able to write before. We can automate a bunch of things that we never thought would be possible in our generation.
One of the most important things is natural language understanding. Its now so good that you can summarize an entire chapter of a book, or the whole book. Pretty soon you can summarize a movie. Watch the movie, listen to the words, and summarize it in a wonderful way. You can have questions and answers with an NLU model.
AI has made tremendous breakthroughs, but has largely been used by the internet companies, the cloud service providers and internet services. What we announced at GTC initially a few weeks ago, and then what we announced at Computex, is a brand new platform thats called Nvidia Certified AI for Enterprise. Nvidia Certified systems running a software stack we call Nvidia AI Enterprise. The software stack makes it possible to achieve world class capabilities in AI with a bunch of tools and pre-trained AI models. A pre-trained AI model is like a new college grad. They got a bunch of education. Theyre trained. But you have to adapt them into your job and to your profession, your industry. But theyre pre-trained and really smart. Theyre smart at image recognition, at language understanding, and so on.
We have this Nvidia AI Enterprise that sits on top of a body of work that we collaborated on with VMware. That sits on top of Nvidia Certified servers from the worlds leading computer makers, many of them in Taiwan, all over the world, and these are high-volume servers that incorporate our Ampere generation datacenter GPUs and our Mellanox BlueField DPUs. This whole stack gives you a cloud native its like having an AI cloud, but its in your company. It comes with a bunch of tools and capabilities for you to be able to adapt it.
How would you use it? Health care would use it for image recognition in radiology, for example. Retail will use it for automatic checkout. Warehouses and logistics, moving products, tracking inventory automatically. Cities would use these to monitor traffic. Airports would use it in case someone lost baggage, it could instantly find it. There are all kinds of applications for AI in enterprises. I expect enterprise AI, what some people call the industrial edge, will be the largest opportunity of all. Itll be the largest AI opportunity.
With the overall trend, what all of these announcements show is that Nvidia accelerated computing is gaining momentum. We had our company grow a lot last year, as many of you know. This last quarter we had a record quarter across all our product lines. We expect the next quarter to be another great quarter, and the second half also to be a great growth second half. Its very clear that the world of computing is changing, that accelerated computing is making a contribution, and one of the most important applications is AI.
Above: BMW Group is using Nvidias Omniverse to build a digital factory that will mirror a real-world place.
Image Credit: Nvidia
Question: I wonder about your latest thoughts on the metaverse and how were making progress toward that. Do you see steps happening in the process of creating the metaverse?
Huang: Youve been talking about the metaverse for some time, and youve had interest in this area for a long time. I believe were right on the cusp of it. The metaverse, as you know, for all of you who are learning about it and hearing about it, its a virtual world that connects to the world that we live in. Its a virtual world that is shared by a lot of people. It has real design. It has a real economy. You have a real avatar. That avatar belongs to you and is you. It could be a photoreal avatar of you, or a character.
In these metaverses, youll spend time with your friends. Youll communicate, for example. We could be, in the future, in a metaverse right now. It will be a communications metaverse. It wont be flat. Itll be 3D. Well be able to almost feel like were there with each other. Its how we do time travel. Its how we travel to far places at the speed of light. It could simulate the future. There will be many types of metaverses, and video games are one of them, for example. Fortnite will eventually evolve into a form of metaverse, or some derivative of it. World of Warcraft, you can imagine, will someday evolve into a form of metaverse. There will be video game versions.
There will be AR versions, where the art that you have is a digital art. You own it using NFT. Youll display that beautiful art, thats one of a kind, and its completely digital. Youll have our glasses on or your phone. You can see that its sitting right there, perfectly lit, and it belongs to you. Well see this overlay, a metaverse overlay if you will, into our physical world.
In the world of industry, the example I was giving earlier, this building exists fully in virtual reality. This building completely exists in VR. We designed it completely digitally. Were going to build it out so that there will be a digital twin of this very physical building in VR. Well be able to simulate everything, train our robots in it. We can simulate how best to distribute the air conditioning to reduce the energy consumption. Design certain shapeshifting mechanisms that block sunlight while letting in as much light as possible. We can simulate all of that in our digital twin, our building metaverse, before we deploy anything here in the physical world. Well be able to go in and out of it using VR and AR.
Those are all pieces that have to come together. One of the most important technologies that we have to build, for several of them in the case of consumers, one of the important technologies is AR, and its coming along. AR is important. VR is becoming more accessible and easier to use. Its coming along. In the case of the industrial metaverse, one of the most important technologies is physically based, physically simulated VR environments. An object that you design in the metaverse, if you drop it to the ground, itll fall to the ground, because it obeys the laws of physics. The lighting condition will be exactly as we see. Materials will be simulated physically.
These things are essential components of it, and thats the reason why we invented the Nvidia Omniverse. If you havent had a chance to look at it, its so important. Its one of our most important bodies of work. It combines almost everything that Nvidia has ever built. Omniverse is now in open beta. Its being tested by 400 companies around the world. Its used at BMW to create a digital factory. Its used by WPP, the worlds largest advertising agency. Its used by large simulation architects. Bentley, the worlds largest designer of large infrastructure, they just announced that theyll use Omniverse to create digital twins. Omniverse is very important work, and its worth taking a look at.
Above: Nvidia GeForce RTX 3080 Ti graphics card.
Image Credit: Nvidia
Question: You mentioned the opportunities ahead of Nvidia. The recent trend in China is that China has seen a lot of GPU startups emerge in the last one or two years. Its received billions in funding from VCs. China has a lot of reasons to develop its own Nvidia in the next few years. Are you concerned that your Chinese customers are hoping to develop a rival for you in this market?
Huang: Weve had competition, intense competition, from companies that are gigantic, since the founding of our company. What we need to do is we need to make sure we continue to run very fast. Our company is able to invest, in a couple of years, which is one generation, $10 billion to do one thing. After investing in it for 30 years. We have a great deal of expertise and scale. We have the ability to invest greatly. We care deeply about this marketplace. Were going to continue to run very fast. Our companys position, of course, is not certain. We have to take all of the competition, respect them, and take them seriously, and recognize that there are many places where you could contribute to AI. We just have to keep on running hard.
However, heres my prediction. Every datacenter and every server will be accelerated. The GPU is the ideal accelerator for these general purpose applications. There will be hundreds of millions of datacenters. Not just 100 datacenters or 1,000 datacenters, but 100 million. The datacenters will be in retail stores, in 5G base stations, in warehouses, in schools and banks and airports. Theyll be everywhere. Street corners. They will all be datacenters. The market opportunity is quite large. This is the largest market opportunity the IT industry has ever seen. I can understand why it inspires so many competitors. We just need to continue to do our best work and run as fast as we can.
Question: Are you also worried about the government interfering in this space?
Huang: I believe that we add value to the marketplace. Nvidias position in China, and our contribution to China, is good. It has helped the internet companies, helped many startups, helped researchers developing AI. Its wonderful for the gaming business and the design business. We make a lot of contributions to the IT ecosystem in China. I think the government recognizes that. My sense is that were welcome in China and well continue to work hard to deserve to be welcome in China, and every other country for that matter. Well do that.
Above: Nvidias GeForce RTX 3050 will power new laptops.
Image Credit: Nvidia
Question: Weve seen a few keynotes about games, and weve seen more and more Chinese games, games developed by Chinese companies. How do you position or commend Chinese developers? What does Nvidia plan to do to support the Chinese gaming ecosystem?
Huang: We do several things that developers love. The first thing is our installed base is very big. If youre a developer and you develop on Nvidias platform, because all of our platform, all of our GeForce, are compatible we work so hard to make sure that all of the software is high quality. We maintain and continue to update the software, to keep tuning every single GPU for every game. Every GPU, every game, were constantly tuning. We have a large group of engineers constantly studying and looking for ways to improve. We use our platform called GeForce Experience to update the software for the gamer.
The first thing is our installed base is very large, then. Our software quality is very good. But very important, one of the things that content developers, game developers love is our expertise in computer graphics, working with them to bring beautiful graphics to their games is excellent. Weve invented so many algorithms. We invented programmable shading, as you know. This is almost 20 years ago, we invented the programmable pixel and vertex shaders in the GPU. We invented RTX. We teach people how to use programmable shading to create special effects, how to use RTX to create raytracing and ambient occlusion and global illumination, really beautiful computer graphics. We have a lot of expertise and a lot of technology that we can use to work with gamers to incorporate that into their games so that theyre as beautiful as possible.
When its done, we have fantastic marketing. We have such a large reach, we can help the developers promote their games all over the world. Many of the Chinese developers would like to reach the rest of the world, because their games are now triple-A quality, and they should be able to go all over the world. There are several reasons why game developers enjoy working with us, and those are the reasons.
Above: Nvidias Grace CPU for datacenters is named after Grace Hopper.
Image Credit: Nvidia
Question: At GTC you announced Grace, which seems like a big project. An Arm CPU is hard to implement. Do you think Arm can overtake the x86 processor in the server market in the future?
Huang: First of all, I think the future world is very diversified. It will be x86. It will be Arm. It will be big CPUs, small CPUs, edge CPUs, datacenter CPUs, supercomputing CPUs, enterprise computing CPUs, lots of CPUs. I think the world is very diversified. There is no one answer.
Our strategy is one where well continue to support the x86 CPUs in the markets we serve. We dont serve every market. We serve high-performance computing. We serve AI. We serve computer graphics. We serve the markets that we serve. For the markets that we serve, not every CPU is perfect, but some CPUs are quite ideal. Depending on the market, and depending on the application, the computing requirements, we will use the right CPU.
Sometimes the right CPU is Intel x86. For example, we have 140 laptops. The vast majority of them are Intel CPUs. We have DGX systems. We need a lot of PCI Express. It was great to use the AMD CPU. In the case of 5G base stations, Marvells CPU is ideal. Theyre based on Arm. Cloud hyperscale, Ampere Computings Altra CPU is excellent. Graviton 2 is excellent. Its fantastic. We support those. In Japan, Fujitsus CPU is incredible for supercomputing. Well support that. Different types of CPUs are designed for different applications.
The CPU we designed has never been designed before. No CPU has ever been able to achieve the level of memory bandwidth and memory capacity that we have designed for. It is designed for big data analytics. Its designed for the state of the art in AI. There are two primary models, or AI models, that we are very interested in advancing, because theyre so important. The first one is the recommender system. Its the most valuable piece of software, approach of software, that the world has ever known. It drives all the internet companies, all the internet services. The recommender system is very important, incredibly important science. Its designed for that. The second is natural language understanding, which requires a lot of memory, a lot of data, to train a very smart AI for having conversational AI, answering questions, making recommendations, and so on.
These two models are probably, my estimation, the most valuable software in the world today. It requires a very large machine. We decided that we would design something just for those types of applications, where big AI is necessary. Meanwhile, there are so many different markets and edges and enterprises and this and that. Well support the CPUs that are right for them. I believe the future is about diversity. I believe the future is about variability and customization and those kinds of things. Arm is a great strategy for us, and x86 will remain a great strategy for us.
Above: Simon Segars is CEO of Arm.
Image Credit: Arm
Question: You recently had the earnings call where you talked a bit about the Arm deal, and Simon Segars keynote mentioned it as well, that hes looking forward to the deal, combining their ecosystem plus all the AI capabilities of Nvidia. Is there any update about the next steps for you guys?
Huang: Were going through the regulatory approval. It takes about 18 months. The process typically goes U.S., then the EC, and then China last. Thats the typical journey. Mellanox took about 18 months, or close to it. I expect this one to take about 18 months. That makes it early next year, or late this year.
Im confident about the transaction. The regulators are looking for, is this good for competition? Is it pro-competitive? Does it bring innovation to the market? Does it give customers more choice? Does it give customers more offerings and more choice? You can see that on first principles, because our companies are completely complementary they build CPUs, we build GPUs and DPUs. They dont build GPUs. Our companies are complementary, and so by nature well bring innovations that come as a result of coming together offering complementary things. Its like ketchup and mustard coming together. Its good for innovation.
Question: You mentioned that the acquisition will increase competition. Can you explain which areas you see for future competition? We see that AMD and also other players are starting to compete in GPUs, CPUs, and datacenters.
Huang: First of all, its pro-competitive because it brings customers more choice. If we combine Nvidia and Arm, Arms R&D scale will be much larger. As you know, Arm is a big company. Its not a small company. But Nvidia is much bigger. Our R&D budget is many times larger than Arms. Our combination will give them more R&D scale. It will give them technology that they dont have the ability to build themselves, or the scale to build themselves, like all of the AI expertise that we have. We can bring those capabilities to Arm and to its market.
As a result of that, we will offer Arm customers more technology choice, better technology, more advanced technology. That ultimately is great for competition, because it allows Arms licensees to create even better products, more vibrant products, better leading-edge technology, which in the end market will give the end market more choice. Thats ultimately the fundamental reason for competition. Its customer choice. More vibrant innovation, more R&D scale, more R&D expertise brings customers more choice. That, I think, is at the core of it.
For us, it brings us a very large ecosystem of developers, which Nvidia as a company, because were an accelerated computing company developers drive our business. And so with 15 million more developers we have more than 30 million developers today those 15 million developers will develop new software that ultimately will create value for our company. Our technology, through their channel, creates value for their company. The combination is a win-win.
Above: Jensen Huang of Nvidia stands in a virtual environment.
Image Credit: Nvidia
Question: Im interested in your personal thoughts on the weve had all the supply chain constraints on one hand, and then on the other hand a demand surplus when it comes to the crypto world. Whats your feeling? Is it like youre making Ferraris and people are just parking them in the garage revving the engine for the sake of revving it? Do you see an end to proof of work blockchain in the future that might help resolve that issue? What are your thoughts on the push-pull in that space?
Huang: The reason why Ethereum chose our GPUs is because its the largest network of distributed supercomputers in the world. Its programmable. When Bitcoin first came out, it used our GPU. When Ethereum came out it used our GPU. When other cryptocurrencies came out in the beginning, they established their credibility and their viability and integrity with proof of work using algorithms that run on our GPUs. Its ideal. Its the most energy efficient method, the most performant method, the fastest method, and has the benefit of very large distributed networks. Thats the origins of it.
Am I excited about proof of stake? The answers yes. I believe that the demand for Ethereum has reached such a high level that it would be nice for either somebody to come up with an ASIC that does it, or for there to be another method. Ethereum has established itself. It has the opportunity now to implement a second generation that carries on from the platform approach and all of the services that are built on top of it. Its legitimate. Its established. Theres a lot of credibility. It works well. A lot of people depend on it for DeFi and other things. This is a great time for proof of stake to come.
Now, as we go toward that transition, its now established that Ethereum is going to be quite valuable. Theres a future where the processing of these transactions can be a lot faster, and because there are so many people built on top of it now, Ethereum is going to be valuable. In the meantime there will be a lot of coins mined. Thats why we created this new product called CMP. CMP is right here. It looks like this. This is what a CMP looks like. It has no display connectors, as you can probably see.
The CMP is something we learned from the last generation. What we learned is that, first of all CMP does not yield to GeForce. Its not a GeForce put into a different box. It does not yield to our datacenter. It does not yield to our workstations. It doesnt yield to any of our product lines. It has enough functionality that you can use it for crypto mining.
The $150 million we sold last quarter and the $400 million were projecting to sell this quarter essentially increased supply of our company by half a billion dollars. They were supply that we otherwise couldnt use, and we diverted good yielding supply to GeForce gamers, to workstations and such. The first thing is that CMP effectively increases our supply. CMP also has the after benefit of not being able to be resold secondhand to GeForce customers because it doesnt play games. These things we learned from the last cycle, and hopefully we can take some pressure off of the GeForce gaming side, getting more GeForce supply to gamers.
Above: Perlmutter, the largest NVIDIA A100-powered system in the world.
Image Credit: Nvidia
Question: Theres a shortage problem in the semiconductor market as a whole. The price of GPU products is getting higher. What do you think it will take to stabilize that price?
Huang: Our situation is very different than other peoples situations, as you can imagine. Nvidia doesnt make commodity components. Were not in the DRAM business or the flash business or the CPU business. Our products are not commodity-oriented. Its very specific, for specific applications. In the case of GeForce, for example, we havent raised our price. Our price is basically the same. We have an MSRP. The channel end market prices are higher because demand is so strong.
Our strategy is to alleviate, to reduce the high demand that is caused by crypto mining, and create a special product, the CMP, directly for the crypto miners. If the crypto miners can buy, directly from us, a large volume of GPUs, and they dont yield to GeForce, so they cannot be used for GeForce, but they can be used for crypto mining, it will discourage them from buying from the open market.
The second reason is we introduced new GeForce configurations that reduce the hash rate for crypto mining. We reduced the performance of our GPU on purpose so that if you would like to buy a GPU for gaming, you can. If youd like to buy a GPU for crypto mining, either you can buy the CMP version, or if you really would like to use the GeForce to do it, unfortunately the performance will be reduced. This allows us to save our GPUs for the gamers, and hopefully, as a result, the pricing will slowly come down.
In terms of supply, its the case that the worlds technology industry has reshaped itself. As you know, cloud computing is growing very fast. In the cloud, the datacenters are so big. The chips can be very powerful. Thats why die size, chip size continues to grow. The amount of leading-edge process it consumes is growing. Also, smartphones are using state of the art technology. The leading-edge process consumption used to see some distribution, but now the distribution is heavily skewed toward the leading edge. Technology is moving faster and faster.
The shape of the semiconductor industry changed because of these dynamics. In our case, we have demand that exceeds our supply. Thats for sure. However, as you saw from our last quarters performance, we have enough supply to grow significantly year over year. We have enough supply to grow in Q2 as we guided. We have enough supply to grow in the second half. However, I do wish we had more supply. We have enough supply to grow and grow very nicely. Were very thankful for all of our supply chain and our partners supporting us. But the world is going to be reshaped because of cloud computing, because of the way that computing is going.
Question: When do you think the ongoing chip shortage problem could be solved?
Huang: It just depends on degree and for whom. As you know, we grew tremendously year over year. We announced a great quarter last year. Record quarter for GeForce, for workstations, for datacenters. Although demand was even higher than that, we had enough supply to grow quite nicely year over year. Well grow in Q2. Well grow in the second half. We have supply to do that.
However, there are several dynamics that I think are foundational to our growth. RTX has reset computer graphics. Everyone who has a GTX is looking to upgrade to RTX. RTX is going to reset workstation graphics. There are 45 million designers and creators in the world, and growing. They used to use GTX, but now obviously everyone wants to move to RTX so they can do raytracing in real time. We have this pent-up demand because we reset and reinvented computer graphics. Thats going to drive our demand for some time. It will be several years of pent-up demand that needs to re-upgrade.
In the datacenter its because of AI, because of accelerated computing. You need it for AI and deep learning. We now add to it what I believe will be the long term biggest AI market, which is enterprise industries. Health care is going to be large. Manufacturing, transportation. These are the largest industries in the world. Even agriculture. Retail. Warehouses and logistics. These are giant industries, and they will all be based on AI to achieve productivity and capabilities for their customers.
Now we have that new platform that we just announced at Computex. We have many years of very exciting growth ahead of us. Well just keep working with our supply chain to inform them about the changing world of IT, so that they can be better prepared for the demand thats coming in the future. But I believe that the areas that were in, the markets that were in, because we have very specific reasons, will have rich demand for some time to come.
Above: AI algorithms were developed on Nvidia DGX servers at a U.S. Postal Service Engineering facility.
Image Credit: Nvidia
Question: I see that AMD just announced bringing their RDNA 2 to Arm-based SOCs, collaborating with Samsung to bring raytracing and VR features to Android-based devices. Will there be some further plan from Nvidia to bring RTX technology to consumer devices with Arm-based CPUs?
Huang: Maybe. You know that we build lots of Arm SOCs. We build Arm SOCs for robotics, for the Nintendo Switch, for our self-driving cars. Were very good at building Arm SOCs. The Arm consumer market, I believe, especially for PCs and raytracing games raytracing games are quite large, to be honest. The data set is quite large. There will be a time for it. When the time is right we might consider it. But in the meantime we use our SOCs for autonomous vehicles, autonomous machines, robots, and for Android devices we bring the best games using GeForce Now.
As you know, GeForce Now has more than 10 million gamers on it now. Its in 70 countries. Were about to bring it to the southern hemisphere. Im excited about that. It has 1,000 games, 300 publishers, and it streams in Taiwan. I hope youre using it in Taiwan. Thats how wed like to reach Android devices, Chrome devices, iOS devices, MacOS devices, Linux devices, all kinds of devices, whether its on TV or a mobile device. For us, right now, thats the best strategy.
Above: Jensen Huang of Nvidia holds the worlds largest graphics card.
Image Credit: Nvidia
Question: I wanted to ask you about die size. Obviously with Moores Law, it seems we have the choice of using Moores Law to either shrink the die size or pack more transistors in. In the next few generations, the next three years or so, do you see die sizes shrinking, or do you think theyll stay stable, or even rise again?
Huang: Since the beginning of time, transistor time, die sizes have grown and grown. Theres no question die sizes are increasing. Because technology cycles are increasing in pace, new products are being introduced every year. Theres no time to cost reduce into smaller die sizes. If you look at the trend, its unquestionably to the upper right. If you look at the application space that we see, talking very specifically about us, if you look at our die sizes, there are always reticle limits now. The reticle limits are pretty spectacular. We cant fit another transistor. Thats why we have to use multi-chip packing, of course. We created NVLink to put a bunch of them together. Theres all kinds of strategies to increase the effective die size.
One of the important things is that cloud datacenters so much of the computing experience you have on your phone is because of computers in the cloud. The cloud is a much bigger place. The datacenters are larger. The electricity is more abundant. The cooling system is better. The die size can be very large. Die size is going to continue to grow, even as transistors continue to shrink.
Question: Its expensive to spin up fabs, but in light of the prolonged silicon crunch, is that on the horizon for Nvidia to consider, spinning up a fab for yourself?
Huang: No. Boy, thats the shortest answer Ive had all night. Its the only answer I know, completely. The reason for that, you know theres a difference between a kitchen and a restaurant. Theres a difference between a fab and a foundry. I can spin up a fab, no doubt, just like I can spin up a kitchen, but it wont be a good restaurant. You can spin up a fab, but it wont be a good foundry.
A foundry is a service-oriented business that combines service, agility, technology, capacity, courage, intuition about the future. Its a lot of stuff. The business is not easy. What TSMC does for a living is not easy. Its not going to get any easier, and its not getting easier. Its getting harder. There are so many people who are so good at what they do. Theres no reason for us to go repeating that. We should encourage them to develop the necessary capacity for our platforms benefit.
Meanwhile, they now realize that the leading-edge consumption, leading-edge wafer consumption, the shape has changed because of the way the computing industry is evolving. They see the opportunity in front of them. Theyre racing as fast as they can to increase capacity. I dont think theres anything I can do, that a fabless semiconductor company can do, that can possibly catch up to any of them. So the answer is no.
Above: Nvidias Clara AI for COVID-19 diagnosis from CT scans.
Image Credit: Nvidia
Link:
Nvidia CEO Jensen Huang weighs in on the metaverse, blockchain, and chip shortage - VentureBeat
