Why Elon Musk Is Building The World's BIGGEST Supercomputer

Elon Musk appears to have found himself a new obsession supercomputers big ones the biggest in the world Elon has not been shy about telling the world that he is laying down fat stacks of cash to build out his computer Army we are looking at tens of billions of dollars being invested in just the next year alone now why is he doing all this well that's where things get interesting [Music] okay first let's break this whole superc Compu situation up into some manageable chunks and start to identify what goes where because Elon is building multiple computer clusters for different projects that do different things and at some point he seemingly referred to each of them as either the world's biggest or the world's most powerful so it's a bit hard to follow let's start with Tesla they're getting a brand new supercomputer this is actually under construction right now the gigafactory in Austin Texas which was already the biggest car manufacturing plant in the world is getting even bigger and most of that new real estate is being dedicated to supercomputer activity which is why they are also building this whole dedicated cooling bunker Elon talked about this recently on X he wrote sizing for about 130 megawatt of power and cooling this year but will increase to over 500 megaw over next 18 months or so so as for what exactly Tesla plans to do with all that power we'll get into those details shortly but first let's talk about an even bigger supercomputer project that Elon is working on for his xai Venture this one will be built in Memphis Tennessee and Elon has referred to it as the gigafactory of compute he then went on to tell officials quote my vision is to build the world's largest and most powerful supercomputer and I'm willing to put it in Memphis and then in addition to all of that Tesla has been kind of secretly converting all of their vehicles into a mobile decentralized supercomputer network of their own which will eventually include all of their humanoid robots as well okay let's start breaking down how all of this stuff works so as many of you know we are all Canadians here behind the scenes which is generally pretty awesome except when it comes to the internet the Canadian government has a weird thing about trying to control what we can and can't see online it's even started to result in meta and Google limiting the type of content that I'm able to access and if that wasn't enough our Netflix selection sucks up here too so in an effort to dodge all of that Madness I've started using a VPN more specifically I've been using cyber ghost VPN not only because they have a cool name but also because they offer a very high quality product at an even more affordable price and a cool name with cyber GH vbn all of your traffic goes through a secure VPN tunnel your IP address is hidden and your data is encrypted trust me you want your data and history secured and encrypted so what you do online is strictly your business you can also change your online location in just three clicks and get access to Geor restricted content from dozens of streaming services like Netflix and that's not all with cyber ghost VPN you can even find better online shopping deals or play games blocked in your region cyber GH VPN is available for all platforms such as Windows Mac OS Android iOS and many others you can use one subscription to protect up to seven devices at a time so you can easily share with your family and friends plus you get a 45-day money back guarantee and 247 customer support so everything is risk free cyber GH VPN is offering their best deal ever just $23 per month and you get 4 months free which is 84% off so join over 38 million happy users including me and click the link in our description to sign up today okay that brand new Giga Texas data center that's under construction right now is going to be aimed specifically at developing Tesla's full self-driving software and to do that Elon says that it will be loaded with a combination of Nvidia gpus along with Tesla's own AI specific Hardware Elon says that the South Extension of the factory is custom built for heavy power compute and Cooling hence the giant cooling bunker he said earlier this month that the initial system is 50,000 Nvidia h100 gpus alongside 20,000 Tesla hardware for AI computers and a massive network of hard drives for video storage when Elon says that Tesla is spending $10 billion this year on AI this is where a large chunk of that cash is going right now the Nvidia h100 is a current industry standard chip for AI training which is an extraordinarily complicated process involving endless calculations in an attempt to teach a computer network the difference between right and wrong we provide the input and then train the network until it produces the desired output in the most common AI models that we use today like chat GPT or mid Journey we input words or pictures and receive the same as an output in some more advanced new models you can even input text and get video as an output in Tesla's AI models the input is video and the output is driving a car so this is significantly more complex than what most people have grown accustomed to and as a result it requires a much more powerful and sophisticated hardware setup to make it all work that's where Tesla's AI Hardware comes into play in addition to the training computer Tesla also uses a powerful computer inside their vehicles this is called inference comp compute and it allows the AI to operate in the real world in real time and make decisions at incredibly high speed you know when you ask chat GPT a question and it has to kind of think for a second before generating an answer that's because pretty much every AI model that we use right now is just a cloud-based web app Chad gbt isn't operating on your computer or your phone The Prompt that you write is sent off to an open aai data center where it's processed through their own giant supercomputer cluster and then the response is sent back to you this is fine if you just want a cookie recipe or a picture of a robot on Mars but when AI is driving your car it cannot be sending every decision back and forth through the internet it needs a brain that will do the thinking and decision- making on site that is the Tesla AI Hardware not only is this inference Hardware inside every car it's also used in the Tesla data centers alongside the Nvidia hard Ware the way that Elon explains this is that the h100s the Tesla hardware and software video data is all part of one big training Loop currently Tesla is using their AI hardware version 4 but Elon says that before the end of next year there will be hardware version 5 which is called AI 5 this will roll out in vehicles and data centers Elon says that the new chip will have 10 times more capability than Hardware 4 so that would potentially equal 10 times better performance in the training Loop and 10 times better performance running the AI model in the vehicle for autonomous driving but there's more the same ai5 chip is not only going into future Tesla vehicles it's also going into Tesla's humanoid robot which is going to need its own AI model for navigating the real world this is likely the motivating factor for Tesla building out such a massive new super computer cluster obviously full self-driving still needs some work but Elon said a couple of months back that Tesla was not compute constrain for FSD he said that was more about data though when it comes to developing brand new models for the Tesla bot those could prove to be even bigger than full self-driving there is so much that the bot will need to know in order to function in the real world and perform human tasks so Tesla will not be done with AI training anytime soon even if we do get full Robo taxis next year and if that wasn't enough Elon already has some big ideas for what Tesla could do with all of these high-powered inference computers out there in the world at the recent Tesla shareholder meeting in June Elon Musk put out this concept about how the company might be able to use future autonomous vehicle Hardware in some unconventional ways the idea is that if there is a point down the road where tens of Millions of Tesla vehicles are out there in the world and many of them are equipped with this ai5 Hardware then you essentially have a giant decentralized supercomputer made up of individual cars that are all connected by the Tesla Network Elon speculated that by around the end of the decade there might be a gwatt of computing power when all of these Tesla vehicles are combined going back to that gig Texas Computer cluster there's up to 500 megaw of power which is half a gwatt anyway the incar computer of a robotaxi would be occupied with self-driving tasks most of the time but for periods when the vehicle is either recharging or just not being utilized like at 4 in the morning then that computing power might be harnessed to do other important jobs this is basically the same concept behind Amazon web services this is the business model that actually makes money at Amazon and the concept was born when the company found that all of the data processing Hardware that they required to deal with Peak traffic situations like Christmas was just sitting around and not being utilized during the other times of the year so they started renting out that computer hardware to other companies that needed the processing but didn't have the capital to build their own data center in theory Tesla's robotaxi Network could kind of do the same thing even the consumer Vehicles as well you could check a box on the app that would let Tesla access your incar computer and maybe you get a cut of the revenue it earns it's kind of like a crypto mining pool if you've ever seen or tried one of those Okay so we've talked about Ai and cars and autonomous driving that's all cool but what about solving the mysteries of the universe okay let's go back to musk's gigafactory of compute which is not to be confused with his giant computer at the Tesla gigafactory this is the new installation in Memphis that will be dedicated to xai this is the one that could potentially become the world's largest and most powerful supercomputer by the end of 2025 if you're inclined to follow Elon timelines in the short term Elon is targeting 100,000 of the Nvidia h100 gpus up and running before the end of this year that's what he believes the company needs to build out the next generation of their grock AI language model this is chatbot that is native to the X platform available to premium subscribers it's like chat GPT except grock has real-time access to every post on X and grock also has the freedom of language to write swear words and make cringe attempts at humor which can be a lot of fun this is just basic level stuff though xai was able to build out grock 1 at an incredibly Fast Pace it only took about 6 months from the company being founded to the release of their first product although it still lags behind Chad TBT a little bit in terms of capability and Gro definitely lacks the name recognition and popularity currently being enjoyed by chat GPT and open AI grock 2 might be able to start turning the tide this is the product that xai is working on currently the upgrade will allow grock to both interpret and produce images and visual media so you can have it turn a spreadsheet into a graph or turn a graph into a spread sheeet or identify the content of a photograph or even explain a piece of art or a meme so far xai has been able to do all of this AI training in partnership with a company called Oracle Cloud just like we were talking about earlier with renting out data processing that's exactly what xai has done here it looks like they have been renting the equivalent of about 20,000 h100 gpus from Oracle Elon has said that the 100,000 h100 cluster will be necessary to train grock 3 which is still unknown but we have to assume that this would be moving in the direction of a generalized artificial intelligence something that can deal with text sound images and video as both input and output media which probably not by coincidence would be the exact kind of AI model that the Tesla bot will need to fully function as a productive member of society at some point in the future now beyond that is where things start to get weird elon's vision of his completed gigafactory of compute is now looking like 300,000 units of the B 200 GPU which is nvidia's next big chip release it's the new most powerful chip in the world for AI training these are going to be several times more capable than the h100 chips and Elon wants 300,000 of them and he wants this up and running by 2026 ostensibly the reason that we've been given for xai pursuing these massive amounts of computing power is simply the mission to understand the universe more specifically X is a company working on building artificial intelligence to accelerate human scientific discovery we are Guided by our mission to advance our Collective understanding of the universe now this is all going to be very expensive xai recently completed a $6 billion funding round which will be in addition to the startups initial $1 billion seed fund this could theoretically be enough to cover the cost of their initial 100,000 GPU cluster with the h100s but just trying to price out the much bigger cluster of the much more powerful b200s which Nvidia has said would run between 30 and 40 Grand each which is $9 billion just in GPU Hardware alone if we assume the lowest end of the price Spectrum so xai still has a long way to go they're going to need to keep drawing massive amounts of funding from groups with very deep pockets and the competition is not sleeping either Microsoft and open AI are are said to be considering spending up to $100 billion on a 5 gaw AI data center known as Stargate this would require its own nuclear power plant to operate at full capacity which is probably why Amazon just recently purchased a Pennsylvania data center site that is literally right next to a nuclear power plant so even if musk's gigafactory of compute does get built on time it certainly has a chance of becoming the world's most powerful supercomputer but it won't wear that crown for long in the immortal words of Fallout Boy this ain't a scene it's a godamn arms race thanks again to cyber ghost for sponsoring this video they protect your data while you browse and give you full access to blocked online content for just over $2 a month click the link in the video description to find their special offer with 84% off and a 45-day money back guarantee

Channel: The Tesla Space

Views: 188,975

Keywords: tesla, xai, ai, artificial intelligence, hardware, computer, supercomputer, super computer, dojo, nvidia, h100, b200, memphis, Tennessee, grok, full self driving, fsd, robotaxi, cybercab, autonomy, autonomous vehicle, self driving car, self-driving, gigatexas, gigaaustin, austin, texas, gigafactory, compute, gigafactory of compute, openai, microsoft, amazon, power, chip, gpu, ai5, hardware 5, ai 5, inference, wold's biggest, most powerful, world's largest, elon musk, tsla, tesla stock, nvidia stock, billion

Id: 0fSUI_mzaxM

Length: 15min 51sec (951 seconds)

Published: Sun Jun 30 2024