What Can You Do With 64 Core Threadripper Pro? We'll Show You!

what can you do with 64 cores that's harder to do with anything else and is it a server is it a workstation it's a swerk station that's threadripper pro 64 cores 32 cores even 16 cores but 64 cores 64 cores is doing it in style let me tell you i don't think that people understand how disruptive threadripper pro is or anything really i mean what amd's doing here in the workstation market is kind of disruptive because it sort of turns the whole market on its head it's like oh you need a really expensive computer we're going to charge a lot of money we want to cut whereas threadripper pro like the goodwill can't be understated i mean yeah it's expensive but the limitation is your imagination and if you haven't imagined what you can use 64 cores yet well you can opt for a 16 core cpu or opt for something lower end but this whole this whole thing has already moved the pricing but what can you do with a 64 core thread ripper let's take a look so this system behind me is megadesk and i did a video on megadesk and i've since upgraded megadesk to threadripper pro the big deal with threadripper pro is that it feels like a server it acts like a server this motherboard the asus wrx80 sage e has built-in ipmi just like a server motherboard it supports registered error correcting memory uh load reduced dimms uh just all the server accoutrement that you could possibly want as configured i have a half of a terabyte of memory in here eight dimms 512 gigabytes i also have 20 gigabytes of storage keyoxia u.2 in the ic dock yeah four drives 20 gigabytes plus you know some other ones that are just scattered around the system with u.2 adapters of course i could also use key oxia storage on the on the m.2 because i've got pcie lanes for days 128 pcie lanes to be exact because if you're building a system like this you probably have a lot of storage and gpu and that's the first thing that you can build with this system an incredible virtualization platform i like to use vfio it means that i've put multiple graphics cards in the system and i'm running them with different virtual machines this motherboard has so many pcie lanes put my msi supreme 3090 in the bottom and in the fractal meshfi xl2 it hangs off of the bottom it doesn't block any pcie slots even though i'm using a triple slot gpu i still have six pcie slots available on this platform that's incredible i've gone for ek custom loop cooling although you don't really need it i like having it i like being able to juice things a little bit to be sure though threadripper pro is not overclockable but yeah i just like having water cooling that's just me if you're running the absolute highest fastest in storage you can expect transfer rates of about 20 25 gigabytes per second from an nvme array like this so when you're working with a workstation that has 512 gigabytes of memory 64 cores and 20 gigabytes of uh throughput per card can i add in more than one i certainly have i put in two for a total of eight nvme on this platform i've put in so many nvme that i've encountered a bug in the bios that they're fixing uh more than 10 nvme and um they're working on it it's almost fixed good news as at the end of april the new bias from asus is out and it fixes the nvme issue at least i'm up to 23 nvme 20 million iops here we come and that motherboard is not like any other server motherboard you will ever find it has nicer features than most desktop motherboards like i say it's a swerk station so okay you can run virtual machines uh check this out this is running an entire company as a simulation so if you're doing forensics or you know doing an incident response simulation you can use microsoft's pv tool and just it's like okay i've got a couple of domain controllers and a couple of member servers that's three servers let's give those 16 gigabytes of memory got about eight workstations those need about eight gigabytes of memory let's just p2v the entire company put it in a little sandbox so it can't get on the internet or confuse anything on the local area network it's all simulated it's all software so i have the entire company simulated on this thing in virtual machines and whether you're running on the linux operating system or a window the windows operating system with hyper-v you can do it either way p to v virtualize those physical machines and with 512 gigabytes of memory we haven't even scratched what the limits are that right there that's the meat and potatoes of an entire company executive machines but it's not literally everything but it's pretty much everything active directory i can do incident response i can do you wouldn't really want to do this for like testing and upgrades and stuff because there's better ways to do it but if you just need to get everything in a sandbox the fact that i can do this on a single machine and honestly these virtual machines run better than their real hardware in a lot of cases which is just sad for the state of upgrades that we have in corporations but threadripper pro is what makes that go all of that u.2 storage my setup here with this workstation motherboard i would love it if form factors of desktop machines change so that the graphics card because it's getting so big that it blocks so many pcie slots that you know just by the standard by the convention the graphics card hangs off of the end of the motherboard there's like nine slots at the back of this case we just have the graphics card out of the way and asus even had the forethought to put the connectors in at a right angle along the bottom edge of the motherboard so that the gpu works really well there so i can run multiple gpus 12 15 nvme whatever we need this much power in one machine is completely intoxicating i mean i can't i can't think of a way to explain it you know there's there's like a trillion transistors in a modern iphone but probably more than that and the cost of a transistor in 1950 to have a trillion of them was like the entire world's economic output this thing has so many transistors in it i think it's basically equivalent to the entire economic output of the planet like five years ago it's that insane so what we're doing right now is using mdisk it's free software we're creating a ram drive that's 320 gigabytes it's probably a few of you watching that only have a 250 gig or 128 gig ssd that you're running from but uh we're going to copy grand theft auto 5 to a ram disk i don't mean to pick on gta 5 it's just it's just so easy you see i ran gta 5 for years on a high core count machine and uh it was years before they fixed a bug where if you had more than like eight or ten cores it would just straight up crash so gta running from a ram disc still kind of slow isn't it why is it slow when it's running from a ram disc on a 64 core machine i mean windows itself struggles to handle 64 cores i kind of get that okay maybe grand theft auto is going to crash when you've got more than like 8 or 10 cores that's fixed now to be sure 120 fps on a 3090 seems a little low i mean gta 5 is just not that new but this is important because can you imagine if the rockstar developers if the game developers had had such i mean this this machine is the pinnacle of civilization and if your game is running weird on this uh mere mortal to your machines you're gonna probably have to do some more work on your game i mean just the other day there was a huge patch that saved minutes of load time when you're loading on in online because the system spent a long time parsing json now my system is still doing a little bit more in the background we're running the benchmark and you know all that's really exciting but i'm still running hyper-v in the background with all the virtual machines for the entire business two domain controllers a file server and a half a dozen workstations while also playing the gta 5 benchmark demo how insane is this this is a normal desktop computer i mean admittedly it's high-end it's nice but 4k 120 hertz on mega desk 38 gigabytes per second disk array but wait there's more did the magic at the level on text kvm and switching a series of inputs yes we're running nested virtualization although note that that works a little better in the windows insider ring with the hyper-v side of things so don't really recommend running hyper-v in a nested configuration it's not that's a story for another day um but yes you can you can have it all with threadripper pro and that's what's exciting and you know 512 gigabytes of memory isn't even maxing this out so i don't know it's a different it's a different mindset you have the machine you'll think of interesting stuff to do with it versus normally when you're working with machines that are this high end it's like oh i have a very specific purpose in mind i'm going to make a lot of money working in industry x or industry y and therefore i can afford to have a ridiculously expensive machine this feels more like i've got this really high-end hardware and we can sell it you know amd can sell it at this price and make some money but they're not really you know squeezing every single uh you know dollar out of the equation that they possibly can because this is a crazy amount of horsepower and we've come this far in a very short amount of time after a very long period of stagnation for workstations in my opinion and yes this is threadripper pro this is you know like i say the pinnacle of civilization where it's uh it's a swerk station server and it's a workstation it does a little bit of everything people could remote desktop into those the windows the entire windows forest right now and use their machines like nothing is going on and yeah i'm starting to tax the memory capacity and yeah i'm starting to tax the the the number of cpus that i have and you could do this with 32 cores just as easily as 64 cores probably also even 16 cores but with 64 cores you're doing it in style and the machine's got a little bit more breathing room when i'm running all of those tasks in parallel in the background it's really it's it's something different and it's something exciting and the uh the waveringness in my voice is just because i don't know what to do with so much computer horsepower it's crazy i can be running builds in the background and simulating things and playing games and it just it doesn't care it just shrugs it all off and this is going to lead to a new era of innovation smart people are going to get their hands on this and they're going to do truly incredible things and i can't wait i'm well this is level one this has been a quick look at what you can do with 64 cores of madness you know there's a full build log if you want to check that out in some of my other videos reason asus wrx sage like i said and a 64 core thread ripper 512 gigabytes of memory i've got the sabra rocket uh as a boot disk and then all of my bulk storage is kiocia and uh there's a 20 million iops video coming for that as well so we're going to going to try to get 20 million iops on a desktop system and that's a whole other that's a whole other thing so i'm one of those level one i'm signing out i'll catch you later [Music] you

Channel: Level1Techs

Views: 255,209

Rating: 4.8853369 out of 5

Keywords: technology, science, design, ux, computers, hardware, software, programming, level1, l1, level one

Id: _38DHOde5T8

Length: 11min 55sec (715 seconds)

Published: Wed May 12 2021

Reddit Comments

[u/AK-Brian]

Great video, but to me the most interesting part is that it looks like Wendell was able to have someone at Asus circumvent the NVMe device limit in the BIOS (which has been limited to about ten (p6)). This has actually been a bit of a problem for a few high end workstation style Threadripper builds and I'm curious to know if it's something that could be addressed further, either throughout Asus' TRX40 lineup as well, or by AMD directly for other vendors.

Ten drives seems like a lot until you've got two filled quad-adapter cards for high speed storage and two or three drives on the motherboard itself for the OS and applications/VMs.

[u/J_pk_99_26]

I love to "make -j 128" when building Linux kernel.

[u/secretagent01]

- Hey check out my new $10k+ server!

- Awesome! What do you use it for?

- I spin up VMs that nobody uses

[u/fistymcbuttpuncher]

That guy's enthusiasm is great. Like a kid that saw the future and is in awe of what he saw.

[u/p1mrx]

What can you do with 64 core Threadripper Pro?

¯\_(ツ)_/¯

[u/CataclysmZA]

Here I am running a dozen different things on a Ryzen 7 1700 and it's not breaking a sweat, and there's Wendell with 64 cores and more RAM than my SSD has storage. And even then I'm mostly limited by RAM.

Computers these days are a bit nuts.

[u/bacondavis]

I remember back in the day, some software wouldn't even recognize a second CPU core so it would sit idle, now we can have 64 cores sitting idle :) The real breakthrough in this technology is the price per core and parallelism, there are no breakthroughs in processing speeds, but rather running multiple threads has become very stable.

Who would have thought that you could own a desktop HPC in your home :)

[u/QueenTahllia]

Your computer scientists were so preoccupied with whether or not they could, they didn't stop to think if they should.

[u/eras]

And then not even compile the Linux kernel? What a waste!

Though maybe LLVM or Mozilla would be a more modern benchmark.