Fixing My $10,000 Mistake - Whonnock 3 Deployment

Video Statistics and Information

Video
Captions Word Cloud
Reddit Comments

Pretty sure he meant $50000

👍︎︎ 5 👤︎︎ u/SCRefleX 📅︎︎ Jan 31 2021 🗫︎ replies

The new editing den looks great

👍︎︎ 1 👤︎︎ u/vDooZeus 📅︎︎ Feb 01 2021 🗫︎ replies
Captions
- Do you guys have any idea what's in there? We got fiber freaking networking, 25 gigabit per second. The only problem is that we're going to need a way faster, not to mention bigger server in order for all of our editors to use it. Thankfully, (chuckles) didn't want to slam these, these are very expensive. We've got just that. We are going to be rolling 100 terabytes of PCI express gen four storage on a 100 gigabit per second fiber optic network connection today. And it's going to be a blast, like bwhoo! Save time and money with Storyblocks. Storyblocks gets you studio quality stock video clips for a fraction of the price. Check it out today at the link in the video description. (upbeat music) We'll be sliding this baby into our rack soon enough, but before we do, I want to give you guys a quick tour of what Liqid calls the Badger Den. (rock music) Now Liqid is a specialist in composable PCI express infrastructure and high-speed storage. And this is about as high speed storage as it freaking gets. In here we've got two 64 core 128 thread AMD EPYC server processors, one terabyte of 3200 megahertz ECC registered memory, and a whopping seven PCI express gen four expansion slots back here, five of which are actually full height allowing us to hook up what Liqid calls the Honeybadger. And then do it four more times. That's right. We can have a total of up to five of these carrier boards that are each capable of handling up to eight gen four M.2 drives for absolutely mind blowing speeds. Man, I feel like I'm on like a cooking show. I got my mixing bowl. I got my ingredients over here. I got my premade thing for at the end. (laughs) We're only going to be assembling one of these, but it's really important to show you guys how they go together. Because this right here in a storage server is obviously the key ingredient, the storage. Sabrent sent over 32 of their four terabyte Rocket NVMe drives. And we chose these ones specifically for a couple of reasons. Number one, we could have gone with eight terabyte drives but those use QLC NAND and in an application like a server, even one that's going to be written to relatively frequently we don't want to use QLC. That's going to wear out faster. Why we went gen three versus gen four is that A, the gen four drives top out at just two terabytes per stick, which would halve our capacity and two, I mean, we can only hook up at most a 100 gigabit per second network card, and then twin it for 200 gigabit per second. Even running gen three on these things, we are going to be so far beyond that that it's not even funny. So we'd rather have the extra capacity. Man, this is crazy. Like, thinking back to when I built our first company storage server we had one terabyte drives and they were this big. - [Jake] Were they SSD's? - No, they were magnetic drives. It was almost nine years ago, Jake. - [Jake] Yeah, geez. It's like one of those-- (Linus sings tunelessly) (Linus laughs) This is our big old heat spreader for this puppy. - [Jake] Oh geez. Just lay it down. - I got this, I got this, I got this. - Oh Jesus. Look at this! This is a 100 and what? 128 terabytes of raw storage. 128 terabytes! It's like a storage sandwich, you know? Without networking though, these are pointless. 'Cause we'd have no way to access them. That is where this comes in. This is a ConnectX-6 100 gigabit per second, hoo! Network card with not one, but two, 100 gigabit ports on it. That's right. A total of up to 20 gigabytes per second. And I'm rounding which doesn't work when the numbers get so big. So it's like 24, 25 gigabytes a second or something like that. It's flipping nuts. - [Jake] 25, yeah. - And I got to bury it because the half height slots are way in the back of the thing here, they're in the bottom, you gotta dig them out, you gotta excavate. One of the sick things about AMD EPYC is that because it uses PCI express gen four, you can actually get the full capabilities out of a card like this. If you're using PCI express gen three, your slot would not actually be fast enough to keep up with both of these ports being used fully at the same time. Freaking nuts, right? A PCI express 16X slot. That's for like, graphics cards. While we've got this opened up it's a good opportunity to show you guys how expansion can be handled a little differently in servers. On your motherboard, all the ports are built in. On this one, actually it's these interfaces back here that lead to all of the IO. So this daughterboard right here does two gigabit network ports. This one right here does four. But these could easily be swapped out for other ports if the customer wanted a different configuration. And then this last one over here is what Dell calls their iDRAC. So this is our management port, a USB 3 port, and of course VGA out so that you can hook it up to a display if you really want to. And then back here, look at these puppies. That's not your conventional PCI express slot. But it definitely carries the same signal, so you can actually take, ah yes, this guy right here. And that is what wires up to these PCI express 16X slots that we're using for dun-dun-dun-dun-dun! Our storage cards. Storage, excuse me. Network card. And well, one of them's storage for our boot drive. Now we fill it with Badgers. We're actually not quite filling it. We could put in one more Badger but there was a limit to Liqid and Sabrent's generosity. (laughs) The limit was 128 terabytes. I was like, okay. (Jake laughs) Okay, got a little bit of stress here. Okay. Got a little bit of stress. If I break these I do not have an easy way to replace them. - [Jake] We can just call Dell, you know. They might sell some warranties though. - [Woman] How about the warranty? Like if something goes wrong either with the hardware or software? - Well, that went so well I think I'll do it again. Oh my God. I see what they mean by the cables being fragile. They're not even, there's no connector. What the hell is this? - [Jake] Look at how small the wires are too. - [Linus] What the heck? - [Jake] Isn't that terrifying? - There it is. Theoretically that's it. We're ready to roll this thing. Man, this thing's heavy. It's got a handle back here though so you can just carry it, right? (Jake groans) Yeah, yeah, yeah, don't worry. For something that doesn't have hard drives in it though, it's like, it's got some heft. I'm going to need a hand. So hey Jake, you ready to roll this thing? - Yeah, I guess. - Is this handle actually a handle? - Yeah, I think so. - [Jake] I'm going for it. Do you want me to let go and you just carry it? I kind of want to try. - [Linus] I mean, I guess we should. It's our responsibility. - [Jake] We're reviewing this chassis, right? All right, okay cool. Ooh, what was that? - [Linus] Okay, you gotta take it. - [Jake] You can't, you can't-- - [Linus] It's too heavy. What's up L's and G's? Check this out. Look at them pretend to work when we walk in, look at that. This is it! We're actually doing it this time. This is new new Whonnock. It's not gonna have 20 terabytes, it's not gonna have 40 terabytes, it's gonna have 100 terabytes of storage. - [Man] Oh wow, so we don't have to delete anything ever? - No, that's not what I said. It's going to have more storage, though, and it'll be more reliable, Jake promises. - [Jake] Jake promises? - I was expecting them to be more excited. Hey David, watch this. It's the world's fastest server. - Hold it, hold it! (Jake laughing) - [Jake] Imagine if he tripped. - Now this is not its permanent home, that's why there's no actual rails in here. We're actually going to put it here in place of old Whonnock. We never actually deployed new Whonnock because we continued to have problems with it. So this is officially, I am christening it, new new Whonnock. - [Jake] Whonnock Three. - New new Whonnock. - [Jake] Whonnock, you know what, (bleeping). New new Whonnock. - New new Whonnock. See you later old Whonnock. And (bleeping) you new Whonnock. (bleeping) piece of (bleeping) that thing was. We already created our storage space, and this is it, suckas. 104 flippin' terabytes! See, it needs a minute here. It's gotta check how much capacity we got. What's my free space, I don't know. There's so much. - [Jake] Did you tell them what kind of parity you're running? - Oh yeah, right, we're running just single drive failure protection, single parity, and the reason for that, hold on, hold on, the reason for that is that this server will be doing by the minute backups to another local server, and then every probably hour or so it'll be backing up offsite. So we're not really worried about the drives failing and bricking the data. - Plus they're SSDs so like, failures are a lot less common. - Should be fine. Oh yeah, there it is. - [Jake] 100 gigabits? - Holy, is it gonna show? Is it gonna show me a big number? (Linus laughs) Now, a lot of people get confused when we show numbers like this, um, you can't even get internet that fast. Oh my god, I'm so tired of explaining it. That is not the point. That's not the point. It's a local network. We can get these speeds to local machines. Also, we have 10 gig internet, so like, we're gonna use a significant chunk of that, so you know. (Jake laughs) Of course, to transfer those kinds of speeds on the local network, you need some sick transceivers. So these are all the server end transceivers that we're gonna be using. These are 25 gigabit from fs.com. Massive shoutout to those guys, great compatibility, great performance, and did I mention the price? - [Jake] So good. - Freaking awesome. So we're gonna plug in these ends, then we're gonna go hook up all the editing machines and we're gonna do a live test. Some problem, Edzel Yago, production manager for linusmediagroup.com? - Dennis can't seem to access Whonnock. - Hm, interesting. Well hey, good news. We're replacing it right now. - So is it gonna work as good as old Whonnock used to work too? - It should work better than it ever used to work, that's the plan. So gimme like, 10 minutes. - So it should never do anything like this. - I mean. - Okay, I don't know never. - Jake is staking his reputation on it but I don't know if I would. - Wait, I didn't, what? (man laughing) - Why are you downloading Beyond Compare? Why don't you just use ChoEazyCopy? - I'm not using ChoEazyCopy. - But ChoEazyCopy is so good, though. - I love Beyond Compare and I trust it, so that's how this is gonna be. New plan, we're going back to our good friend ChoEazyCopy. - (laughs) It's so good, man! - Oh, it sounds so stupid. But it's one of the only multithreaded, just directory, take all this stuff and dump it over there programs. It's actually really robust. - Three gigabit. - And we're getting, no, I think you mean three gigabytes a second. - Two to three gigabytes a second. - Yeah, so that's like 20 to 30 gigabit, which when you consider that we're plugged into a 40 gigabit network adapter on the old Whonnock side-- - No, it's 100 I think. - Is it 100? - Yeah, but it's like-- - Either way. - Yeah, it's still NTFS. - And it's like being used right now. - Yeah. We could try more threads. - I think it's okay. - Just leave it at 16? - Yeah, that looks pretty toasterific right there. I mean, we maxed out at 3.2 gigabytes a second. 2.4 gigs a second, dang! Now that's hot. It's acid test time, and I actually like Mark's initial comments so we're going to interview him about the performance first. - [Mark] Yeah, it's not bad. - Okay, so what happens in a multi-cam clip normally? - So usually what happens is I'll press play and then I'll stop and then it will keep going a couple seconds and then it'll stop. - Oh wait, so we actually have a tangible workflow improvement? - I guess you could say that if you want to justify it. - Wow, that actually wasn't my intention. We thought we were just adding more storage. - [Jake] And improving latency. - Is this a noticeable difference? - Yeah, I'd say so. - Ah, nice! No, this isn't something that we tested. We knew the latency is better, but it's not something that we were like, yes, we know that this will work better. - Yeah, and we didn't know that it was going to have a very real-world tangible difference. - Didn't we do that though? - Sort of, but we were mostly hoping for improved stability and then also adding the capacity. - Yeah. Something we know from past experience is when you have a latency spike in terms of storage access on your remote server, it can cause not just one person's Premiere to crash, but the entire editing den all at once will just go down. So the tighter we can keep those latencies, the better. And that means both networking and storage have to be as fast as possible. - Does it feel better? - Yeah, that's actually, like, I'm playing at half-res but everything actually feels really snappy. So like Mark said, normally when you play a multicam sequence it'll just run away from you, but no, this is actually stopping. - My jaw is like, my mouth is like, but you can't see it. - I know. - I'm just like. (man laughs) Like, you can't tell. - I know, I was like, I wasn't even hoping for an actual performance improvement, I was just like, well, we'll just show lots of people editing 8K at the same time and they'll be like, yeah, that's great. But hey, it's even better. (laughs) - [Jake] You're not supposed to tell them that, damn it! - Well, what? (Jake laughs) - Any thoughts, Dennis? - I'm playing in full. I need to test. - Okay, but that's more of like, a system bottleneck. Is this 8K or 12K, Brandon? - [Brandon] It's 8K. - Oh, it's 8K? Okay. Is that 8K Red or Blackmagic? - Blackmagic. - Blackmagic, okay. - It's pretty good. Like, this is also, it's a multicam sequence. - Yeah, why is yours handling it and poor Mark's system chugged? - [Jake] Mark's system always has sucked, I don't know why. - [Man] It's only one window. You don't have the actual multicam sequence. - Ah, okay. - Oh yeah, okay, you want to do that? Let's see. Yeah, 1/4 is actually pretty good. I have multicam here, and program. - And remember, we've got everybody else hitting this same project at the same time. - This is on the new thing. I can like, go around. Bam, bam, bam. This project is on the old one. - Oh, you've got it up on both servers right now, what a pro. - Oh yeah, you see? Look at that. There you go. Oh wait, it's in full. (Jake laughs) - [Jake] Wow, that like, okay hold on. What? - Okay. - That's huge. - Gotta have that gen four baby. 'Cause remember actually, Hoffman's only testing one aspect of the upgrade right now, because both of those servers are running at 100 gig right now. So that's actually just the Honeybadger, just that Honeybadger power. Honeybadger don't give a (bleeping) - [Jake] He said (bleeping) so many times this video. It's great. - All right, so good job everyone. Good job Jake, good job editors, keep at it. Socially distanced fist bump or whatever. So all that's left is to thank everyone who helped with this project, Jake, the editing team for, you guys can actually go back to whatever you need to do now. Thank you very much guys. Of course, Liqid for providing the server and their Honeybadgers, Micron for sending over their memory, fs.com for all the transceivers, Mellanox, excuse me, I mean NVIDIA for the high-speed networking gear. Man, those cards are so freaking sick! And am I missing anyone? And Sabrent, right. For sending over all the drives. 100 terabytes! That's so fast. And Infinite Cables, thanks for the cables guys. And right, our sponsor for the video. Storyblocks gets you studio quality stock video clips for a fraction of the cost. And you can download all the stock video your heart desires from their member library, including HD and 4K footage, After Effects templates, motion backgrounds, and more. We use it quite a bit on Tech Quickie, and all the content is royalty free so you can use it for personal projects like YouTube videos or commercial projects like, well, for us, YouTube videos are also commercial. New clips are added regularly so there's always something fresh to download. So why wait? Check it out today at the link in the video description. If you guys enjoyed this video you might enjoy the more in-depth look at both our high-speed networking as well as the high-speed storage with the Honeybadgers that we did with that server as a preview to this. Those were theoretical though. I'm really glad that it's actually working once we deployed it. (laughs) - [Jake] Whoo! (Linus sighs) All I've got to say is (bleeping) new Whonnock. - You mean new new Whonnock? Oh no, you meant (bleeping) new Whonnock. - [Jake] No, no, yeah. - Yeah, new Whonnock, (bleeping) that thing. New new Whonnock, that's where it's at. - [Jake] Whonnock Three. - New new Whonnock, Jesus Christ.
Info
Channel: Linus Tech Tips
Views: 1,817,226
Rating: 4.9404798 out of 5
Keywords: networking, 100gbe, fs.com, 25gbe transceiver, transceivers, fibre optic, fs transceiver, fs.com transceiver, video editing, server, data center, enterprise, gaming, adobe premiere, networked, dell, liqid, micron, mellanox, nvidia, sabrent, nvme
Id: 2n-yJwuVE4k
Channel Id: undefined
Length: 17min 25sec (1045 seconds)
Published: Sun Jan 31 2021
Related Videos
Note
Please note that this website is currently a work in progress! Lots of interesting data and statistics to come.