320 TERABYTES in a normal case!! - The DIY 4k editing NAS

whether you're a casual part-time wedding photographer or you're working on the next big budget Hollywood movie every media production professional has run into this problem at some point they don't have enough space for all their photos graphics assets or video clips what's the solution well a lot of the time people will run out and buy things like these and whether they've got a hard drive inside them or an SSD external drives like these ones always run into some of the same limitations they connect your system using buses like USB or Thunderbolt that are not easily shared with other users so today as a spiritual follow-up to our recent budget 4k video editing workstation I'm going to be showing you guys what I consider to be the budget 4k video editing Nass instantly see your current and past network activity detect malware and block badly behaving apps on your PC or Android device with glassware use offer code Linus to get 25 percent off at the link below [Music] I'm gonna put aside the internals for now because really where the story starts is the case so this ticked all the boxes quiet reasonably professional-looking and it can accommodate with the optional hard drives LEDs up to eight teen hard drives fractals sent along the case for this video along with all the expansions but I haven't looked at the reviewers guide so I don't really know how any of this works well there seems to be a slight problem my original email said the defined 7xl holds up to eighteen three and a half inch hard drives the reviewers guide says fourteen max and it's bolded I don't know how this works oh here we go so now what I want to do is reconfigure my fans before I start stacking hard drives in this thing now we're about ready to install drives but I found yet more conflicting information in the users guide three and a half two and a half Universal Drive positions 18 which one is it fractal so for this project we're gonna be using the ideal drives these are Seagate's iron Wolfe prone as drives so these are the 16 terabyte variant but they are available in a variety of capacities they come with a five-year warranty including Seagate's rescue data recovery service that's freaking awesome and as their pro iron wolf drives they're rated for up to 24 drives in an enclosure because with drives that are not designed for naseous and for operation in close proximity to each other the vibrations of the next drive over can actually affect the operation of another Drive so these are good for up to 20 for instance we're gonna be putting 18 or 14 in this chassis these were a perfect fit we got to put the anti vibration rubber grommet then we line that puppy up on the bottom of our drive now with an SSD you guys have probably seen me use as few as two screws or one or none and some double-sided tape but I would never recommend that with hard drive when it comes to hard drives you mount them with as many screws as you can because even if your drives are designed to withstand the vibrations of nearby drives they are not designed to withstand the vibrations of nearby drives that are not mounted correctly so all four of our screws go in that's sixteen okay none of the documentation said anything about sixteen what the crap oh well that happened we're up to 19 drives which sort of leads me to wonder how much farther we can go like yeah you know what you can call it good at twenty right I mean three hundred and twenty terabytes of raw capacity and a two hundred dollar case let's start talking about some of our other components yes this is a Strix gaming motherboard or whatever but what it also is is a good value board with lots of memory expansion which could be important if we want to run VMs or other server functions on our Ness it's got support for third gen rising processors with a BIOS update of course it's got lots of PCI Express expansion it's got two m dot two slots and we'll get to why we need those later and finally it manages to boot in headless mode without a graphics card installed and without an APU installed where you would be able to use the onboard graphics so that saves us some money because even though we're gonna need a graphics card in order to configure our system we don't actually necessarily want to leave one in there unless we have some purpose for it like we will want to use GPU hardware acceleration for media encoding for a Plex server or something like that so we're going with a second gen rise in 2600 nan X because it's using the original Zen architecture instead of Zen to those individual cores are not as fast now we could go with something heavier if we intend to use this thing you know again as a you know a media server that's gonna have to do you know heavy video encoding or whatever the case may be but our intent for the build today is to just have it be a file server and this is going to be plenty plenty of horsepower for that now I did consider go Intel for this bill but even though we're using regular unbuffered memory one of the things that pushed me to AMD was their unofficial support for ECC or error checking memory on their consumer processors now it does require support from the motherboard and conveniently this one happens to support it as well as costing a little bit more but if you were gonna run something like ZFS for your software raid it is a recommended feature to have and you should spend a little bit of extra for some on buffered ECC DRAM pooling is another item that I will devote a little bit on this build so I ultimately decided to give it a shot with the AMD Box cooler and then as long as my thermals and acoustics were fine stick with that and then if they're not then I can always upgrade down the line one thing I spent extra on that would normally be considered a splurge item but in this case actually makes a ton of sense is a modular power supply why don't we just say this the recommended way to do this would be to get your hands on some custom cables for the power supply all right that's sixteen and we've got both one more harness as well as one more plug on our modular power supply to handle our other four drives I just really doubt that this is gonna work turns out this power supply does only come with one four connector molex cable but I was able to find one just kind of lying around in the warehouse so we've got enough even if you as an end user would end up having to order an additional one now comes the part of the build that's pretty much just down to however you want to do things connecting the drives to data as you can see the motherboard can only accommodate six drives with these connectors on the right-hand edge fortunately as long as we've got PCI Express slots to spare we can add pretty much as many SATA ports as we want with boards like this now the most important thing to watch out for if you are expanding your storage is not to get a raid card you want an HBA or host bus adapter because most software rate whether you're running it through FreeNAS or unread can behave erratically or at the very least not give you proper Drive reporting if you are using a raid card another thing to watch out for when you're shopping for these is the types of connectors some of them just have the regular SATA connect that you would recognize and you plug into them and then you've got an octopus of cables coming out a plug into your drives but others use connectors that are more designed for SATA or SAS backplanes so mini SAS HD or SFF 8087 are some pretty common ones the way that you connect these is with slightly fancier cables so here's a mini SAS HD one this is an eight port card so you've got just these two connectors that go into the back of the drive and then way at the other end you've got the octopus oh yeah it's actually eight octopus okay so it's four per connector picking up cards like these secondhand on eBay can be a great way to add a ton of connectivity to your system just one thing to watch out for guys is SAS cards will work with SATA drives but not the other way around for whatever reason you have SAS drives you can't buy SATA HBAs so to be clear guys I am not necessarily recommending exactly the cards I'm using I'm just using whatever HBA cards I had lying around a couple little housekeeping items still be taken care of if I want to Kayla manage these kind of like this these ones for the bottom can go over here a couple of cable ties and then I've run myself an extra SATA cable for the future in case I want to plug in a second SSD down the line and still got to plug in these ones at the top overall actually this is not bad for having 20 hard drives in it I could use the built-in fan controller that's in the case but actually that would require another SATA connector and I don't have any right now all I need to do now is put in my temporary graphics card yeah this obnoxious what what do you mean obnoxious okay I mean like in a good way this is awesome so I'm not that familiar with proxmox and I wanted to show people how you might configure a system like this in proxmox what if you ceramic-coated this if it would help with the finger prints what is it with you and ceramic coating things no that's cool probably make sure you're subscribed so you don't miss our ceramic coating a phone video which was also his eyes this is heavy them so I mean like straight into proxmox the only thing you can really create is a single video cool so we could have one that's like raid z3 although if you're gonna add more drives that would mean you would need at 20 hold more truth I mean in an ideal world what I would probably want to do is like maybe three raid-z ones so that would be three grades e1v devs that would be three drives of capacity loss two redundancy and then I'd have two hot spares or something like that I mean if you're running stuff of your house like for me I have my ubiquity controller that runs on a VM on - I have a plex server I have lots of different VMs just for doing all these little things home automation and like in proxmox you can do it really easy you can actually create containers which are still running in the host OS so there's a very little overhead and it is super easy to maintain so why don't you just use FreeNAS well aside from my bad experiences with it in the past it's sort of a question of what's more cost-effective right right so I'm raid costs money yeah which is sort of a drag not a whole lot but but if I want to use ZFS optimally in a way that is recommended by the experts who know a lot about ZFS I'm actually spending more on memory upgrades yeah if I don't care about the virtualization which is not how I've configured this in the first place then it would cost me to just buy an unread license in the first place right and I'm read does have some performance gotchas like if you level your drives that you're not accessing currently to go to sleep so you disable turbo right that's bad and also if you configure it to fill up one drive then the next one then what that means is every project can potentially be IO bottlenecked by the individual drive that it's being pulled off of I just wanted to highlight a few different types of software that you can use for a config like this okay so we we just if we do DF we can actually see it's 214 terabytes of capacity oh no I mean we lost what was it for drive good heavens three drives it oh man you can wow the vibration is real you know what actually this would be a good way to check our drive thermals I'm gonna put the covers on and then just like run a hundred gig one and let yeah I'm gonna install that data so we can actually look at the array it's nice that there's so much room for cable management on the back but in the event that you do have kind of a you know Thicke boy cable back here I would prefer if there was some way to screw on the side panel that's not that great I mean it's holding but see that is what I'm talking about cable manager stuff better watch out that's power for the drive oh why is it like that now I did misspeak before I said that this was two hundred dollars it's two hundred dollars without the tempered glass side panel which we obviously wouldn't need for a build like this that's just someone they sent so we're using net data to monitor the disk usage it's always so funny cuz ZFS messes around with it so it's like 20 megabytes what that doesn't make any sense now that we're updated the first thing we need to do is create our unread array so the parity disks right here are the capacity that we're going to give up in order to avoid losing data in the event of a physical drive failure so one parity disk means we give up one drive worth of capacity but it also means we can only lose one drive before we start to lose data after that while two means that we give up a total of 32 terabytes of space but we can lose two drives before we start to lose any data now it should be noted I'm read has a cache feature that allows you to have high speed SSDs as like a faster storage tier but I used the word tier very loosely because it doesn't work the way you might expect it to you can use it to accelerate writes on to the young raid array but from my experience especially when working with very large amounts of data like you might when you're ingesting footage it can be a little bit on the finicky side and I wouldn't really use it for that what I would use it for is if I wanted to run virtual machines on this I would run all of my VMs off of a RAID one set of SSDs that I plug into my M 2 slots oh oh cool they built a new feature based on my feedback when it's formatting it automatically pauses parody sync because otherwise it takes like a day while we wait for the format we can adjust some of the settings that we talked about before so turbo right is technically called reconstruct right so we're going to go ahead and turn on this is the second tweak i talked about we're gonna use most free so as we write data to the share it'll go to whichever drive has the most free space on it which means that if we were to write 18 separate video clips it would go this one this one this one this one this one this one this one like that minimum free space is a really important parameter to tune so if we think our clips could be no bigger than a hundred gigs then we need to make sure that we Keith at in now Nicholas assured me that this is going to work but Nicholas also brought me the wrong motherboard twice when we were doing that CPU repair thing here's our problem our chassis fans are running at 700 rpm which is nice and quiet but is just not enough to push enough air through all those friggin drives I'm gonna move our cable from our onboard gigabit network to our add-in 10 gig a quanta card are we 10 gig we're 10 gig share time who's not that busy right now there's my water bottle you bastard why would I I don't know but it has my name on it and also my stickers so right now mark is pulling in excess of gigabit speeds when he's playing back this is ten to one 8k red footage so really not what I had designed the system for and Dennis how's it going ok so Dennis 2 is an excessive one being in it but we're also getting some chop now so we're actually pulling three and a half gigabit per second off of that machine now the right speeds are not fast but the assumption that I made is that you guys are not working with ten to one red footage and instead you're ingesting from SD cards in which case 60 to 80 megabytes a second should be as fast as you need as long as only one person's ingesting at a time the benefit of unread that I think outweighs its slow rates in this case is that if you're the kind of person who's just starting out it allows you to just get one parity drive and as few as one additional storage drive and then just expand as you go as long as every drive that you add is smaller than the parity drive you can add as many different kinds of drives as you want and you can just add them one at a time that's something that you can't do with a ZFS based solution like FreeNAS like proxmox I'm really surprised that this worked as well as it did I I mean that's like between the two of you that's around 350 megabytes a second that we're pulling off of that thing and drive temps have held steady even while we're pushing it so all the ones on the front are around 39 41 degrees and you can really tell which ones are the four that are in the top and epic back 47 48 46 and maybe this one 43 could be worse though so it works great but of course the million-dollar question is how much does it cost and when I say a thousand dollars with no drives so no SSDs not even the USB to boot on right off of that sounds like a lot of money but when you compare it to an off-the-shelf NAS you would be paying more than a thousand dollars for one with just eight days and it might have specs that are much worse than this one whereas we've got a six core processor 16 gigs around 10 gigabit networking 20 hard drives to n dot 2 s and 2 more SATA drives just comes down to what software works best for us so whether you choose unreadiness proxmox or whatever else floats your boat this is a great starting point if you're a starting out editor and you want to work with 4k footage or apparently even 8k even if you have a small team speaking of having a small team guys this video is brought to you by fresh books fresh books is the accounting solution for you and your small team fresh books makes it easier to focus on your business instead of uncomplicated accounting software it's designed to be simple and intuitive and you can automate tasks like invoicing organizing expenses tracking your time and following up and the best part is everything is stored in the cloud so you can easily switch between your PC and your mobile device whether it's Android or iOS start your 30-day free trial right now at fresh books comm slash tech tips pricing starts at just $15 a month with the $25 a month tear handling up to 50 billable clients so thanks for watching guys if you liked this video maybe check out our budget 4k video editing workstation it is a perfect companion for our budget 4k editing that's what it's all about right getting work done keeping all your files organized in one place getting everybody access

Channel: Linus Tech Tips

Views: 2,234,990

Rating: 4.9284296 out of 5

Keywords: Define 7XL, segate, iron wolf, NAS, DIY, proxmox, unraid, freenas, 4k, editing, networking, terabytes, 20 bay, computer, 8k, red, storage, fractal, amd, HBA, zfs, raid, home, server, small business

Id: FAy9N1vX76o

Length: 18min 48sec (1128 seconds)

Published: Sat Mar 07 2020

Reddit Comments

[u/IMI4tth3w]

Fractal Design 7 XL

[u/Hobbitcraftlol]

16 3.5" drives if you don't want to do janky non-standard mounting like he has done :)

[u/Nullberri]

I noticed he didn’t add any additional cooling for his hba. That thing is probably cooking itself.

[u/curl-o]

Placing HDDs into fan-slots, that sure is datahoarder way to go.

[u/Jasondtay]

Those drives are about 500 a piece right? so that's 10,000 in drives right?

[u/[deleted]]

Can I ask something? How come, for high-end and custom rigs like this, or even enterprise, do they not use thicker cables? For instance, a single 5-VDC cable coming out of the power supply that's near the size of a car-battery cable. Then have smaller wires splice off it for each 5-VDC drive connection. Or same with mobo, why not a single thick-gauge 12 and (separate) 5V (and ground, of course) wire, that then has several smaller wires coming off it to the ATX and other power connectors?

I'm not saying this would be for the masses, as I know copper is expensive, but with what some of these people are paying for water cooling, or the custom cabling management/pcie-extenders, etc, I'm surprised they don't make low-gauge 3-wire power supply lines. Doing so would give you amazing cable management options, no? So There must be an electrical reason?

[u/[deleted]]

Why not just spend $250-300 for a 24-bay 4U NAS?

[u/Athrax]

I've actually got a somewhat similar setup going, with 'just' around 90TB across 20 fullsize HDDs and 4 M.2 NVME drives in one normal PC case. I'm using mostly oldish HDDs I've had laying around since the rig was built on a budget. If I was Linus I probably too could afford to use 16TB drives.
I still got space for 3 M.2 drives, and theoretically could add another 16-port controller and probably find the space for another 4 3.5" or a half dozen 2.5" drives, but for now I'm happy. See current rig here.

[u/gnocchicotti]

This is a surprisingly not bad video from Linus.