How Do I Backup All My Servers???

so why do i drink cocktails over the top of really expensive server gear just to trigger people welcome back to craft computing everyone as always i'm jeff and yes there's another genbro nr 12000 sitting in front of me but this one is not going to be a primary use server nor is it going to go into my home lab instead this is going to be my new backup server now this is the second nr12000 chassis that i've purchased the last one is a dedicated nas for my home lab so something that i can tinker with and try new configurations on but something that i don't necessarily need to rely on for day-to-day operation however this server is going to function as my new backup system before i get into it i do have a little bit of a confession to make i wasn't necessarily using raid as a backup but i wasn't necessarily keeping the best backups either that's because to keep good backups you need to spend almost as much money on your backup system as you do on your primary system and well budget has been a primary factor limiting the amount of storage that i have the primary storage pool in my main trunas system has been a collection of eight eight terabyte hgst enterprise drives giving me a total capacity in a raid z2 of around 40 terabytes and in the not even a year since i built that server i managed to grow that storage pool up to 32 terabytes which means i need at least 32 terabytes of backup storage to keep everything that i want yeah these videos use quite a bit recently i did a little bit of housekeeping and got that number down to 26 but that still means i need at least 26 terabytes of raw storage to create a proper backup of all that i alleviated part of my storage problem by filling up the rest of my nas with 16 3 terabyte sas drives now these i'm not relying on on a primary basis because well three terabyte drives are pretty much inherently unreliable but they did give me some added storage at a pretty low cost of about 22 dollars per drive i also moved some of my less critical data off the primary storage pool and onto those three terabyte arrays meaning my craft computing data can continue to run almost worry free but it's only worry free if you have a good backup solution so i present to you today my new backup solution this is again a chenboro nr12000 chassis which is a 1u 12 bay server inside of this system is just a basic 4 core 8 threaded cpu in the xeon e3 1230 v2 it's an iv bridge chip with a 3.4 gigahertz clock and should be more than adequate to run as a backup server for system memory at the moment i have 16 gigabytes of ddr3 1866 ecc non-registered memory as the server will not use registered memory nor can you add more than 32 gigabytes to it that being said i do have a 32 gigabyte kit on the way it just didn't arrive in time for this video i also added a two port 10 gigabit sfp plus network card what's nice about having two ports is one of those is going to go up to my 10 gigabit switch to give 10 gigabit network access the other is actually going to be direct connected to my truenow server meaning that any backup traffic generated won't actually touch my network as far as storage goes i figured i might as well fill this thing up to the brim so it's got 12 6 terabyte hgst helium drives also running in a raid z2 after the raid z2 and formatting was applied i have about 48 terabytes of usable storage inside this box giving me more than plenty to back up every single server in my home lab and i think that'll do it for the hardware introductions so i'm gonna go slide this thing back into my rack and i'll be back in just a minute and i'll show you how i'm going to use this as a backup server see in a second while mirror universe jeff is lugging that 49 pound server into his rack editing jeff here to tell you about today's video sponsor lenode because one of us needs to make money around here like i mentioned earlier storage can be expensive especially when you need to nearly double that cost just to keep proper backups so whether you have a couple computers at home a full server rack in your garage or manage full-fledged data centers instead of keeping your backups on prem why not let lenode host them for you linode features both block storage and s3 compatible object storage plans with prices starting at 10 cents per gig making it easy and affordable to keep all of your data protected but lenote isn't just for storage they also offer virtual machine instances in just about any price or power range and if it runs on linux it'll run on the node with services from shared cpu plans massive dedicated multi-core virtual machines and even gpu instances featuring quadro rtx 6000 cards there's no limit to what lenode can host for you visit lynnode.com craft computing and get a 100.60 day credit just for signing up for a new account and get your home lab cloud business or backup solution started today that's the node.com craft computing and now back to that other guy who keeps spending all of my money on ebay and we are back and wouldn't you know it as soon as i got the server into the rack and fired back up the postman knocked on my door and delivered my 32 gigabyte kit of ram so the backup server does indeed have 32 gigs now but enough about the hardware let's go ahead and dive into the backup configuration and we're going to do that by starting over on my existing truenow server so that is at 192.168.1.226 and as you can see i have three storage pools all of which i will be backing up in this video and yes i am well aware that i have one unhealthy pool in my server right now uh all of the disks are reporting green as far as the smart status goes but one of the disks i believe it was disk 21 uh said it had seven errors that it had to correct from and even after they corrected the errors uh the unhealthy pool status remains so i might need to actually pull that disk out and test it independently or just swap out the disk for another one and scrolling down just a little bit further here you can see that i do have both of these servers with dual 10 gig network cards again one of these nicks will be connecting each of my servers up to the rest of the network the other will be a direct link between them and that is where all the backup jobs will go now the way i'm going to configure my backups is through a pull replication that is i'm going to configure the backup task on my backup server and have it scrape the data off of my primary true nas box to get that all set up i really only need one piece of information off of this main server and that is what is the network address of that secondary 10 gig link and i've set that up as a static address between the two so my primary box is 10.100.100.11 and on my backup server if i go to network summary it's 10.100.100.12. besides the network address the other thing that you need is to have snapshots enabled because that's actually what's going to replicate between one server to the other so again if we go back to my primary truenow server and i go down to tasks and then periodic snapshots and as you can see all three of my storage pools have a periodic snapshot that captures once per day and i save each of those snapshots for one week to verify that everything is running as scheduled i'm going to go down to storage and then click on snapshots and for each pool and for each data set underneath as these are set up as recursive snapshots there should be a total of seven snapshots taken one for each of the last seven days and as you can see for the storage pool craft 44 terabyte we have a snapshot taken on march 15th all the way back to march 9th and scrolling down you can see all of the child data sets as well as the other storage pools have the same number of snapshots so we are good to go ahead and start backing up this server jumping back over to the backup server i have one storage pool set up as one very large raid z2 with total of 46.08 terabytes available now i don't have any data sets set up yet but i will be setting up a data set for each individual storage pool that i'll be backing up so on the backup server go ahead and go over to tasks and then click on replication tasks then we're going to go over to add now this wizard is pretty cool as it does pretty much everything for you under source location i'm going to select on a different system because i am pulling from the truna server onto my backup server the way zfs replication works is through a zfs connection direct connected between these two boxes but since i haven't set up an ssh connection yet we're going to go ahead and create a new one i'm going to go ahead and name this craft dash truenas dash12 which is the name of my truenow server under setup method just leave this as semi-automatic unless you're backing up from a different zfs system other than truenas under truenast url i'm going to type in https colon slash and then the ip address of the dedicated 10 gig card so that was 10.100.100.11. then enter your username and password and under private key go ahead and click on generate new private key and if everything looks good click on create ssh connection now if everything worked properly you should be able to click on the little down arrow right there and browse the storage pools on your truenow server so we are up and running and there are my three storage pools clicking on the little arrow next to the storage pool will reveal all of the child data sets now when setting up a zfs backup you can select to back up just a single data set or you can select to back up an entire storage pool the way i'm going to do it is to back up the entire storage pool and then click on recursive so i've selected the craft 44 terabyte storage pool and checked recursive now i'm going to go over to destination and we're going to set a path on this server where we're going to store the backups it again browsing down and clicking on the craft backup server i'm going to create a new directory here craft dash 44 tb dash z2 by default any replication task you set up will be encrypted over ssh it is a little bit slower but it is a lot more secure and if you are passing this over any kind of network i would recommend clicking on encryption for my setup though i'm going to select no encryption as i am again direct connected with a physical cable off of the network from one server to the other and if you are happy with the way everything looks up here go ahead and click on next by default your replication task will run daily at midnight and your snapshot lifetime will follow the same settings as your source data sets now again the snapshots on my truenow server are set up to capture once per day and hold them for seven days and i think that's a pretty good starting point on my backup server so we're going to leave this as default however i will be setting up an additional snapshot task on the backup server to extend that timeline a little bit and again if everything looks good here go ahead and click on start replication now i'm going to do the exact same thing for my other two storage pools so i'm going to click on add i'm going to click on source location on a different system and since i've already set up the ssh connection i can just click on craft truenast 12 and then select my new source so i'm going to go ahead and click on my valiant storage pool and then click on recursive the destination again is going to be the craft backup server inside of its own directory so forward slash craft dash ncc dash 74210 that's the uss valiant if no one knew that again i don't need any encryption in my particular use case i'm gonna click on next and then again we're gonna use the defaults for scheduling and snapshot lifetime so start replication and finally one more task for the defiant pool so now we have all three of my replication tasks set up but they're not going to run until midnight because that's what the schedule says to do so i'm going to go ahead and force one to start by clicking on the little expand arrow and then clicking on run now so clicking on the task manager you can see it's already at four and a half percent so now if we go over to storage and click on pools you'll see that we have a brand new craft defiant data set that's been created and we already have one gigabyte of data transferred over now that we know it's working i'm going to go ahead and force start the other two reason being is there's about 26 terabytes of data to transfer which means it's going to take most of the night and probably most of tomorrow so i'd rather get those started sooner rather than later back over to storage pools and there are all three of our data sets now the nice thing about using snapshots is the initial backup is going to take a fair amount of time because well there's 26 terabytes of data to transfer however from here on out the only thing that will need to be transferred is the data that changes not all 26 terabytes but i mentioned i was going to set up some additional snapshot tasks on my backup server to extend the timeline of my snapshots a little bit and here's how i'm going to do that on the backup server i'm going to go up to tasks and then click on periodic snapshot tasks i'm going to add a periodic snapshot so if we click on data set you can see the replication task has recreated all of the data sets that were present on my truenow server so again we can choose here to backup a storage pool or create snapshots for any of the child data sets however since i'm going to configure just one backup policy for everything all i need to do is click on the storage pool and then click on recursive under schedule i'm going to set up a weekly snapshot and i'm going to keep the data for eight weeks if i haven't noticed that the data is gone within two months i probably don't need it back by default the weekly schedule will run sundays at midnight which is perfect because i usually take sundays off and if everything is set up to your liking go ahead and click on submit so now once per day my backup server will pull any new data from my trunas server and keep it backed up daily for seven days it will then also keep one snapshot per week for two months meaning that any time within that two-month time frame i can go back to a previous spot in time and pull data from but what about my proxmox servers how am i backing those up well there's a really cool feature built into proxmox called backup which allows you to push a backup of any virtual machine that you have over to a nas device and so all of my proxmox servers are set up to send backups to my trunas server and then the truenow server is also being backed up to my backup server which means i actually have two copies of my backup data for all my virtual machines now the setup for this is pretty darn simple i'm gonna jump on over to my proxmox server i'm gonna click on the data center icon and then go down to backup and as you can see my proxmox server is set to back up every monday at 4 am and back up all of my virtual machines to my craft truenow server and if you ever need to recover a virtual machine from backup that process is pretty simple as well simply click on one of the vms that you would like to restore go to the backup tab and then you can see the backups that are currently in storage you can click on one of those and click on restore so as you can see proxmox has a built-in solution that is pretty darn slick now i will say when i was planning this video out as well as just thinking about how i wanted to take backups i really did consider the all-new proxmox backup server it came out recently and it looks pretty darn good but the use case for running a backup server in my rack is to back up my trunas server it's not to back up the vms it's not that they're not important it's just they're not critical that and truenos already has the zfs replication task that works flawlessly between two machines and proxmox i'd have to kind of jury rig something together so the easier solution one i must say i am feeling a lot better now that this is set up especially because my old backup solution was a raid zero of two 10 terabyte drives that i just kept offline most the time and would try to run a replication to about once every two weeks which we all know how reliable human scheduling is now that i have the backup fully automated i can sleep a little bit easier at night however there's also the task of getting all of that 26 terabytes of data pushed off site for a full 321 backup and i haven't figured that one out yet especially because i only have 50 megabit up that's gonna be a problem for another day and i think that's a pretty good place to wrap this one up but before you go let me know down in the comments what did you think of this backup solution and what do you use for your home or business servers i'm genuinely curious to know on your way down there make sure to drop this video a like and subscribe to craft computing if you haven't done so already follow me on twitter at craft computing to keep up with my daily shenanigans like this and if you like the content you see on this channel and want to help support me in what i do consider joining the patreon or float plane links are both down in the video description as a bonus you'll get exclusive access to my discord server where you can chat with myself and the other hosts from talking heads also if you're interested in any of the hardware from today's video i will have ebay and amazon affiliate links down in the video description as well go give those a look thank you all so much for watching this one and as always i will see you in the next video cheers guys here we go in another episode of mixology march and i'm pretty excited for today's drink as i've never had this one before it's called the devil's own and it's essentially a new spin on a gin martini but this time with some orange liqueur and some angostura bitters added in it sounds pretty interesting so first up we're going to add some ice to our shaker gin for today is one of my more recent discoveries and i've really been enjoying it from oregon distilleries it's their dry gin a pacific northwest forged gin this classic dry gin birthed in the high desert offers itself up to the palate with a crisp citrus bite deepened by juniper and softened by pine well yeah it said it was gin i certainly hope those are present so one ounce of our dry gin the recipe calls for one full ounce of vermouth i'm gonna go with three quarter ounce of vermouth i just want a little bit more orange in my drink than uh vermouth so much like winston churchill i prefer my martinis with uh as little vermouth as possible as he once said the proper amount of vermouth in my martini is for the bottle to angrily stare at my glass from across the bar and finally one ounce of an orange liqueur i'm using gran gala one reason i really like this one is it is a brandy based liqueur and it is a full forty percent also you get a great orange taste with it without adding a lot of syrupiness to your drink which a lot of the cheaper orange liqueurs tend to be well more sugar than liqueur and finally just a couple of dashes of angostura bitters and now we shake shake until you get just a little bit of frost on there then we're gonna strain this straight up into a martini glass for better results you should probably double strain this drink as uh ice chips aren't really one of the things you like in martinis most of the time but i just didn't grab my second strainer i feel like that should have a garnish although it didn't call for a garnish i feel like a lemon would be a great garnish i'm gonna give it just a little bit of garnish a little bit of lemon zest in there and there we go a devil's own gin martini um i will say it started fairly cloudy but it is starting to clear up there there's a couple things about this drink i can tell you right off number one adding that little bit of a lemon garnish that was a good move number two reducing the vermouth to three quarter that was also a good move um i can taste the vermouth but it's way way in the background instead that that orange and brandy is playing so well together with with the gin this is just outstanding someone in my last video commented that they didn't realize they clicked on a how to drink video to that i'll comment with uh this drink has a lot of orange in it it's not sweet like at all this is a very dry but still citrus forward drink and adding that little dash of lemon i think really did help but i'm actually really impressed with this drink ended up being a genuinely good martini

Channel: Craft Computing

Views: 80,497

Keywords:

Id: jwkRLHdtsmc

Length: 19min 49sec (1189 seconds)

Published: Sat Mar 20 2021