How to Use and Store Data on the Cloud | AWS Cloud Storage | Intellipaat

hello everyone welcome to this session on ews cloud storage tutorial in this session today we will be going through the agenda so let's go ahead and see what the agenda is and understand what all we'll be covering today so first of all we'll be starting off with what is AWS cloud storage and then we want to discuss the different types of AWS cloud storage once that is done we'll move on and talk about the different types which are basically AWS s3 then you have AWS EBS AWS EFS and then AWS FS X so we're going to talk about all these types today and majorly I will be showing you hands-on for all these services in this session all right so without any delay guys let's go ahead and start with the session with the first topic which is what is AWS so let me give you a brief about what the AWS services so there is a degrace is basically a company which rents infrastructure on the internet and this infrastructure can basically you know be either of compute it could be networking it could be storage but basically you pay the cloud provider or the company who's renting you that infrastructure on a pay-as-you-go basis right so the infrastructure can either be a server it could either be storage it could either be a network device etc now why should you prefer an AWS infrastructure rather than buying your own hard drive or your own server is first of all you know this type of infrastructure is actually used by a lot of companies so what is there in it for you to learn if you learn this infrastructure how to use it etc there are more chances that you can actually get a job as an EWS professional in most of the fortune 500 companies since 90% of them are using AWS forest for their daily needs second thing is the AWS infrastructure is very cost effective now what that means is that not only do you get a lot of free services to use in AWS but because of the oddly try or a pic or the pay-as-you-go pricing that is available in AWS it is a lot cheap for companies to actually use the infrastructure of AWS rather than to own their own infrastructure right so basically companies that's why are preferring cloud computing and that's why companies have now started to rent infrastructure from cloud complete like AWS rather than having their own infrastructure third thing is because of the availability so the AWS service is actually any available service is actually available in a lot of regions around the world now what that does is it not only gives you you know the option of having and your service available in a lot of countries which basically makes it highly available but at the same time this what you get is you know low latency so let's say somebody's India is trying to access your service and that service is basically let's say hosted in US so somebody from India if he's trying to connect to the US servers obviously it will you know the response time for any kind of operation on that application could be more but if your application is actually hosted in the different regions you can get the response time pretty fast and that is valid across all these services which are there on the AWS console now having said that now let's go ahead and talk about what is AWS Storage exactly right and which is exactly the session also that we're talking about today so guys AWS Storage basically gives you a pay-as-you-go pricing model on all the storage offerings that are given by AWS now what are the different types of storage offerings given to you by AWS so I have broadly categorized then in generic terms and then we will talk about the specific names of those services right for example AWS gives you an internet storage all right which is where you can basically store anything and that anything will then be available on the Internet right the second type of service that you have in AWS is the hard drive storage right so what are the hard drives for you for example you will see that a lot of companies which are running servers on cloud providers they are when you deploy servers and cloud providers they also have an underlying hard drive which is basically connected to it now that hard drive can be controlled specifically as well apart from the server with what that means is let's say you are using a Windows system right you have your own desktop you have your own laptop now on this next op or laptop if you all say that you have 50 GB of hard drive and tomorrow if you want to increase it 200 GB so what you will do is you will add install first of all you you don't have to buy that a drink and then you will install that harddrive is a secondary hard drive in the server right so that is also given as a service bar AWS so all the servers that you deploy on AWS you can add unlimited amounts of hard drives to them right and those hard drives can themselves have you know a lot of storage capacity and that storage capacity you just have to specify in the console and I'll be showing that in this session today as well right so this is the second kind of service which is given by e SS which is the hard drive storage which you can attach to a tablet servers the third kind of EWS service that you get is the network storage now what does network storage for example you would have seen in your offices or you might have encountered a hardware like this as well where in let's say you are sitting in one room of your house right and the desktop that you have let's say it has a one there about a terabyte hard drive so you can make that one terabyte hard drive of yours which is in let's say another another room right as a network drive and what it will do is basically anyone in the house who is connected to the same network can access that hard drive over the LAN or over the Wi-Fi that you have or the home network that you have in your house right so that is what a network storage a so how is that helpful in AWS so when we talk about hard drive storage so hard right store basically can be connected to only one server at a time but when you talk about network storage it can be connected to multiple systems at a time so that is also useful and I'll show you how you can use that also email WS and finally we have something called as high performance storage which is basically used for machine learning you know types of data and then it is also used for big data use cases so when a lot of i/o is required a lot of input output is required a lot of throughput is required you use these specialized services that are there in AWS so this also includes your databases and we'll talk more about these as we move along so let's first start with the internet storage how it can be used and what happens exactly so guys the internet storage is basically called simple storage service right and this simple storage services is basically also known as the storage of the Internet now what do you mean by that now it can store files in an unlimited amount of fashion where in each file can range from 0 points to up to 5 terabytes so this is the kind of dreams that you get so let's say you are uploading a video file on your Amazon simple storage service right so that video file can be up to 5 terabytes now you will say is it something like Google Drive so yes it is something like Google Drive but apart from you know uploading files and then down giving it to a friend who will be able to download it on the other end of the Internet it gives you a lot more features as well and that's what we are going to discuss now right so first of all it can be used to store data which is good it can be used to throw data fine second thing is it can be also used for hosting data now what do you mean by posting later hosting database basically means that not only you can store your data over there but you can also share that data to other people over the Internet it can also be used as you know serving the purpose of as a back-end for your website so all the images that you've seen in a website if you want to load it using s3 even that is possible and even I will show you by creating a simple HTML file how you can basically load images on an HTML page by using the f3 servers right and the third thing that s3 is also famous for is static website hosting so if you have static code and you want to host it on AWS even that is possible using and so let's explore all these features one by one so what I do is let me log into my AWS management console and from there let's let me take you to you or again sorry there's a net connectivity issue today so I hope everyone is able to hear me now and this is where we left off when you were dies even you guys were able to hear my voice so basically this is how my AWS management console guys look like right so I was telling you that the first thing that you have to do is you have to click on the s3 service now once you click on the s3 service what you do get is a management console which looks like this right now in this management console the first thing that you do is you click on the bucket that you want to work on so if you have not created a bucket you can go ahead and by clicking on create bucket over here in the s3 management console you can create a bucket for yourself as well right now how do you go ahead and create a bucket just click on this button right and specify the bucket name over here now the bucket can actually be created in multiple regions you can choose whatever region you want so like I specify that AWS is actually available in a lot of regions right so all these regions are listed over here you can choose from Mumbai Singapore Oregon to other regions as well and whichever region you want you just select that region specify the bucket name over here let's say we specify the bucket name as AWS bucket and let's say it's test ok this is the bucket name that I'm giving and now what I'll do is I'll just click and go ahead and click on create bucket now what is going to happen is sometimes it will give you an error that bucket is with the name that you have specified it already exists now it might be the case that it does not exist in your management console but it talks about that bucket name actually existing in the region that you are deploying through somebody in the Mumbai region has already given this particular name which is called AWS bucket test so let's give it some other region let's give it Intel apart AWS let's see if this is a unique name so it's not giving me any error let's click on create bucket and yes this bucket name ones are actually not created by anyone else and he would have noticed that I did not change any setting I loaded all the default settings and that's how I created this bucket so now you can see that this is the name that we gave to a bucket and it is listed over here let's click over here and let me first show you the first thing that you can do with s3 which is basically upload a file into it now how can you upload a file in history let's go and understand so the first thing that you have to do is you have to click on upload and then you have to go ahead and click on add files and then you can add any file so let's let's say I add let me choose a txt file or let me go ahead and actually choose an HTML file if I can get let me go to desktop so there's this file called error dot HTML let me cover it in upload it right so this file has now been uploaded on to s3 right and this file can now be given to other people as well now how can I give it to other people now if I want if I open this HTML file in my browser to the SD management console I can go ahead and download it so the first level of accesses that you can give your AWS management console to someone else as well and these guys who have access to your management console can go to s3 and they can download it directly from this management console right now the next thing that you can actually do is you can change the permissions of this file so if I go ahead to permissions right I can give this file permissions by giving it public access so first of all what I have to do is I'll have to change the permissions of this file and the permissions I will have to give the public access now you can see it says the block public access setting can be turned on for this bucket which is basically preventing public access give granting to this particular object as well which means on the folder level first I'll have to specify that public access is allowed now how can I do that just go to permissions right and here you have the option of block all public access let's go ahead and edit it and let's turn it off all right let's click on save now okay so now what I can do is I can click I've just edited the block all public access and I can just click on confirm to confirm the settings so now public access has been granted to my bucket and now what I can do is I can just go to the bucket now and I can select the HTML file that I've been using okay now what I'll do is I change it properties for this particular file now so I just select this file click on action sorry click on properties or let me click on permissions actually and now over here I can see that public access this off right so again I go to view select the file go to actions and now make it public so when I make this file public now if let's say I select the file and this is the link of the file that I get now so I can just open this link and this link will open the HTML file instead so now anybody of you if you open this link that is over here right on your browser you will actually be able to go ahead and see this page okay so this is what is hosting a file now this is not possible in Google records you cannot host an HTML file like this in Google Drive so it's not even HTML files which can be hosted let's say I go ahead and upload a video file over here right let me go to my bucket once more and let's say I upload a video file over here and then video file that video file and give public access then the link that I'll be sharing with you if you hit that link on the browser you will be able to download that video file through your browser on your computer now that is again an option which is there in Google Drive right but let me show you very cool thing so let me go ahead and upload some image over here so let me click on add files and let me go ahead and let's say upload an image let me get an image from the internet so let's say we go ahead let's say we get the AWS Google right this is the a doubler logo let's go ahead and download it let's call it a SS logo or let me see if I can download some of the file let me search for EWS two each so let's say this is one architecture which is available on the internet okay let me go ahead and save this image so this will now be saved on my desktop now let me upload this on s3 I just click on add files and let me upload it to s3 this is the diagram all right so this file has been uploaded now may let me go ahead and make it public okay so the file is public now now what I do is I'll quickly go to terminal or let me just quickly create an index or HTML file right and let's first save it so let me save it again on the desktop and let's call it as indexed or HTML okay let me specify HTML tag right let the title be sample website right now let me specify body bgcolor or body it's background and then I have to give a link over here now this link can actually be of my file that I have uploaded on s3 right so let me copy this link let me know couldn't in browser and see if I'm able to actually load it or not so yeah I'm able to load it let me copy this link and now let me go to my sublime text paste the link over there and now let's see if we are actually able to see this HTML page so let me quickly go to my desktop and let me go to in next or HTML so let me search for index dot HTML on desktop okay let me open it and here you can see this is how much you are finally looking a which is good I can see the title as well I can see the image as well and now what I'll do is I'll upload this on s3 so this was my bucket let me go ahead and upload it so let me click on add files and in add files I'll just add the index for HTML that I've just created okay so file has uploaded now now what I'll do is I'll just make it public and now if I go to this link you can see that I'm able to see the image which is actually being loaded from esten right to give you more perspective as to how this is really cool let me go to an Arab Luis server and let me actually go ahead and deploy our web server over there which will actually make things more clear to you so when you would look at any website it could be the intellibid website is there on the web page all the images that you see those images are at least stored somewhere now how is the s3 and that's all everybody is be able to see that HTML file or see it okay so let me go ahead and deploy a saga so let me go ahead and deploy in a window server and it's a it will be a T 2 dot micro so this we can use for a later demos as bed and let's go ahead and deploy tutorial bit over here I'll use the second one later for showing you the other hand and let me go ahead and launch it so don't worry how you can connect a normal process of clicking on launch and clicking on next next to davonne define all your settings now what happens is once your server is defined over here once you have an AWS server over here just select the IP address of that server go to a terminal and then go ahead and connect to your server so just type in the command SSH - I and I basically means the key pair that is related to your server so this is just like having a password on your server but in this case what you do but it is a key pair which is like telling the server this is the authentication for me and please authenticate me in this so ok once you've authenticated into your server let's go ahead and create a web server of it so let me update the machine and once the machine is the beaded let me go ahead and install our web server on it so that server is now getting installed now what I'll do is I'll basically go ahead and let me put the index dot HTML on the server right so let me first move in head start on hey copy this file the index.html file on to the server that we are trying to connect okay so file has been copied I have the index.html file over here and this basically has the code which I wrote on my system this is the sample website code now let me go ahead and put it in or post it on my web server so what I'm gonna do is let me copy this file and stay within this location which is basically the location for my bed server okay so I've done it let me verify appetising copied so yes this is the HTML page and now what I do is I go back to my so enter this IP address and now you can see the same web page that I created with an image which is actually not stored on the server but is actually being served from s3 that the file that I uploaded right and I can change this you know image anytime I want I'll simply just have to go to AWS I'll have to go to s3 and let's say tomorrow I want to you know go ahead and change the background of my website right but I don't want to go ahead and you know change the code so what I can do is I can upload one more file over here so let's say we go ahead and choose a background let's say this is the background you know that I want to go ahead and put on my website so I just go ahead and save this image on the desktop and then I'll upload it on my SD bucket so let me search for the file this is the file let me upload it file has been uploaded right now let's go ahead and make it public so file has been made public now let's get the link of this file in this case I'm going to copy this link in the HTML but what you can also do is just change the name of the file in the bucket to what it was originally like for example if this is the the image name if I change its name to file get a poor diagram dot PNG right it will basically start to reflect on this website as well so what I'm gonna do is I just copy the link for the beg cells file let me open it to the browser and see yes so this is the file now what I do is I will go ahead and change it in my server so what I do is I just go to the terminal again edit the HTML file and in this HTML file now I'll go ahead and change select so let me delete the link over here this is the new link let me save it and now if I go to my browser hit refresh over here you can see the new image is now available on the browser so why don't people actually upload it on this server that's because servers are not reliable it could be the server can go in down any time right and at the same time when you talk about production architecture there are actually a lot of servers which are deployed in the backend to meet the requirement of the traffic which is coming in and for the redundancy as well so that if one server goes down the other doesn't happen it does not have to go down now if tomorrow I want to change this background how will I change it I can only change this background when I be actually going ahead and changing it on each and every server of mine then only all the servers will actually show this background otherwise what I can also do is I can upload it at a central place and then my HTML file will have the link to that particular file which is can be actually hosted on any individual äj-- and then you know my site will be visible like this so if you guys visit this IP address right now I'm pretty sure you guys will also see this HTML file on your browser okay now this is how guys you can go ahead and use s3 with a website and this is how you can actually go ahead and host your files on s3 as well now s3 also gives you the option of static web site question now what do you exactly mean by that let's go ahead and understand so if I go to properties of this bucket which I have created in s3 I can click on static web site hosting and in static website hosting I can specify use this bucket to host a website let's select this option now it will ask me which is the index document and which is the error document so I can specify the index document as next or HTML the error document as error dot HTML and then I can click on save now I'll explain you what it does now once static website hosting has been enabled you can actually go ahead this is the link that it gives you alright so if I go to this link now you can see that index dot HTML is being served and after this the coolest thing is that I first specified any other thing which is not there on the bucket I will automatically get a custom web page ok so it could be anything so it will never give me a 4 0 4 it will always show me the any error page in case you know I am going to any gibberish link okay now this again behavior you can see on a lot of production websites that you use every day for example if I go to amazon.com azan bottle this is their index dot HTML right what you see over here is index dot HTML similarly if I am going to this link what you see over here is index dot HTML right now let me type in something gibberish in Amazon dot in and let's see what happens so I am typing something gibberish here hitting Enter and it's giving me we are sorry the webpage you are entered is not a function page on our site right so this is the custom error that yet they they're giving right for example if I go to my server's IP address and if I enter something gibberish here because I'm not specified anything it will give me a error page which looks like this right it's giving me a request URL with not found of this server not found page this is a default page of an apache software which has been installed on this machine and you can see it also giving me Raiders of the machine which probably I don't want to show to my customers so what companies do is they create their own error pages right and these are a peerage pages are basically static pages and then they host it on a web site like Amazon s3 right so this 4:04 page that you see is actually going to be the same for anything that you go out on for example let me enter some other random text hit enter it will again show me the same page which is basically the 4:04 page over here okay similarly on my website that I have deployed on s3 which is this if I go to any gibberish link I have to find a custom add a page which is always going to show me this alright so this is how you can also use s3 for static website hosting okay now this was about testing let me come back to my slides very quickly right so I've showed you it can be used to store data it can be used for hosting data and it can also be used to do static website hosting now let's talk about the pricing of this three how are you basically charged for I saying this is the most important part all right and this is what companies are actually using s3 these days now for all the tasks that I showed you right now right those tasks are frequently accessed asks now in X you can use s3 for data which is in frequently accessed as well you can use s3 to store data which probably you do not know when you might me but you are actually not going to use it every day right even use it for that kind of data and you can also use it for data that you probably never want to use but just for records you want to save it that kind of data also you can say one s3 now based on these workloads s3 gives you a different pricing now you can see it's basically for another frequent access tier now if you have uploaded data in the frequent access tier your data will basically cost you around point 0 to 5 dollars per GD right so if there's 1 GB of data that you've uploaded on history that 1 GB of data is going to cost you points 0 to 5 dollars in a year right and when should you use it you should use it when the data that you have uploaded you want it in the lowest response time possible for example all the images that you see on a website that are basically hosted on s3 right they have the lowest latency you know provided to them and that's why they basically are for following enough frequent access tier right which is the pricing for it and pricing is different for every region there but aprox ability it is same for the Mumbai region it is point zero to five dollars per GB when we talk about infrequent access there now infrequent access they can be used for files which do not require the lowest response time possible but can bear you know but I mean it requires latency of around or response time of around milliseconds so it could be 100 milliseconds or 200 milliseconds so where performance is not an issue and you still want to host file the nicely you can actually go ahead and use the infrequent access to you all right and the kind of pricing that you get for infrequent access here obviously less than frequent access there and it is point zero one nine dollars per GB right this is again good third type of storage tier that you get is the s3 glacial access here now in this basically you have files which can be you know retrieved it can take time from either one minute two up to 12 as is well this is the dreaded tree will file for this this kind of file right so if you have data which probably is not going to be accessed in any let's say in a year it might be accessed Y once or twice but you still want to be wanted to be saved somewhere safe you can actually upload it to s3 and s3 is going to then charge you only zero point zero zero five dollars per GB which is chillie very cheap right so if you have hundred GB of data right on s3 still it is going to charge you only 0.5 dollars 0.5 dollars bill you will get even if you have 100 GB of data on it right if you have thousand GB data on s3 under the s3 glacier excess tier then only you will get $5 as a charge but thousand GB is actually a lot of data values right so that is the kind of pricing that you get from aw so that other companies these days are using this infrastructure as well right now again there is one node access to your which you can again use from here in this access to at least had the option of retrieving the file from starting from one minute as well you can choose which time you want to retrieve your file and it charges you based on that but if let's say you're sure that the file that you are going to use in the future right that's fine it is okay if you would it can retrieve it within 12 hours as well so those kind of files are basically called as glacial deep archive files and the pricing is as low as point zero zero two dollars per GB okay so this is the kind of pricing that you get when you are using the s3 service in AWS now let's move on and talk about the second kind of service which I discussed my lab was starting with a double storage services which is basically called the hard drive storage service right which is nothing but Amazon EBS so amazon EBS is a hydride source that you can rent on AWS and this hard drive you can attach to multiple servers that you've launched on AWS for example I just launched a web server on EWS so underlying that web server that obviously will be a hard drive right now I can control how many hard drives I can connect to my server what sized all hard drives have to be all that I can control and let me show you how to do it on the AWS management console so this is my AWS management console let me go to the easy to console so these are my two servers the first server is I'm going to let the other one be you're going to do okay now what I'm going to do is let me show you so obviously there are two servers here there should be two hard drives which should be running so if you scroll down from the left hand side you can actually go to the elastic block store category and inside that you can go to volumes okay so there are two volumes which are running right now which are any use right these volumes are of 8gb each right and they are connected to my servers that have - launched and these are the two servers that it has been connected to okay so let me see with so that is practical for example the first EBS is connected to open to server so let me name it as Ubuntu and the second one is connected to my boon due to system so these are the hard drives that are there right now now I can go ahead and create one more hard drive I can specify any size that I want let's say we go ahead and specify 500 GB right so 500 GB hard drive will be educated if I can give thousand or so thousand GB hard drive will be allocated so this is the maximum size that I can specify for a hard life that is around 16 TB so I tell you a 16 TB size of a hard drive and then attach it to my easy - now the fun fact here is that I make I can attach multiple 16 TB hard rails as well to my easy do so for this demo what I do is I will create a 50 GB hard drive alright and let me go ahead and create it now one more thing that you have to make sure is that the chapel region you have deployed your easy to end your EPS or your hard drive should also be in that particular region okay so when this go ahead and click on create volume and the volume will now be so here it is the let's call it as a custom hard drive that we have created and now let's go ahead and attach this volume okay so it says that in one II there is no server running so let me quickly check it so if we okay so it's in 1b so if our hard drive should be in 1b only then we will be able to connect to a server so if you have created a hard drive which you don't need you can go to just select that hard drive go to actions click on delete volume and your hard drive will then be believed in this refresh and be deleted let's go ahead and create the volume once more so let's give it the size of 50 GB and we have to deploy it in 1b let's click on create volume and now within seconds you will have a new volume which you can use and now you can see the state it is available so you can go ahead and attach it so let's go ahead and attach it to I wouldn't do instance right and this is the path for the hard drive so let's go ahead and click on attach so when you click on attach now that hot day that you're creating is getting attached to your server and it is now attached you can basically call this as custom right now if I go to my server which is over here right I can see that hard drive attached by typing in a simple command LS BLK and here you can see there is a 50 GB hard drive and it is basically on this path right this is the hard drive that we have just connected if I go ahead and detach it I've just detach the hard drive from the system right so it will take some seconds to detach itself so it will detach down as you can see the state is available and if I pass in the same command now you can see that hard drive is gone right so let's attach it once more and see how we can use it with our server so I just attach the volume to the Ubuntu server click on attach it will take some time to attach it attached now let me again pass that command so the hard disk has been again attached now what we'll have to do is you will have to format there's hard disk before you can use it now how can you format this hard disk there is a command for that that you have to pass in so that command let me quickly open the commands that you can use right so this is the command that you have to pass in order to format a hard drive in the ext4 format okay now pay attention to this path over here this part X PDF should match the path which is mentioned in front of your hotness otherwise you might format some other hard leads me to the dashed your system okay so this particular command is going to format this hard disk in the format EHT for let's go ahead and hit enter so now the file has been the hard disk has been formatted and you can verify that by typing in less BLK and then mounting it on a folder so let's create a folder let's call it custom right and let's mount our drive to this folder so what I'll do is I just type in sudo mount then specify the path of my drive so my path is slash dev slash X PDF right this is the path of the heart rate and I want to mount it on the this folder that is custom done and now all I have to do is go inside the custom folder and now what I can do is I can store any file over here let me go ahead and store one dot txt [Music] one more file let's call it - dot txt let's create one more file let's call it three dot txt all right so now all these files you can see over here right let's go ahead and edit this file also let's add some text to 1.2 HD hello from the butoh in the 50g me bonding so this all is being now saved on the second hard drive that I have connected to my ec2 machine okay so let's verify if the text has actually been saved yes so this text has been save in one dot txt file now now what I can do is I can just come out of this folder now let's move unmount the hard drive that we have created right so I have unmounted and as you can see in this folder I don't have any files now why don't I have any files because I have unmounted the drive from this particular folder if I mount it on some other tray let me create one more folder so let me come out let me create a folder called test if I mount my hard drive which I created in this folder which is test I will again be able to see in the test directory all the files that I created right now let's do the same thing by attaching it to another easy to instance and see in another server are we able to see the files that we have created over here okay so I'll just go out and I'll unmount my hard drive first this is very important otherwise the data might crash okay so it's been unmounted now I can safely my browser and it does the wardroom from my ec2 instance so this was being detached from Google to one server as you can see it has been detached right and now let me attach it to machine and first let's go ahead and connect to one CooCoo machine as well so this is the one to do machine let me connect to it from the terminal so let me quickly enter the command and the IP address and now I'm connected to the server so this is a different server as you can see the IP here is 172 31 9 185 and the IPR is 172 31 15 18 right so this is a different server that I've just connected to and as you can see right now it just has its root of all you Maneka tool which is 8 GB now what I'm gonna do is I'm gonna connect the custom hard drive that we created which is this to my second machine so let me click on attach volume let me select the second machine click on attach it will take a matter of seconds to attach it to an X machine it has been attached and now if I type in LS BLK I can see the 50 GB hard drive is now here now I don't have to format it because it was already formatted so what I can do is I just create a folder you let's call that folder let's see as to write and let me mount the hard drive which is again on the same path right now XV DF space - they will go to folder it's been mounted and now if I go inside this folder again you can see all the files that are created on the other server on this server as well right and if I see the content inside one dot exe file I can see the same content I can see in this server - right so this is how guys you can use the harddrive service in EWS to actually attach dicta - d attach multiple times among multiple servers that you have in your ear abuse management console but there is one downside to it this EBS modem can only be connected to one instance at a time now there are various versions of this hundreds this service which has been deployed for example there is one more variant of EBS which is basically call it might be attached EBS which can be attached to multiple each two instances at a time as well but that is for a later session but probably now you understand the hard drive part of how AWS manages its hard drives and how you can use it to attach to servers that you have actually launched on EWS now the third kind of service that you have in AWS with respect to storage is called a network storage which is basically elastic file system now elastic file system when you compare it with EBS it's again hard drive but this hard drive can actually be used to connect to multiple servers at the same time right so it is usually used for applications which require to write files which are basically shared between multiple systems okay so let me go ahead and show you how you can basically deploy this particular service which is the EFS service so just go to your management console in the search bar over here just type in EFS you will get the service click over there and here you can now pour it and create a file system so let's click on create a file system right and it is very important to basically deploy this EFS in the same region as the region various servers exist right so and it has also has to be inside the same network that you are easy to is in so right now we are using the default setting so we don't have to change anything just click on next step so it will ask you about some settings that you just click on next step click on create we have to install this particular command on our terminal on both the machines right where we want to connect EFS drive to alright so the software is being installed and once that is done it is basically asking us to create a directory so let's go ahead and create that directory you all right so on both machines now I have to create a directory called EFS now this can be any directory you can give it the name as anything right but I am just following what documentation says so here also okay let me come out of this folder here also I'm going to create a folder called EFS so I have one folder here which has EFS and I have one folder here which is also called EFS okay on both the servers now I have to run this command which is given to me by AWS and I have to pass this command on this server on both the server's actually where I have the EFS folder right so as you can see this EFS name whyever kept the same because i also have a photo per DFS if let's say you create a custom folder which you have named differently this name will change over here in the command ok similarly on this server as well let me pass in the command and now that's it my EFS has been mounted on these folders and now what I can do is I can just go to these folders and I can create a file over here so let's say I create a file core one dot HTML okay I create a file called one dot HTML on this server in the EFS folder if I go to this folder and if I go inside the FS forever do an LS you can see I have a one dot HTML file here as well right let me edit the file from this server so let me edit one dot HTML right and let me say it's HelloWorld on this particular server which is one seven two three nine three one nine one eighty five if I go to the other server which is one seven two three 11580 and if I you know see the content of one dot HTML you can see that it says hello world over here if I create a file over here which is over one right I can see this fire on the other server result which is so one okay this is a shared file system which you have created on two different servers but all both these servers are basically XP are able to access the common files which are there and are able to change those files as well right and accordingly your servers are also able to use it now this is like I said it is very useful for workloads bits required to work on the same concurrent file right and for that what you do is you create a shared file system which can actually be mounted on multiple easy to machine the multiple servers that you have deployed on EWS right so guys this was all about the network file system in AWS right finally the final you know service that you have in an area base with this with regards to storage is called the high performance storage in AWS now what is it basically about so let's say you have databases right you have some databases on your local system so those databases obviously will be slow because given the processor that you have given the hard drive space that you have given the other applications that are running on your system your database will be comparatively slow then a server which you can deploy on cloud which you can you know give a specific aramet to which you can give any kind of processor - right so when you talk about high performance storage on AWS it basically can be categorized into three parts the first part is relational databases so let's say you need a MySQL server on AWS you can use the RDS service which is available in AWS to deploy a relational database service then you have something called as no sequel databases you can also deploy that on AWS by using a service which is something called as dynamo DB and finally you have again you know file systems which are high performant file systems which are related to big data and machine learning workloads which are which is basically called fsx now fsx is a file system so you would have seen that earlier we use use HDD right hard disk drives and now we use solid state state drives so solid state drives are basically more faster than HDD when it comes to right to speed and the read speed similarly fsx is faster than SSD as well and the cool thing about fsx is it can also be mounted among multiple servers right but EFS is limited so the same thing can be done with EFS as well but with EFS you have it limited IO speed right but with a physics you can actually get very high i/o speeds which are ideal for big data and machine learning scenarios right so there are two kind of f6 services one is the FS x windows which is a shared file storage for windows systems high performance where shared file storage and then is there is something called as FS x lustre which is basically for linux systems right and can be used among Linux systems when you talk about EFS it is platform independent you can also install it on Linux you can also mount it on Windows and will work exactly the same for all the operating systems but with fsx this is one limitation although the input/output rate is very high but it is limited to the operating system that it is running on and that's why you have two different services which is em physics luster and fsx Windows for the different operating systems that might be there in your walk to work so with respect to storage guys I think we are done now let's talk about so this was a very small part of AWS this was a very brief introduction to what AWS is capable of if you start talking about the other services in AWS and then use them in conjunction with the sources that you have learned today you can do a lot of things in AWS you can make a production-ready application at the available of your fingertips on this alienness mahajan console that's how powerful it is every kind of services is there right so it's just a matter of time that you get to learn about them and then start using them now when we talk about learning all these things so there are hundred plus services in AWS which one you should study which one is good for job which one is good for your workload that you want to deploy you can actually go ahead and study from a lot of content which is available on these two platforms that is the intellibid blog platform and the YouTube platform that we have that you basically guys are studying on correctly right and apart for that we also happen to have a course on AWS which again deals with all the different kind of services which are there in AWS it not only prepares you for the certification all right so let me show you the website so if you happen to visit in Gallup on Comm what you can do is on intelecom you can just search for a course called either the West now we don't only teach AWS we actually teach a lot of other consumers when we can browse all the courses that we teach from our homepage right if you want to study a specific course like AWS is click on the search bar type in AWS hit enter and it'll show you all the AWS courses that we offer okay now we often a master's course as well which is basically a combination of multiple AWS certifications and we offer single up courses as well that is let's say you just want to go ahead and crack the AWS Solutions Architect certifications we can go ahead to just crack that as well or if you want to crack both notifications you can go ahead and see our AWS certification master's course as well so let me show you the solution the architect certification web page right so this is our web page guys and what we have these are the key features that we offer right so you can just go through them our course content and mention on the website so you can see what all things you gonna actually in the course and the blended those guys we not only give you instructor-led courses which are basically taught by DL industry experts like me but it will actually be you know a combination of self-paced courses as well where when there will be some topics which are good to know right which we actually cover in the self-paced section of ours right so you can go to them as well and understand what all things you should know okay so why should we actually learn with Intel apart because we not only you know teach you from industry experts which are basically not only working as solutions architects in the industry but at the same time they're also very well renowned in the industry and they will be able to train you and guide you how you can make a career shift if you're not on right now on the plough to me right but other than that we also offer you 24/7 support so let's say you know after the class you get some doubts you your classes next week now and now you want actually want to go ahead and ask you instructor something or you want to clear a technical committee which you basically go to the class so you can actually go ahead and act always you know a mailer support team and they will be you know available 24/7 they will be able to help you out and all the technical queries that you have all right and there are a lot of other features as well that we offer you know you can just go to our website and you can go through that now one common question that you guys will have is you know I don't know Linux so I I worked on Linux right now for all the hands-on that I showed and you might be wondering it well I don't know let it so is this course actually helpful for me so we also give a free Linux course with this training so that's skill gap of yours that you don't know Linux you can actually fill that by going through the free Linux course that we offer okay so with that guys I think that is all that I have to tell you so apart from that okay there is one more cool thing that you can actually go ahead and visit just go ahead and visit in developer.com slash academy right now this is our academy page what we have done is we have offered some free courses over here that you can actually go ahead and enroll yourself into right and you can watch some part of all our courses for free for example we have the AWS course also over here you can go in see our AWS course you know and understand what the quality is that only if you feel the quality is good you can go ahead in and go right so this is going to be you know through and through study of major concepts but limited concepts that we have taught and have made available to you guys for free so you can just go ahead on in telecom slash Academy and you can go ahead and see the quality that you guys teach it is a very transparent process well then if you are convinced you can actually call us on these numbers that are available on the screen all right and we would be getting in touch with you you know regards to your career query right so when that dies you can also mail us actually that they you can tell apart calm and I think that is up from my side also that is very quick you know info to you so all the people who are watching out in the code youtube' well you are checking out a course right so you can just go ahead and wheel up to thirty percent discount on the course price that we have and go ahead and go for the training this is also something which is made available to you and with that guys I'll take a leaf from you all so you can call us on the displayed numbers which are there on the screen and leave it on for five or you can also email us on the email with mention on the screen and that should also get you so with that is I will take a leave from you are thank you for joining in today have a great day ahead and goodbye

Channel: Intellipaat

Views: 4,074

Keywords: How to Use and Store Data on the Cloud, how to store data on cloud, Store Data on Cloud, Store Data on aws Cloud, aws cloud storage, Cloud Storage, AWS Certification, Cloud Storage On AWS, Cloud Storage Myths, Cloud Storage best Practices, aws cloud storage tutorial, aws cloud storage services, cloud storage explained, Cloud Security model, what is cloud storage, Cloud storage gateway, aws intellipaat, aws training and certification, intellipaat

Id: 07YgaOfd1xA

Length: 76min 26sec (4586 seconds)

Published: Tue May 12 2020