How to Install Hadoop in Windows 10 & 11 | Hadoop Installation Guide | Ivy Pro School

thank you hello everyone welcome back to Ivy's YouTube channel today I will show how to configure Hadoop in Windows operating system over here I am using Windows based virtual machine you can use your local Windows operating system as well before we configure Hadoop we need to check Java is installed or not to check it go to your command prompt and write Java then press enter to execute it if Java isn't installed you will see Java is not recognized as an internal or external command to install it Java now go to your web browser search Oracle Java download click on this link then scroll down and choose Java 8. then click on Windows then download since my operating system is 64-bit I am downloading this if your operating system is 32-bit then you can download from the other link click on here to accept the license agreement then click on download after that Oracle will ask you to login if you don't have any account then click on create account since I have already an account just provide the credentials and click on sign in then the download will be started before we start to install it fast go to your local disk drive C and create a folder name as Java now let's install Java double click on the downloaded file click next again click next over here change the path to Java the newly created folder under C drive then click next to install Java click on close to complete the installation process now go to program files folder then Java and cut the jdk folder then paste it in the Java folder and delete the Java folder under the program files now again go to command line prompt and write Java and run it it still shows Java is not found we need to configure the environment of java so it can be detected correctly go to search bar search environment variables then open it create a new user variable where user name is Java home all caps for the variable value go to the Java then jtk then bin folder copy the path of the folder and then paste it over here now click on the path of system variable then click on edit then create a new environment variable over here paste the same GDK bin path over here after that click on OK and here also to take effect all the changes now open a new command line prompt write Java now it's working you can check Java version as well now our Java installation is done now you have to install the Hadoop so for that again go back to your browser and search Apache Hadoop click on this link then click on download we are going to download one version older than the latest version since it is more stable click on binary then click on this link it will start downloading we also need WinRAR to unzip it first I am installing owendra once it's installed double click to download Hadoop file and extract it on the C drive and rename it as a Hadoop now open the Hadoop folder then click on Etc then right click on Hadoop EnV then click on edit over here change the Java jdk path again we have to create environment path for Hadoop go to search bar and open edit environment variables then click on environment variables in user variable create new user variable name as Hadoop home all caps and provide the Hadoop bin path in the variable value again in system variable edit path create a new environment path Hadoop bin and has been and press ok to save it now go to command prompt to check our system detect Hadoop or not just write Hadoop it will print the all commands for Hadoop let's check the Hadoop version from here and you can see that Hadoop 3.2.4 is running so our Hadoop is detected now we have to configure Hadoop to run it in our system first go to Hadoop folder then Etc then again Hadoop folder and right click on the core site XML file then edit it now in configuration you have add one property which should have name and value I'm just copy this in a notepad we need to write this many more time now in coresight XML write in the name as FS dot default FS FS will be capital then in the value section I give the localhost part hdfs localhost 9000. now press Ctrl s to save it and close it after that we need to edit hdfs site dot XML or httpsside.xml either one will work now again write a property with the name as a DFS dot replication where the value will be 1 and create two more properties we have to give the path of name node and data node now go back to your Hadoop folder create a folder named as data then inside the data folder created two more folder named as name node and data node respectively after that copy the path of name node then go back to your XML file give the property name as DFS dot name node.name dot directory and the value will be the path of a name node same as you have to do with this data node give the path of the data node and the name will be dfs.name node.name.dir now once it done save it and close it now again go back how to folder then is ETC then how to begin to edit map route site dot XML file and again copy paste that property in the name section just write mapreduce dot framework dot name and the value will be earn again save it and close it finally we need to edit yarn site XML file again copy paste the property over here whose name will be earn.nodemanager.ox Dash services and the value will be mapreduce suffer again we have to create another property whose name will be en.nodemanager.aux Services dot mapreduce dot Shuffle and the value will be organization org dot Apache dot hadoop.mapper dot Shuffle Handler finally save it and close it once it's done we have to fix the bin folder to run Hadoop in Windows first go to your Hadoop folder and then delete the bin folder after that download the bin folder with this link you can check the description box for this link after that extract that bin folder inside Hado folder now open the bin folder you will see win utils dot exe file run this file you will see an System error 1.dll file is missing now we need to install it again go back to your browser and search which dll files is missing over here msbcr 120 dll file is missing for me so I am just search it and download it since my system is 64-bit so I am downloading the 64-bit version if your system is 32-bit you can download the 32-bit version once it downloaded copy this dll file into your system32 folder to access that system 32 folder you have to go to your PC then your local disk then go to Windows and then scroll down you will find system32 folder inside this folder paste that dwl file now again run this queen utils.exe file and you see there will be no error pop-up once it's done we need to install C plus plus redistributable for visual studio for that again go back to your browser and search msvc-170 and click on this Microsoft official link and scroll down and download the 64-bit version if you are using 32-bit version please download that one once it's downloaded install it click on I agree then install finally we are done now go to your search bar Search Command Prompt and run it as a administrator first we need to format the name node just write hdfs space name node space Dash format once it's done you will see over here main node successfully formatted now we can launch Hadoop cluster first go back to root directory riding CD backslash then write CD Hadoop execute and then CD has been execute over here just write start Dash dfs.cmd to start name node and data node and you will see new node and data node is running it is in shutdown also you can check the running status from command prompt just write JPS now we need to start earn writing start and dash eon.cmd executed you can visually check Hadoop cluster is running or not just go to your browser and write localhost semicolon 9870 you will see the status of Hadoop cluster you can check the log and the files you have uploaded in hdfs over here 2C results manager just execute localhost semicolon 808 you will see the cluster size and number of nodes is running that's it for today's video I am just stopping all the nodes to writing stop Dash all dot CMD in the next video I will demonstrate how to upload a data in hdfs and run a mapreduce function on topic till then take care bye bye

Channel: IvyProSchool

Views: 107,243

Keywords: how to install hadoop on windows 10, hadoop installation on windows 10 step by step, hadoop installation on windows 10 2024, hadoop installation on windows, how to install hadoop on windows, installing hadoop on windows 10, hadoop installation, how to install hadoop, how to install hadoop on windows 11, How to configure hadoop in windows, Hadoop installation guide, How to install hadoop in windows os, Hadoop installation tutorial, Hadoop for windows 11, hadoop install tutorial

Id: knAS0w-jiUk

Length: 17min 34sec (1054 seconds)

Published: Tue Jan 10 2023