Apache Kafka® Installation On Windows & Mac | Confluent Kafka | Offset Explorer | JavaTechie

hi everyone welcome to Java tech key in this tutorial we'll understand how to set up Kafka in our local machine apart from Kafka we will also install all required tools which will help in our Kafka development course okay all right so without any further delay let's get started [Music] so before we install kapka let me tell you that we have different kind of Kafka server available in Market with different type of flavor like Apache kapka which is open source commercial distribution managed Kafka service so let me give you some heads up about above three cup flavor so that you can able to understand which Kafka service need to choose based on the situation or based on the scenario okay so the first one is open source version of Apache Kappa this you can easily download from Apache portal and then you can install and use it in case if you face any operational issue or open bargain Kafka then you need to manage it by your own or you might need to upgrade if needed so maximum Company still use this open source with proper infrastructure setup and also they have dedicated developers or experts to handle any kind of inference related issue so the second one is the commercial distribution that comes with a lot of tools and utility to perform your day-to-day Kafka operation this will add cost to your organization or to the project and confluent Kafka is one of the best commercial distribution to use which simplifies connecting data source to the Kafka building streaming application as well as securing monitoring and managing your Kafka infra so today if you will observe confluent platform is used for a wide array of use case across numerous Industries and confluent Kafka also provide a Community Edition for developers which is completely free don't worry I will show you how to use the community edition of confluent Kafka next is managed Kafka service this comes with everything you need you just create instance as per required configuration let everything managed by the Kafka provider all infrastructure will be ready for you and it really easy to scale when needed a similar as Cloud infra so Amazon msk and confluent are best managed Kafka service provider to use So based on the project requirement and budget availability you need to decide which Kafka service need to choose okay but as part of this course we will use the open source Apache Kafka but don't worry I will also demonstrate how to use the community edition of Kafka confluent okay so let's begin with the installation steps so I'll walk you through the steps to install Apache Kappa which is open source also will install the community edition of conference Kafka then at the end we'll install Kafka offset Explorer which will helps us to monitor our Kafka messaging system okay so let's begin with the first one that is installation of Apache Kappa so we are going to download the open source of Apache Kappa so for that go to the Chrome browser and then you can search here Kafka go to the official page of Apache Kafka then you can find the option to the download click on download Kafka so the latest version you can find your 3.4.0 okay so you can download any of them this is the binary distribution so let me click on the first one the file size is 102 MB so it will take few second to download so once the download will be completed go to that particular folder so you need to extract this particular folder you can see here the version we downloaded 3.4.0 now go inside this particular folder you can find bin config leaves license and side docs okay so inside the bin you will find all the cell script file for mac and all the batch file for Windows so if I will open this you can see here all the dot sh extension is being used for the Linux or Mac operating system and in the windows you can find the dot batch file to start the Zookeeper or to start the Kafka server or to start the topic or to create the topic all the things whatever we have discussed before you can play by executing this batch file or by executing the cell script file so once you will download the binary distribution you will find the support for both operating system this is for Windows and this cell script is for Mac or Linux okay and if you go inside the confi it contains the properties file okay so you can see here server.properties which holds the Kafka property specification and you can see here zookeeper.properties okay so these are the properties file you will understand once we will play with those properties file now if you go here insert the leaves there are couple of Jar that's it okay you just need to download this binary distribution then all set in upcoming session I will show you how you can play with the Kafka component by executing this script okay so let's move to the next one that Community Edition of confluent Kafka okay so to install the confluent Kafka what you can do you can go to the confluent dot IO then you can click on get started free and you want to install the software which is community edition of confluent Kafka we don't want any managed Kafka service so navigate the tab to the softwares next you can fill this form and then just acknowledge these two click on start free here we go so if You observe here there is a local install conference platform on a single local Machine by using G per tar archive or Docker images so we don't need this what do we need we need the Community Edition okay there is something called distributed confront for kubernetes and there are few more so we need to focus on this community which is completely free so you can see here use it for free forever okay so we want to install the Jeep or we just want to download the Jeep just click on this download this is the size four double six MB okay so let's wait it to complete so once it downloaded just so in the folder and again you need to extract this you can see this right the latest version of Community Edition of confluent Kafka is 7.3.2 fine now go inside this particular folder you can find the same structure that is bin and you can find the file which is the cell script for mac and Linux and for Windows you can file this batch file okay and if you move further insert this Etc as I already mentioned once you are playing with the conference apart from Kafka you will find lot of utility when I say utility you will find Kafka rest K scale DV rest utils schema registry so we will understand about this particular utility in our upcoming session okay now if you go inside the Kafka you will find the properties file okay so whatever files you downloaded through the open source and confluent is file is similar only the structure is changed so let me compare this so that it will be easy for you to understand okay let me open the Kafka and meanwhile I'll open the another window for conflict okay now let me so this is the Kafka and this is the confluent Kafka folder now if we'll compare these two folder if you go inside bin you will find the script file and Windows File and again if you go inside this you will find the same okay now if you go back and if you'll check about the config you will find all the properties file but in confront Kafka since it supports for multiple utility methods inside the ETC you will find a folder called Kafka inside that Kafka you can find the properties okay and these are the utility fine this is the only structure changed you will find between these two Kafka and confront Kafka okay so as I mentioned I will just show you how you can play with both okay that is my next session I will just demonstrate using the command line interface how we can play with all the Kafka component in open source Apache Kappa and in confluent Kafka fine now the next we need to install the Kafka offset Explorer to monitor our Kafka messaging system so what you can do for that go to the Chrome and just search here Kafka offset Explorer the first link you can find something called Kafka tool okay so just open this link and then let me Zoom this for you you can see here right offset Explorer this is the cup cut tool is a GUI application for managing and using Apache Kafka cluster okay so just click on the download you will find the option to download for Windows and Mac so download Based on your operating system so since I am using the Mac I'll download this particular Mac OS so the size will be 60.2 MB so once it will be download you just need to double click to install it okay so let's wait it to complete so download it just so in the folder and you just need to double click on it okay so that it will be installed to your machine drag and drop I have already installed it so it is asking me whether you want to replace or you want to keep the both so I will just stop for now okay because already I installed it so I'll also remove for now fine so this is what about the installation steps in my coming tutorial I will show you how you can play with the Kafka component using the command line interface will create the consumer and producer we'll publish the event to the topic and will add the partition and will show the various type of behavior in this particular producer and consumer flow okay that's all about this particular video guys thanks for watching this video meet you soon with A New Concept

Channel: Java Techie

Views: 45,948

Keywords:

Id: Y83O0_7OKb4

Length: 12min 19sec (739 seconds)

Published: Fri Apr 07 2023