Elasticsearch, Logstash, Kibana (ELK) Beginner's Guide - How to run ELK

[Music] how's it going everybody today I'm gonna show you a beginner's guide on how to run elasticsearch log stash and Cabana also known as the ELQ stack today I'm gonna be running it on ubuntu 16.04 but you can use any operating system you want as long as as java 8 first thing you want to do is open up your internet browser and go to elastic passio slash downloads and here is gonna take you to the elastic download page we're gonna download elastic search Cubana and log stash since we are running it into a bun too I'm gonna download the tar file and I'm just gonna open it and then I'm just gonna extract it to a folder I called elastic [Music] I'm gonna go ahead and do it the same thing for cabana I have Linux 64-bit open it [Music] and extract it lastly we'll do the same thing for logstash downloaded thar open it and extract it okay now that the downloads are complete and it clear my desk top of it and open up a terminal now we're gonna go into where we have all three of our programs elasticsearch cabana and logstash like I said I created a folder called elastic now if I list out part folders you're gonna see right there - run elastic search go into the elastic search folder and type in dot slash bin slash elastic search [Music] now this is gonna start our cluster here we can see the name of our node it's gonna load in all the modules and it's gonna start elasticsearch now if you open up another terminal you can test the seed that elasticsearch is working by running a curl command curl - X get and we could ping our localhost at port 9200 and we should receive this statement you know for search you can also open up your web browser and go to localhost colon 9200 and you'll get the exact same thing now the next thing we want to do is start up qivana so go back to the elastic folder go into the Cabana folder and just like elastic search we're gonna do dot slash bin slash Cabana [Music] here we go we can see the status of our cluster it found it's listening on ports 5601 and it did find our cluster so to see that cabañas working we can go to localhost 5601 and this is what Cubana looks like now the last thing we want to do is run log stash open up a new tab on terminal and what we're gonna do is first of all we need a configuration file because we do need to send some files to log stash to be able to visualize it so let's just create a new file and this is gonna be our configuration file for log stash we will have one input and in our input we're gonna it's going to be a heartbeat we're gonna take it every ten seconds and it's going to be uptight partly our output will be standard out we're gonna give it a codec of Ruby debug and as well as standard out we're gonna output our data into our elastic search index so we're gonna type the elastic search the host as I mentioned before is located is located on localhost 9200 and we're gonna put it into a specific index called pulse we're gonna go ahead and save that into our log stash the folder we're gonna name this my config dot con click Save now to run log stash we're gonna go back go into the log stash folder now we're gonna do dot slash bin slash log stash we're gonna give it the minus F flag to run log stash with our configuration file that we just made so Mike and big comp and click enter [Music] as you can see it's starting logstash now and it's gonna read our configuration file to start accepting documents and here we go our standard output just found a document call and it's up type heartbeat and then every ten seconds it will find a new heartbeat now to visualize our data we're gonna go back to Kabana go over to management and click index patterns now in this screen Cabana is gonna look at all the indices available in our elastic search cluster and it did find our index that we labeled before called pulse so we're just going to go ahead and add that click next step and for the timestamp we're just gonna leave it to the default then click create index pattern as you can see on the left hand side logstash is going to be continuously running and taking in heartbeats every 10 seconds now if we click the discover tab you'll be able to see all the documents that it's ingesting if we open one up we can take a look closer look at the document here we see that it's a heartbeat and we are on the pulse index thank you for watching everyone this has been a quick beginner's guide on how to run the Elks tach to learn more please subscribe below and I'll be doing a lot more elastic videos thanks for watching [Music]

Channel: cleanCode

Views: 13,478

Keywords: elastic, elasticsearch, logstash, kibana, elk, data visualization, data management, pipeline, ingestion, searching, indexing, computer science, cs, tutorial, how to, guide

Id: QTVtbdLl4ac

Length: 7min 44sec (464 seconds)

Published: Sun May 13 2018