Data Scientist vs Data Engineer vs Data Analyst (funny!)

hey good morning luke oh what's up dad nerd luke you know i don't like when you call us that us what do you mean by us my dude our bro here has told me some great things about you you ain't my bro bro and who the heck are you oh me i'm the new data engineer to the team i'm stoked to meet you um we got a new data engineer on our team didn't you read the memo from our manager no i've been too busy i've been trying to fix the data that's going to management's power bi dashboard for yet another kpi that they want to add unlike you who's just been performing random testing all day luke i told you it's random forest classification and testing it's actually a very popular ensemble machine learning method that uses decisions yeah decision trees within a random forest how clever either way your testing failed well they didn't fail per se it just failed to reject the null hypothesis well whatever that p-value was that management was talking about they weren't happy um hey my dudes i'm uh i'm still here oh sorry so what are you doing in the closet better yet what do you say you do here i like that engineer things he builds data pipelines for us he's basically like a plumber of data science yeah totally if you think of data like water i basically build systems that pipe you clean quality water from a dirty source yeah and then we use the water to make things like lemonade metaphorically of course i've tasted what you've made before and it definitely wasn't lemonade so what do you use to build these data pipelines yeah typically i use some sort of workflow orchestration tool like airflow to manage etl processes with both python and sql all within a continuous integration and continuous deployment framework on the cloud although i'm currently building a better version of airflow but what data engineer isn't so you're actually useful unlike this guy they can't even get machine learning models into production oh yeah i can also do that guys sorry to interrupt but i can't figure out what picture of my favorite youtuber to put up don't you think it's a bit creepy that you have framed pictures of people you don't know in real life i think they're both great but i'm partial to sentex okay hold up that engineer so you know more in demand skills than most data nerds and your job is currently in higher demand but looking on pay scale you make less than this guy yeah basically so um can you help me build a data pipeline um what's it on yeah we just need to overhaul how this current dashboard is getting data basically we need to scrape a bunch of job search data from the internet web scraping is my jam heck yeah guys i've decided i like both exactly equal so both of them were going up so you use python right yeah what's up so quick question to settle a debate tabs versus spaces in python everybody knows it doesn't matter i told you did we just become best friends yep so how long do you think to get this data pipeline six months minimum what the [Music] dead nerds luke here i want to give a special shout out and thanks everybody as we reach this milestone of one hundred thousand subscribers with that coursera has graciously sponsored a giveaway which i have more details in the description below so make sure that you check it out and with that thanks to coursera but also more importantly thanks everybody out there that continues to support the channel bro i told you before we're not hanging pictures of canon tina it's creepy out [Music] hey so um sorry what i said earlier that's really nice of you so um with how long that that engineer's going to take to build this pipeline do you think you could just help me build it

Channel: Luke Barousse

Views: 87,927

Keywords: data viz by luke, business intelligence, data science, bi, computer science, data nerd, data analyst, data scientist, how to, data project, data analytics, data engineer, analyst vs scientist vs engineer, scientist vs analyst vs engineer, engineer vs analyst vs scientist, data analyst vs data scientist, data analyst vs data engineer, data engineer vs data analyst, data engineer vs data scientist

Id: y3TxcejHw-4

Length: 4min 14sec (254 seconds)

Published: Mon Nov 22 2021