Gemini is Here - Is this the End of ChatGPT?

data nerds Google just released Gemini it's powered by its most advanced model Ultra 1.0 and I've been putting it through some tests so we're going to be going over everything you need to know for this and mainly does it even compete with Chad gpt's competitor model GPT 4 so getting into it Gemini pro has been behind its bar model since last December but that's only the middle tier model Ultra 1.0 is their new glorified Premier model and today they've rebranded their chatbot as confusingly enough Gemini and like all companies that are throwing around the term AI these days you have to pay extra to get access to this Advanced model of ultra through Gemini Advanced Google's killing me with these renamings so what can you do with this chatbot Bard I mean Gemini let's say you're a student trying to work smarter not harder to get into your top colleges well for your AP coding classes you don't even have to code anymore just throw in your questions and Bam once you're done have Gemini draft up an email to your teacher on how revolutionary your homework is since you have all this free time you can now plan your trip with the boys down to nand before you go off to college and speaking of colleges why even waste time selecting one anymore just to have Gemini do the SWAT analysis for you even more revolutionary it can even export these results as a table to Google Sheets okay so generating tables is sort of kids work these days when dealing with these large language models but I did run into quite a few limitations when actually testing Gemini out especially when compared right next to its competitors like Microsoft co-pilot you start to see that Google is trying to play catchup all these things that they're claiming Gemini can do Microsoft co-pilot can already do that right inside the apps right now Gemini isn't available inside of any Google apps you have to work through its chat interface just to try it out for a previous example with the student you could use it inside of Microsoft teams to attend all your classes and then summarize them with your notes goodbye classes and Gemini in the chat doesn't even support very basic things like uploading files other than images a very basic feature that this thing should have now I did find in testing that Google did have extensions where you could actually link Gemini to your Drive account and actually connect to different files but this was sort of limiting but we'll get to that in a second so how do you get this Gemini model that I keep on well they're integrating it through their Google one plans and not only giving you access to chatbot but also upgraded storage for 20 bucks you get their AI premium account which gives you access to Gemini advance and also Gemini and Gmail docs and more which is yet another Rebrand from duet AI to Gemini now I only have the Premium plan but Google decided to give those that have this plan access to Gemini advanced well at least until the summer then I got to upgrade speaking of rebrands this isn't abnormal of Google doing this all these tools here were rebrands over the years and have been quite successful so maybe Google knows what the science is behind renaming it with the Gemini Rebrand it looks like it's taking a page right out of Microsoft book it's just like they use co-pilot to rename all their different AI tools Google's doing the same as them so where do you access Gemini well the first place is your browser and this access is available to more than 150 countries including Canada which apparently didn't have access to this before Additionally you can access this on your phone for Android users there's a dedicated app called Gemini that you can go to and access this model for iPhone users they're being a little lazy they're including it as part of the Google app that you can toggle on I don't have access to it yet but apparently it's slowly getting rolled out and because this model is no longer limited just your computers or phones also Google devices it looks like they're going to be rebranding Google Assistant as Gemini hey Google are you renamed Gemini I'm more into astronomy one of my favorite constellations is Orion the hunter because I'm a Hunter of information so what's all the hype about with this Ultra 1.0 model well if we look at the top chatbot Arena leaderboard from hugging face we can see that GPT 4 currently tops the list with Gemini Pro following shortly behind however it's been claimed this Ultra model is performing way better than any of these other models Google released this fancy marketing campaign claiming it exceeds GPT 4's performance but there's a couple of problems Google's marketing nerds switched around some of the numbers for this they were looking at one of the most prominent benchmarks MML U which is designed to test across multiple domains and formats everything from basic geography to Advanced physics anyway for this fancy graph they compared The Chain of Thought reasoning of Gemini Ultra to five shot analysis of GPT 4 basically comparing two separate tests if we look at only the five shot analysis GPT 4 actually beats Gemini Ultra which conveniently they don't make in blue oh and this isn't the first time in this whole launch of Gemini that Google has tried to deceive us all right testing Gemini here we go tell me what you see I see you placing a piece of paper on the table I see a squiggly line it looks like a bird to me once again Google's marketing nerds turned fact into fiction by making it appear that it was possible to interact with Gemini in real time but Google's data nerds who are apparently good friends with the legal nerds actually provided the truth with this interaction by showing how they provided text prompts along with images to then get those responses that were then shown in the video anyway that demo and all the different benchmarks that Google's been providing along with open AI are all just hearsay let's actually jump into testing it out and seeing how it performs I took it through multiple tests including image analysis and coding all the way to things like data analysis and Google Sheets so let's start with the coding question I provided it an image of a database diagram that I want to run a query across I made it complex enough in nature that it would have to actually query across different tables very quickly it provided this results along with a short analysis of its thought process for it I copied the results and then trying them out it finds out that there's no such table as job post fact investigating it I find that it's job posting fact so it just got the table name wrong providing the error message it gave me basically a bunch of nonsense results and nothing I could do to solve so I had to provide it the diagram again and ask it hey is this the correct name of the table from there it upgrade the query to include the correct table name running it again I get a new table that it doesn't recognize which is skills so I had to go back to Gemini provide it the picture and ask it to correct it which it still didn't fix going back and forth again I finally got the answers that I wanted so this took like five generations for Gemini to get correct when I provided this exact same question question and image to chat gbt I got this query result and we got it right in the first try so it's not looking too good for Gemini the next test I wanted to do was analyze something like a spreadsheet now the way to access this is by using the extension at Google Drive and from there you can access any file inside your Google drive or at least so I thought so I have a this sheet inside of my Google Drive that I want Google to access I started by simply just asking what spreadsheets do I have and it said I only had one spreadsheet in my entire Drive which isn't correct and it linked me to a Google doc not a spreadsheet so I asked it to find the sheet and provided the name note I didn't use the extension operator here what it still did is search nonetheless anyway it said there's no spreadsheet titled this so at this point I was just getting annoyed and I went to the share options and got the link and then pasted it into there after this it would appears that it was able to read the sheet and provide a basic analysis of what it contained but other than that it wasn't really helpful I asked it to perform analysis and it came up with a game plan for doing this but then whenever I asked it to actually do it it says it cannot access the spefic specific contents of the spreadsheet due to privacy concerns but it was nice enough to show me step by step how I could potentially do any of these calculations with something like a pivot table so how this compared to Chad gbt similarly it says I can't directly access or download content from external links including Google Sheets and then just says Hey based in the CSV so that's what I did and it went through and provided a complete and really in-depth analysis looking all the different columns how to clean it up and even some key observations now I'm a little biased in this area because I got a course on chat GPT for data analytics which is free and you can access it via the link below and I we'll call out shout out to the people that have purchased the course notes and certificates for this course as they help directly fund making more content from this Channel and making it ad free all right next up is Gmail and I had it read through my inbox and find all the highlights and to my surprise out of all the different features I reviewed so far this one I was most surprised with I was even able to call out specific emails in my inbox and have it summarize it for me so I could get through it a lot quicker and then finally I had to look into one of my inboxes to see where I needed to reply rep to someone and have it draft a response which I can conveniently just draft in Gmail and send it right on over for Chad gbt it wasn't really surprised with this is it can't connect to your Gmail or any external services and it doesn't even look like there's any gpts to actually support doing this as well so finally Gemini gets a win all right let's get into some video analysis using the YouTube extension you can provide a URL of a video you want to look up so I'm prepping for this video I wanted to make sure I didn't miss anything a Gemini so I provided it other YouTube videos that were already out on this and for this it provided a pretty in-depth analysis of what's going on here although for some reason it confused the YouTuber with Bard and kept calling it Bard throughout this and apparently Bard concludes that Gemini Ultra 1.0 is a promising new language model that has the potential to compete with J gbt now it did provide a follow-up question asking if I wanted to know more about Gemini Ultra or Chachi BT and I said hey provide me more about Gemini Ultra and I could see it started to go off script and was not providing me actually relevant information from the YouTube video so you have to be very specific on where you want those results from if you're going to use YouTube you use that ad extension to make sure Gemini uses it or just specify from the video now to No Surprise Chad GPT can do this using a GPT I didn't even provide it a prompt all I did was it provided a link and it provided things like a takeaway and summary and fancy enough provided this diagram inside of this GPT which details the flow of the video itself so already we're seeing the power that Gemini needs to learn from this on building their extensions all right the final extension that I tested was Google Maps asking it to make an iten array for popular things to do in my neighborhood and at first it only listed locations and the times they were open so I prompted it further asking to provide an order of how I should visit this assuming that I was doing it this afternoon and it starts off in the morning providing an inary but it does provide all the different locations and then from there a plan to move from each one of these locations which conveniently it has all these different things in Google Maps now moving to chat gbt inside the core model it doesn't have access to things like Maps but I was curious how it would respond with the same prompt interesting enough it provided almost the exact same locations as G and I which I'll recommend and this time with the prompt it actually started in afternoon and it provided an hour by hour plan of how I can visit all these locations with surprisingly a distance between them when I double checked these results it was pretty damn accurate only3 mil off so it's was pretty blown away that this model was able to understand distances even though it doesn't have any access to a map all right so what are my final thoughts well you can't tell already from this review I'm going to be sticking with Chach gbt don't really feel like Gemini is really up to the task yet for a few main reasons one it's limited extension support or basically lack of gpts two it has problems connecting to files and can't even upload a file three it subpar at reading images and actually extracting insights from it and four custom instructions I can't provide Gemini a consistent set of instructions to provide responses to me I have to do this in every new chat but Gemini is faster and if you have a premium account already you have access to it so go for it all right as always if you got value out of this video smash that like button with that I'll see you in the next one

Channel: Luke Barousse

Views: 41,630

Keywords: data viz by luke, business intelligence, data science, bi, computer science, data nerd, data analyst, data scientist, how to, data project, data analytics, portfolio project, sql, excel, python, power bi, tableau, data engineer

Id: Tfqj7tZdfTM

Length: 10min 59sec (659 seconds)

Published: Fri Feb 09 2024