Age of the AI agents: GPT-4o, Project Astra and an exclusive with Sundar Pichai

AI has moved into a new era from chatbots to something out of the movie Her good morning Theodore good morning you have a meeting in 5 minutes you want to try getting out of bed Google and open AI both debuting AI assistants that can emote whoops I got too excited reason that image of a skull reminds me of Hamlet make jokes a lullaby about Majestic potatoes now that's what I call a mashup translate the objects you're showing are man and in Spanish even remember where you left your glasses do you remember where you saw my glasses yes I do your glasses were on the desk near a red apple I'm dear daosa and this week on Tech check the rise of the AI agents a new race kicked off in geni this week between open Ai and Google AI agents capable of having instantaneous real-time conversation a huge step forward from the AI that we've seen over the last 18 months and an even bigger leap from the series Alexa's hey Googles that we're used to which are slow stunted unbearable to actually talk to no no no you're not listening I said Wolf's Glenn restaurant in Westwood a Wolf's Den is a habitat that provides wolves with protection from stupid fing idiot it started with open AI a demo of its GPT 40 AI assistant helping with math problems perfect now what do you get when you subtract one from both sides coding this code fetches daily weather data for a specific location and time period and storytelling once upon a time in a world not too different from ours there was a robot named bite Altman confirming what many were thinking in a social media post after the event by simply posting her referencing a sci-fi movie from 2013 in which a man falls in love with AI that acts and sounds remarkably humanlike the next day Google answered back showing off its project Astra with similar capabilities what neighborhood do you think I'm in this appears to be the king's cross area of London it's a major departure from the chat Bots that are designed for simple interactions AI agents use sophisticated machine learning algorithms and natural language processing to understand context learn from interactions and perform more complex tasks yes I spotted one just now it's heading you way on the left side of the road get ready to wave it down they can adapt to new situations autonomously I spoke to Google CEO Sun Pai exclusively after the demo here's how he described it I think you started seeing examples today across our keynote of what we we think of as agentic capabilities project Astra itself is one right to be able to process the real world in front of you and constantly Pro process it and answer it intelligently you're not typing into a text box waiting for a response and then reading the output you're actually interacting with the AI through voice just as you would a human so speed is a huge Factor the model is real time responsiveness so that means that you don't have this awkward 2 to 3 second lag before you wait for the model to give a response open AI notes that the new GPT 40 can respond to audio inputs in an average of 320 milliseconds that's similar to human response time you can also now interrupt the model as it's speaking another facet of real life conversations that wasn't the case with chat Bots 1 2 3 hey actually that's um that's a little slow could you count faster Sure Thing 1 2 3 4 5 6 7 8 9 10 and open AI says its model can also now detect emotion breathing in and breathe out that's it how do you feel I feel a lot better plus the model itself can be as emotional as you ask it to be let's amplify the drama once upon a time in a world not too different from ours of course there are caveats Google's Showcase of project Astra during its IO keynote was pre-recorded and it was only 2 minutes long open AI demonstration was live and we counted at least 10 minutes of the open AI team interacting with the model not including more videos posted online after open ai's demo while live it also had its share of glitches though when the AI seemed to cut itself off or lose its place can you give me feedback on my breaths okay here I go whoa slow a bit there mark you're not a vacuum cleaner breathe in or account of four but while the AI agents aren't perfect neither were chat Bots chat TPT or Gemini when they were released they still aren't but they've led to a wave of technological advancements and Innovation that is only getting started Sun Pai telling me that he expects a wide roll out of Astra sometime in the next year it will be quality driven just like with Google Lens uh we are going to test it out give it to more people but then roll it out widely that's what we did with search and so we we know how to do it and scale it up meanwhile open ai's gbt 40 it's already available to many paying subscribers slowly rolling out for free in coming weeks and the voice feature it's set to be available for free later this summer what we're seeing from the models now clearly just a glimpse of what is to come we are working at The Cutting Edge technology and bringing it as fast to our products as [Music] possible the problem with comparing AI agents to the movie Her you're kind of nosy am I you'll get used to it is that it doesn't take into account how that movie ends as Wired Magazine points out it's not until the AI leaves that the protagonist confronts his own messy Human Relationships simple acts of Being Human are deferred because of an enabling AI as users interact with these agents or assistants in a more vulnerable way are they more at risk to be manipulated or weaponized by AI from a privacy standpoint as well AI agents open up a ton of questions like will they know too much about us do we want them seeing and hearing everything around us take that Google demo of Astra with the AI recording everything around you even remembering where you left your glasses imagine what a hacker could do with that data especially if you're recording in a corporate office setting another recent Trend in AI the Embrace of a move fast and break things mentality not long ago generative AI was thought to be too risky too consequential to deploy too quickly it's why open AI was establish lished as a nonprofit Ilia seter was an open AI co-founder who was known for sounding the alarm on AI safety and pushing back against Sam alman's drive to develop it quickly for every positive application of AGI there will be a negative application as well one of my motivations in creating open AI was in addition to developing this technology was also to address the questions that are posed by AGI the difficult questions the concerns that we raised except now set cover has left open AI after heading up the team that was responsible for steering and controlling AI systems much smarter than us his departure coming just months after he tried to OU Sam Alman reportedly over concerns that Alman was moving too fast and being Reckless even Google which has promised to balance boldness and responsibility in its development of geni it's moving faster so we leave you this week with our full conversation with Google CEO sener Pai as the Gen AI arms race moves into a new [Music] phase suar thank you so much for making the time after that fantastic keynote so great to be here thank you so this is pretty much the biggest overhaul of search that we've seen in what two decades this new experience will be available to over a billion users by the end of the year why did you wait until now you know in some ways we've been evolving it continuously the good thing about search is people come from use it they take it for granted we've been answering questions for a while but with generative AI we can do it a lot better we've been testing it for a while and we now feel it's the right moment to roll it out broadly and feedback has been good right from the users user engagement has been positive uh the feedback has been great I think it makes the product much better and so it's a great Direction what about advertisers cuz this will change the business model in some cases you're going to get links from a traditional search in some cases you're going to get a generative AI answer which would move those links lower down on the page are they ready for this moment what are you telling them about their ability to reach your users you know the great thing is users still value commercial information our ads work based on intent and quality and relevant at the right time we've been able to test that in the context of AI overviews and it's working well as we expected it to so I think it'll be a you know smooth transition and that's what we are seeing I I think I heard Liz Reed say that it's leading to more searches but the generative AI or AI overview as you're calling it is it leading to more or less Clicks in in general we find you know it it's both overall increasing usage and when we look at it year on year we've been able to grow traffic to the ecosystem so we are compared to most other players we are prioritizing you know approaches which will uh generate traffic as well so we are working hard on that does does it change the business model how are you thinking about that you know I think about a year ago people had questions on whether this would cost too much to serve you know we' brought down cost 80% I don't think that would be a concern uh I think the way we've been at work and the way we are rolling it out you know I feel like we are set up in a pretty good way and we can build on from here right let's talk about costs you brought it up semi analysis estimates that a single chat with a chat gbt could cost up to a thousand times as much as a simple search as you said you've brought that cost down but bringing out AI overviews to everyone in America to over a billion users by the end of the year that has to raise the cost on your side you know it's still you know maybe more expensive than a traditional query but not by much you know we you know just in the last year we've made our models maybe overall about 80 times more efficient and so you this is what Google was set up for you know for 25 years we've built our own infrastructure from the ground up and you know it's an area I feel super comfortable that we can actually do it well is that because you're using your own in-house custom tpus or do you still use gpus for the AI overviews the search searches I mean we are we are a close partner of nvidias and we definitely use both gpus as well as our own in-house uh Hardware but it's more about it's the ENT end to end what we called as AI hypercom computer how we put it all together and run it uh super efficiently right so not material costs that go up from this form of searching that that's right um critics you know have said for some time that search has become more cluttered over the years with AI overviews you're kind of adding more onto that and competitors like perplexity to name one have sprung up that have rethought the entire user interface the whole entire user experience to a lot of fanfare why not use this moment to completely overhaul the search experience instead of adding new layers on top oh in in some ways that's what we are doing you know when you say AI overviews we're kind of organizing it for you it has links in it so it's not like something that just goes on top alone uh you know today we showed good examples where it almost organizes the page for you and so I actually viewed as we are simplifying The Experience over time May our feedback has been very posi posi as we test it people actually find the experience getting better so you know I think I think it's an exciting Direction with simplifying it the most be just putting it straight to Gemini I mean especially as users get used to other chat Bots and going directly to them why not just kind of go all in with the Gemini which was such a huge focus of the Keen out in the last year you know what what search do is unique in the sense that it takes the intelligence of Gemini and we ground it with what search knows about the world you know what people really value is accurate trustworthy information and I think that's part of part of even in this moment I think people find Google search very valuable and they also care about what's out there on the web so sometimes they're looking for a quick answer sometimes they actually want to go out and learn more so getting that balance right is also what searched us well I think and now you're letting technology make that judgment whether to get links directly other websites or give a generative AI answer how are you explaining that again to like your advertisers and Merchants you know that I mean they you know they see it in their data right you know there are advertisers who are part of this AI overviews uh as we rolling it out I think they'll see it in their performance every time we have this transitions people are a bit uncertain but I think we have done this from desktop to mobile you know when local and social content became much more available we integrated it seamlessly in search we're doing the same with AI and we've been doing it for a decade so I viewed we'll be able to build upon on I want to get to project Astra because that was certainly one of the most exciting parts of the Keynotes technology that we haven't really seen before we saw a little bit of it yesterday from open Ai and its new chat GPT 40 but it feels like broadly we're moving out of the era of chat Bots and into the era of an AI agent how do you make sure that Google wins that sort of next phase of generative AI that users are going to be increasingly using I think you started seeing examples today across our keynote of what we think of as agentic capabilities project Astra itself is one right to be able to process the real world in front of you and constantly Pro process it and answer it intelligently we are building you know you can go to Gemini and ask it to plan a trip in search we announce multi-step reasoning you can write a very very complex queries behind the scenes we are breaking it into multiple parts and composing that answer for you so these are all agentic directions very early days we're going to be able to do a lot more I think that's what makes this moment one of the most exciting I've seen in my life and the demo you know captured a lot of people's imaginations are those products those features available right now when are they available uh you know project Astra is something we are working to bring to Gemini uh you know but we'll do it sometime this year it will be quality driven just like with Google Lens uh we are going to test it out give it to more people but then roll it out while that's what we did with search and so we we know how to do it and scale it up is that fast enough when chat gbt shows a gemo or open AI shows a demo a day before IO and now those some of those features are being used right now can you guys move faster I don't think they've shipped their demo to their users yet too I don't think it's available in the product so I think all of us are you know we are working at The Cutting Edge technology and bringing it as fast to our products as possible uh I think I think it's good to be in that moment but you know we we have a clear sense of how how to approach it and we'll get it right you've said before that Google's competitive advantage in gen is the quality of your data not just the quantity of it there was a report that open AI trained GPT for on millions of hours of YouTube videos would you sue open aai for violating your terms like I think it's a question for them to answer uh uh you know I don't have anything to add we do have clear terms of service and and so you know I think normally in these things we engage with with with companies and make make sure they understand our terms of service and we'll sort it out are you doing anything to determine if they broke your terms uh we you know we we have processes to do that I'm not exactly familiar okay uh back to the Astro demo um the experience was better through glasses than through the phone I think that was you know obvious everyone could see what phone was that and what kind or what kind of glasses were those and what kind of leap and Hardware do we need to really integrate AI agents into our lives you know what we showcasing is we build Gemini to be multimodal because we see use cases like that project Astra shines when you have a form factor like classes so we working on prototypes but through Android you know we've always had plans to work on AR with multiple partners and so over time they'll bring products based on it as well um a lot of anticipation over how apple is going to integrate open AI or sorry generative AI into its phones what are you doing to make sure that you're in pull position in generative AI on the iPhone like you have been in search on the iPhone you throughout uh both you know we we've had a a great partnership with Apple for the years over the years we have focused on delivering great experiences for uh the Apple ecosystem it is something we take very seriously and I'm confident we we have many ways to make sure our products are accessible we see that today AI overviews have been a popular feature on iOS when we have tested and so we'll continue including Gemini will continue working to bring bring that there we lost spoke at I/O about two years ago do you expect to be in the same position at IO in 2025 look I I feel we at an inflection point things seem to be happening faster so by 2025 I think we'll make a lot of progress a year from now what do you hope to accomplish you know things like project Astra would be something you take for granted when you use Google and you know it'll be able to see the world around you a wide roll out of project Astra well by by this time but I yeah absolutely across the US and even more would you be at the same space as you are your same stage as you are in search rolling it out to over a billion users uh we obviously we'll be quality driven but that's the kind of aspiration we are working towards okay well suar thank you so much for taking the time thank you appreciate it e

Channel: CNBC Television

Views: 106,482

Keywords: app, business news, cnbc, digital, disrupt, funding, innovation, investors, nasdaq, nyse, online, silicon valley, startup, stock market, tech, techcheck, technology, venture, wall street

Id: G4-WBq3vnds

Length: 19min 7sec (1147 seconds)

Published: Fri May 17 2024