WWDC 2024: What to Expect from Apple’s Big Event

WWDC is always my favorite Apple event of the year because it's the one we know the least about supply chain rumors those are impossible to avoid right but software built inside of and only inside of Apple now that's something they've been pretty good at keeping on the DL this year is no different however there is a different Aura a different energy surrounding WWDC why well reputable leaker Mark German of Bloomberg and others have been told by sources that 2024 this year holds the biggest iOS update since the original iPhone launched 17 years ago now a bit of a frustration a rumor reporting industrywide has incredibly poor sourcing and often interjects what sources actually state with punditry and opinion most of which no offense is crappy thus in this video I will show you what has been reported word for word from the original source and then discuss with you what that might actually mean as should be well no surprise to anybody that's been paying attention AI is very much the theme of iOS 18 and Mac OS 15 but where is this AI going to run and what is it going to actually do multiple rumors have corroborated German's reporting of project gry matter an internal code name that while as creepy sounding as all get out is supposed to push helpful AI tools into not just core apps like Safari photos and notes but also the operating system as a whole features which we'll discuss shortly now project gry matter Integrations are largely said to run on device with relatively few requests going to the cloud and that just makes sense right Apple has been building amazing npus for years now and they have complete vertical control of not just the hardware but the kernel and the operating system too running on device also lessens the latency of requests that have to be you know normally sent to and from a server and it also reduces the operating costs of a bunch of servers for processing it is logical right now Gman says the following that's kind of strange quote both operating systems meaning Mac OS and iOS will include software that determines whether a task should be handled on the device or via the cloud this to me is uh obvious forthcoming features are not going to be like real AI where you can just ask it anything and it thinks to itself hm where should I send this query no no there are obviously going to be a set of parameters of things that can be done on device via the cloud and perhaps not at all I German statement could be somehow construed to make sense in a world where older devices might need to send data to the cloud since they don't have the processing hootspa of more Modern Hardware to run the request locally however that's not really Apple's Mo I find it more likely that Apple will just prevent certain features from working on older devices rather than default to the cloud okay let's discuss what some of these features will do amongst which quote transcribe voice memos retouch photos with AI and make searches faster and more reliable in the Spotlight feature they will also improve Safari web search and automatically suggest replies to emails and text messages okay this is a meaty chunky one so let's just take this item by item transcribing voice memos yeah true that's handy but speech to text is not generally considered Ai and apple already does that in other places on the system what I find to be more likely to arrive are AI summaries of voice memos and well these are awesome I've been using an app called cleft that I really like you just talk and it creates meeting minutes formatted in a document having that free and on device would be absolutely Stellar retouching photos yeah that one is a must T this is a great real world feature that's already been available on other smartphones for a few years now I certainly see apple playing catch up here by adding some stuff that's been added already previously by other manufacturers like object removal Etc however I would also really like them to implement Voice driven edit features being able to say crop in on my face or make this photo black and white white or make the balloon green instead of purple is something that seems feasible and would be a huge help to those less uh technically Savvy in the edit making search more quick and more reliable doesn't really need AI Spotlight itself just needs a total revamp from the ground up on iOS it is persistently slow and often fails to provide relevant results at all now some AI features that I would like to see in Spotlight for iOS are basically already built into Mac OS like show me PDFs created this month you can say that today on a Mac and it works Okay I lied Siri sucks on the Mac 2 it didn't used to apparently up until Big Sir you used to be able to do tons of things like find all the documents I opened on Wednesday or find the file that I called travel plans open a Pages document for my latest tech tutorial show my downloads folder show my tax files that I sent to this person it was crazy powerful that stuff started to break apparently in Big Sir and more and more and more of it broke until they just removed it entirely with because okay yeah that makes sense yeah I want that on my phone you see I don't really subscribe to the idea that Apple's going to have a chat bot or something like that and we'll talk more about that soon but if there was a place where the system was going to have you ask a question and you could get a result Google gemino style I think it probably would happen within Spotlight as for improvements to Safari web search well I think this will be something similar to how it currently shows inline Wikipedia results I don't think that this should be Tak to mean that you're going to stop Googling and start Apple aiing in browser as for Autos suggesting replies to emails and text messages this is a no-brainer and will likely be one of the most commonly used features I mean I don't even know if we can consider it a rumor since Apple literally published a couple of months ago a model called open Elm that does this very thing being able to Auto Select a reply when you're busy that actually uses context rather than the current can I call you later or taking a sentence that you finger blasted into an email message reply field and well just relying on the system to elaborate and format it that would be a huge quality of life Improvement now German also says the Siri personal assistant will get an upgrade as well with more natural sounding interactions based on Apple's own large language models this is a premise I'm very excited about but also cautiously skeptical of I mean think about it the whole appeal of devices like the AI pin and rabbit R1 is that you can talk to them like a person the problem that both of them have is that they rely on chat GPT and just don't have powerful enough intent engines to do anything beyond respond to basic queries in theory Apple has the ability to do that lowlevel stuff to make Siri actually useful to actually do real things via apis a real lamb the question is will they I'm going to venture that no they're not at least not yet and we're not at scale the main reason being that well this crap is hard and until third party apps can do the same system level stuff I think it'll still feel frustratingly limited no matter what Apple adds I mean providing apis to Dev seems like a reach before people get how this AI stuff is supposed to work and until Apple has not just an llm that's as good as chat GPT but also an intent engine that's better than Google's neither of which currently it seems that they have knowing Apple in their very Underdog position in data collection I mean it might never happen and look even though Siri sucks it can do stuff today like it can add reminders it can set alarms it can send messages Etc these are the same kinds of things we want to do in this new AI era just better and more easily and one of the biggest wow moments I had with the AI pin is that I could take forever to poorly communicate what I wanted to achieve and if it didn't understand what I meant which was actually pretty rare it would ask for clarification it also permitted me to use follow-up commands that's the problem with Siri today I mean if I could say Hey Siri will you set a calendar U thingy for uh Friday no uh wait next Friday um oh it's at 2m and sorry it's an appointment with Dr Smith uh remind me the night before and have that work have it actually perform that function rather than just time out 5 seconds into you mumbling or stuttering and if you could then follow up and just say oh and send an invite to Megan our relationship with Siri as an assistant would change substantially its context what it can do isn't that much better but the way it does it is so much of what feels limiting about Siri today is how carefully you have to speak to it and removing that barrier that would make huge perceived improvements even if the actual capabilities the lamb as it were doesn't grow that much and for whatever it's worth I think that this new Seri is going to bring with it substantially more local processing right now Siri goes out to the cloud for a lot of things most things the llm that apple is likely developing is well something like that a smaller on device model that won't Target you know chat GPT per se but will do most of the things that you want to do on a phone so it'll draft up a quick reply in response to your mom's errand request but likely not know how to dethatch your lawn but what about the times where you do want that kind of response you do need to know how to dethatch your lawn well Siri has fallen so far behind in enal knowledge that I don't even ask it anymore because I just know it will say here's what I found on the web for dethatching your lawn that's not helpful and I think that Apple knows Gemini is going to start kicking butt on Android so German has said that Google and apple had a few months ago almost sealed the deal for a chatbot style integration in iOS this should be actually pretty unsurprising if you've been paying attention to how stuff works in the background because Google pays Apple metric bolt loads of money to be the default web browser on iOS to to be the default chatbot doesn't seem like such a leap but things allegedly fell through the cracks and if everything is to be believed Apple has signed an agreement with open AI instead strategically I I just think this makes a lot of sense I mean open AI is generally ahead of Google in providing accurate results they're not telling you to put glue on your cheese pizza to get the cheese to stick to the crust and they also have the backing of Microsoft and aure which is one of the few infrastructures that can likely accommodate the 1.7 billion Apple devices that are expected to upgrade to the latest OS version within 30 days of release I mean for context open AI right now is only using 180 million so imagine almost 2 billion my prediction because of that is actually the following that chatbot functionality it's only going to exist within spoken Siri requests and disclosure from Siri of hey here's what I found on the web will quietly suggest to you that you maybe take the return can with a grain of salt but look that's not all rumors also suggest that a big part of this new effort is creating smart Recaps this is going to be the AI pitch that I think they focus the most on and frankly it's spectacular again one of the most compelling things at least in principle of the AI pin is the catch me up feature where rather than read you messages for btim and notifications for BM it just provides a short summary of the stuff that's actually important and if you want more detail well you can ask for in a follow-up question and it will provide that Apple already kind of started doing this AI style notification parsing with iOS 17 you might have noticed that when you have airpods in your ears and you receive a multimedia iMessage the phone will actually try to explain the context of the photo to you it's not great but it's better than nothing and that's with images so I think summarizing text will be awesome genuinely useful and quite a big deal now this feature is also supposed to extend into summaries of many uh system level functions so you'll be able to use it on web pages and news articles and more just say hey give me a summary of this and it will provide that um this seems obvious because a lot of AI apps are doing this server side um and they're doing it well already so if Apple could do this on Silicon which I think apple is almost certainly to do they're just going to kick but it's going to be efficient convenient and basically immediate oh and free now we've got to talk about some of the quirkier stuff related to Ai and that starts with generative emojis the idea that uh Emoji will be created on the Fly based on the context of the conversation you're having is actually hilarious and silly I love it potentially wonderful here's the thing though Emoji are controlled by the Unicode Consortium so it's not like it's going to be a literal emoji that you can just post on Twitter or send to random Android phones you'll probably have to if you'd like it to be displayed properly just have it as an image file and uh I don't think that's going to happen can I make a prediction I think that these AI emojis it's going to be exclusive to iMessage just like stickers and many of the other things that already exist in iOS remember RCS support is coming later this year but that doesn't mean that they have to support all of iMessage features inside of our Cs and custom emoji is just another Ploy I expect that will get people to come to iMessage in the first place if they're not already there and B once they've done that to keep purchasing new iPhones and encouraging their friends to download and use iMessage as well why don't we have iMessage for Android Apple music is also said to be gaining autogenerated playlist functionality based on your mood time of day and other parameters if you look at what Spotify has done with their DJ function and other services that already do something similar this is a must Implement on the one hand as fart who listens to albums all the way through I couldn't care less about this feature but stuff like this and Rewind at the end of the year are what keep the Spotify Cults so strong so healthy so it would be good to see an attempt to at least try to chip away at that sick of AI yet yeah well me too in truth there aren't a whole lot of other rumors that have leaked but that's not to say that there's not any German has said for many months now that home screen improvements will come to iOS namely that icons will be able to be placed anywhere on the home screen and that the icons themselves will be able to change their color yeah he says quote for instance you can make all of your Social icons blue or Finance related ones green what does this mean literally change the icon I mean lots of Brands get pnic about their branding so there would need to be an optout function and if there is one would any app developer do this I mean does it color the background behind the app or the logo or just color the whole whole thing with like a somewhat transparent color look it seems problematic I I mean we can go deeper like what about apps that don't have a distinct background color at all and they're just like you know art I guess well some old school Android launchers they would put the app icon inside of like a shape with a background color but that looked like crap and I don't think any Android Launcher is still doing that today so I suspect if this rumor is true at all it seems misconstrued or misunderstood it'll be something similar to the way test flight works on iOS if if you've never installed a test light beta before it it basically puts a little orange dot next to the app name I could see apple allowing the user to tag apps with a color because that's already part of an apple design tenant within Mac OS it's the way that you tag files inside of the finder uh as for being able to place the icons wherever they are desired to be this is obvious it's it's long overdue right and something that Android has done so much better from day one but can I make one other request Apple please for the love that is Holy just give iPad OS users the ability and the option to choose icon placement dependent on the orientation no matter how nicely you make it look in one orientation it looks like crap in the other so let me just customize both orientations please if it's supposed to rotate let me rotate it okay last couple of random rumors reminders are expected to show in Apple calendar now which is very nice it's one of the few reasons that I still pay for Fantastical the other a monthly view that doesn't suck please ditch the dots Apple like Johnny I is gone phone screens aren't 4 in anymore displaying text on an actual date in the monthly view will not kill you we want it we've wanted it for years last the iPad is expected to finally after 14 years receive a calculator app but not just that Apple notes will also integrate a math function similar to solver 3 and while not for everybody this is a great implementation for students and those that keep more technical notes within Apple notes thanks to apple pencil on iPad OS and that's it I would go on to speak of all the feature requests that I have for this year's releases but I told your father I'd have you home before midnight let me know in the comments down below if these rumors sound good to you if they sound bad or if there's something that you want that nobody has yet discussed but most importantly and as always stay snazzy see you next week

Channel: Snazzy Labs

Views: 141,646

Keywords: apple, wwdc, apple rumors, wwdc rumors, ios 18, macOS 15, project greymatter, AI advancements, Siri update, voice memos, photo retouching, safari enhancements, email replies, on-device AI, mark gurman, apple leaks, ios update, macOS update, apple event, apple software, tech news, tech rumors, iPhone, iPad, apple keynote, apple AI, iOS features, macOS features, WWDC 2024, iOS 18 rumors, apple innovations, AI tools, WWDC news, snazzy labs, snazzylabs

Id: IJV9WUNOGVo

Length: 17min 32sec (1052 seconds)

Published: Thu Jun 06 2024