Vision Pro Lets You Have Friends

speaking of floating there was a recent Vision Pro OS update did you guys see this OS Vision OS 1.1 uh big update to uh shared experiences which is a big deal I made a video a week after Vision Pro came out about the things that were missing from Vision Pro and my first and most I think significant thing missing from the Vision Pro experience which is has been in VR headsets forever is shared experiences meaning you and I both have a headset on we're in different places but we're looking at the same virtual thing at the same time very basic thing it seems like one of those things where I'm sure there are people who bought the Vision Pro went in and were like wait this doesn't have that like how it seems like such an obvious thing to start with it feels like they probably were planning on it they probably knew they were going to launch this right after the headset pretty long WWDC when they announced the Vision Pro one of the developer sessions said it was coming and showed how to implement it when it did ship so the update is most of the time uh when you're doing uh how do I how do I explain this you've seen the personas right it's like a in a little glass window you kind of look at the person and it's their face and their like shoulders and they're kind of floating in the glass window FaceTime right so there is now a button when you're you're in certain experiences to enable spatial personas and when you do that the glass GL Windows around the personas go away and the Persona is a little floating ghost person and it's surprising again all the things that were good about FaceTime are are now good about spatial FaceTime which is the person's audio sounds like it's coming from the place in the room where it is and when you look at people you're now all in a room together so I did this this first demo where I was on FaceTime with two other people and the person one was to my right and the person two was to my left and they looked at each other they looked like they were looking at each other and not at me and when one of them looked at me I was looking at her and when I looked at the other one they you know what I mean like it was it was spatially accurate yeah heights were also correctly represented so if we all stood up the headset can see how far from the ground we are I could see that I was the tallest one in the group because I was looking down at the other ghost I mean spatial Persona um yeah it it worked and you could you could sort of enable this in a couple different experiences there were several apps that they had beta versions of that would uh allow us to play with this so jig space which is the one we've all seen with the F Formula 1 car you can pull the engine off and you can look at the wheels and stuff like that jigspace had a demo where they supported the spatial spatial personas right off the bat I like ghosts let's keep calling it ghosts he support the ghosts and right away it was exactly the way Cleo and I described it in her video which was let me show you this yeah you see the object I move the object you see the way I moved it if I wanted to point the engine at you I would l literally take it and manipulate it in space and point it at you and you would see it pointed at you yeah so all of that uh interaction with objects in 3D space is starting to roll out now they had uh I think was like one or two Apple apps like the keynote app and jigs space and one or two other things Apple TV you can watch videos in a virtual theater where you're in the middle seat and the per people behind you have a further backseat all that stuff you could walk around the theater was cool um so that's that's new that's finally you can you can do the thing that you were doing oh you can do environments as well right so I did this thing where I played chess well with uh the group and there was three people and we were all sitting around a chess table or no cards sorry we were playing cards three player chest sorry multiplayer chess but four four people all sat around the table we were playing a card game we turned on the environment and so if we all turned on the environment at once we'd all be in the same environment we could all look around and see the same things so we all saw the same board I played my cards they all saw it then the next person played their cards they all saw it it just it's it's the way we have been doing three years yeah but I thought you said you were playing chess I I did chess with one other person but then I did cards with four people I was like yeah yeah four person chess is yeah four person chest with cards it's a weird game they need like but that that is real now board game game simulator with that which I'm pretty sure is available in probably Quest already and probably VI it is it is it's been around for a very long time that seems to be cool stuff in like VR that would be really fun is like a bunch of board games cuz like right still playing chess I could see being Fun Cards feels like one of those gimmicky things like look we can do spatial ghosts or whatever the also quite limited on what card games you can play cu the games that I play most with groups are like speed or Egyptian rat slap yeah and those games are games that require like rapid in front of each other yeah this wouldn't work as well that wouldn't work that well but I will say my two biggest take ways from having a demo of it where one the ghosts look bad better well they look okay I mean the hands are much more prominent so you know how you could see like hands in front of your face when you did a FaceTime through the glass window the hands are like always visible now so it kind of looks like a like a wi character you've seen the wi characters where the hands are always there and then the body is kind of floating you sound like someone who like just gave a friend a present and they open it and they're not very EXC and so you're trying to explain why it's really cool and they're just not buying it at all I guess if you if you compare this to what I was just doing in the quest it it is obviously a very different experience but the other version of that is the quest has much more massive immersive environments to move around in and I still don't really have that on Vision Pro yet haven't seen that yet obviously having a chessboard is cool in front of you everyone can interact with it obviously being in a theater where everyone watches the same video is pretty cool yeah but having like a huge map where you can run around and play games and all this stuff is not a thing on Vision Pro yet yeah here's a question I have and maybe you still haven't used it or either of them quite enough but like I'm still interested in the if the Avatar is realistic versus like specifically an avatar and like what feels better especially because the realistic avatars in The Vision Pro right now clearly still have a lot of work to do aren't overly realistica yeah so like is that does that feel more real and more like fun or like if you just know that you can't get that realistic to have your own personal Avatar that looks kind of like you but it's clearly a cartoon is that more like immersive because you're just in the whole world like that it's a really good question I think that's exactly where it comes down to taste like when I look at the the Apple Persona especially in the glass window I can see how it feels realistic like a real conversation but when you take the glass window away like the side of your head just Fades into clear and your shoulders Fade Into clear and your your hair Fades into clear and I if you if you look away from me I just see like a ghost outline of you with floating hands so it doesn't look realistic which means I look at it I'm like this has a long way to go but it's if it's a cartoon it doesn't have any of those clear fadeaway downsides I didn't scan the top or the back of my head but now it's a cartoon so it's not it's it is further along because you can see more of me more often in the cartoon but it's also not as far along you know I think sometimes in VR though it's really easy to be like it can be immersive without being realistic and like if the Avatar matches the environment you're with and once you're in there for like 10 20 minutes and then you're in there for a while that's when you have that like I took the headset off and it's like whoa yeah I I was really into that and that's I could see it being more immersive being less realistic it's also a use case thing too like immersive versus realistic in gaming I want immersive but in a a a meeting over a keynote I don't know I kind of just want like if I'm doing if I'm doing a business meeting which I think is kind of what Apple actually thinks some people are going to do with this and I'm showing you a thing on a presentation if it's a cartoon it's like I'm not trying to take that seriously but is it more distracting when it's like it's a cartoon you're expecting a cartoon versus it's David but the left half of his face is missing cuz he keeps turning to the right and like his ears are like glued to his head and like he's fuzzy all over like sometimes I feel like if you're trying too hard to be realistic and it's not that feels way less immersive leaned really hard into the cartoons and I just think that that didn't age very well and it just feels it makes it very hard for them to be like a this is a business like kind of thing I totally agree with that and I'm not one way or the other but I I don't know which one would feel better so you know what I think the main challenge is is Apple wants the scan process to be as easy as possible for as many people as possible but I think if you were to do like a much more detailed like twom minute long scan process you could have an amazing yeah uh Persona kind of like the way like some people like set up like a mirrorless camera with a USB cable into their computer to be like their webcam and that's a small fraction of people and most people will never want to do that but for the people who actually want to put in the work it can look way better I think if there are some fraction of people who are like I'm going to give a work presentation I need the high reses like good scan I'm not going to do the 12 second scan that Apple makes you do for FaceTime I'm going to do the big highres full torso scan so I can like have a good looking realistic Persona I think that if you buy the vision pro at an Apple store they should have like a setup and take it out and do this help you do the scan with like Studio lights and stuff they should do that well like what you're talking about does not exist right even a made up thing I think be nice the best scan possible with lights I still think would look sketchy it's it's definitely better in this update than it was originally like it's it's better at the hair cutouts and stuff like that um and the textures of the face are slightly improved it has a long way to go for sure um I I wanted to note something about the the presence of the ghosts or spatial personas I do think that this is a much bigger deal that this is finally coming out Than People sort of realize because before it felt like there was pretty much literally nothing to do with division Pro except maybe like watch a movie that felt like a good or meaningful or better experience and the arc that this is moving towards with the spatial ponos is actually feeling the presence of like being in a room with someone doing something with someone I think is like the biggest value proposition of this because already people talk about the metaverse right uh Tim Sweeney loves to talk about the fact that kids now get on fortnite and it's it's kind of like they're in a room together right they're all on Discord They're all playing fortnite you're going to a concert together and the whole thing about that is you're doing it with your friends but there's not re the the limit of presence in a fortnite concert is that you're all on Discord together but the closer you can get to like this is my space someone's sitting right next to me we're doing this thing together I think it's really awesome cuz if you're across the world and it really feels like there's a person like right next to you that is incentive for me to put on a Vision Pro and actually hang out with somebody I would rather do that than just get on Discord with them and talk to them over that or even the quest if you had like a cartoon version of them right that's even though you're in the same place it doesn't feel like it doesn't feel real yeah they're still in the uncanny valley with the scans and everything get um but I think that for the future of Vision Pro and going from like this headset doesn't make sense to buy at all to like I can see where they're going with this where this will be incredible and people actually might want to buy it makes a lot of sense um also one cool thing about the if you're using Apple TV which I hope that they enable this in other streaming apps but they probably won't I don't know something that's cool is if you are watching a movie together or a show together or something even though you see them sitting right standing right next to you like or sitting right next to you watching the show um the TV will be perfectly aligned for both of you so if you're both in the movie theater and your character is like sitting at the direct center of the movie theater even if you see your friends sitting to the right to them they're in the direct Center yeah so you always get the best experience even when you're hanging out with your friends kind of cool come in late and you're like oh I got the bad again for for the movie you're always late to the FaceTime back one time I I watched a movie in the theater and we booked tickets at the very last minute and we were literally first row and it was a massive screen it was so of painful yeah do not buy that ticket yeah um anyway I yeah I think it kind of plays into Theo's thesis for her video which was this is a teleportation machine and I think that's going to be the most valuable value did you say Cleo or Theo oh you said Theos thesis they theis Theos theosis yeah Cleo thesis about to being a teleportation machine I think that I can see us getting there now which is cool the Fidelity of everything that's not the ghosts is pretty good yeah like the audio Yeah the that sounds cool the the objects that we're manipulating in front of each other like that all that stuff is like really good yeah so it's just the ghost that are a little and ironically Apple being super obsessive about things being exactly as they were being would be in real life like for example having to like pick up a window and carry it with you that obsessiveness is annoying but I think that they're trying to program into people's heads that this is a real object except that it's not you know yeah I still wish that you could pin windows in front of you but that was the second biggest point in our video so it has to be coming next yeah I has to be I hope so so what do you guys think Google's going to kill next what is the least staying p or it doesn't make a billion dollar don't say it too loud cuz it might actually happen I hope it's not tasks I just started using tasks and I'll be very upset I always think kill it it was tasks I don't look they got keep you know they could just integrate they could just add tasks features to keep Google never integrates things that you would think they do but then they just end up killing one of them yeah they'll integrate features from one to the other and then kill it yeah they make a redundant product and then they were like wait why do we have two of these they kill one of them and then like integrate like one or two of the features into the old one and then they light the building on fire that's they did all development of the other one and then they fire the employees yeah as long as they don't cancel or kill the Subscribe button agreed did that light up for you I would hope YouTube sticks around I'd like I think it a billion dollars so it yeah yeah yeah exactly so we're safe so make sure you subscribe so you can stick around the whole YouTube thing also like and comment [Music] oh

Channel: Waveform Clips

Views: 56,157

Keywords: Waveform, WVFRM, Podcast, MKBHD, Marques, Brownlee, Andrew, Manganelli

Id: zPk5nlc5_Rg

Length: 15min 41sec (941 seconds)

Published: Fri Apr 12 2024