Real Invisibility Cloak Using Artificial Intelligence! - Harry Potter Invisibility!!

yes i got all the harry potter stuff on no magic no green screens check this out [Music] this video is sponsored by micro center all right let's get into this you comment the ideas i make them that's how this works so in the last video we did some real mind control doctor octopus arms which by the way just go watch that video if you haven't yet it's a good one so if we look at the top comment on that video which by the way you should go watch with some real falcon wings i've also been seeing big hero 6 microbots so i hear you guys both those projects are in the works but both those projects are extremely hard to do like i want them to be the best i can if we're gonna make falcon wings like you know we're gonna actually try and fly with them so they're just gonna take a little bit more time definitely subscribe for that it's gonna be great so in the meantime i was going back through like all my older videos i kept seeing invisibility how can you see it if it's invisible ah good one no but i've always been fascinated with that idea what if you could actually turn invisible you could um yeah i'm gonna be honest guys we'd all do some weird stuff we're invisible so let's skip the what and move to the how uh but first if we get a couple more project ideas down in the description that really helped me out some might take longer than others so it's really good to get like a couple ideas so when i think of invisibility my mind immediately goes to harry potter's invisibility cloak you guys know that cloak that he puts on and wants to like spy on snape and stuff basically anything of the cloak becomes perfectly invisible you also got stuff like miles morale spider-man suit doctor strange i think can go invisible invisible woman ah the name guy's kind of slacked on that one though but yeah invisibility is everywhere and nowhere oh come on you didn't even see that one coming all right so how are we actually gonna make this real well the easiest option just take this thing wrap it around yourself click a few buttons and boom you're invisible obviously though in the real world doesn't look quite as cool for those who don't know how this works basically i just took a still image of the background and then we use software to key out all of this color and replace it with that still image actually when doing research i got a lot of this type of stuff so good way to tell if this is real or not is to check if the camera is static and if it looks too good to be true it probably is because as soon as you move the camera to a new perspective that yeah the shot completely breaks down so clearly we're gonna need another option so the goal is to basically make an invisibility suit like that but have it be in the real world so to understand invisibility we gotta start with what actually is visibility basically light gets emitted from a source like the sun light bulbs etc and bounces off objects in all directions say this water balloon is the light and my lovely volunteer here is the object we're trying to see the light hits the target and the splashes bounce off in all directions and some of those splashes reach our eyes so based on all the different splashes and all their different angles we can see the object and know what it looks like all right i hate this demo this is a stupid demo so in order to make something invisible the light reaching our eyes can't be obstructed by the thing we're trying to make invisible that's why glass looks invisible because most of the light we see passes right on through now there's a couple ways we could go about this first we could develop some sort of like jellyfish potion that makes our entire body translucent and we can just run around naked and we're good i'm gonna be honest though that doesn't sound like the best idea we'll call that plan b and maybe move on to something like bending light if we can somehow bend the light around us and create the illusion of invisibility this seems to be like the most common method i found when researching this and actually already exists in small scale rochester cloak is a perfect example of this multiple lenses are used to bend light around a subject first lens focus is incoming light down to a point just like a magnifying glass after it reaches that point the light then re-expands where another lens redirects that light back to the original path and now you have a region of invisibility this method looks super cool and works pretty well but only from one angle you move slightly off access or look at it from the side or anywhere except right down the middle uh that illusion completely goes away so another type of invisibility lens that you've probably already seen before there's this thing right here called a lenticular lens i look invisible it's invisibility properties we first debuted a couple years back uh actually research for military technology and they call it quantum stealth we just appreciate that name for a second so cool like take notes invisible girl well it sounds super cool until you find out it's the exact same stuff as those 3d holograms you used to have same exact thing just without the picture on the back then every youtuber and their mother goes clicks baits and visibility shields on the bandwagon gets millions of views all just for a plastic sheet you sound a little salty dude yeah so what i'm a little salty about this this could have been it i this could have been the end of the video now i gotta go play around with lenses figure out how to like improve this somehow whatever i'll still explain how it works real quick these lenses have tons of tiny little ridges in them all these ridges bend light differently depending on what angle you're looking at it from again you go back to our water balloon demo your position will affect what light interacts with you uh and what you perceive a lot simpler than they make it sound with quantum stealth i think they're calling that because they're just dealing with tiny little photons on the quantum level but you know technically everything's quantum but it works on the same principle of how any other lens affects light so when you stand in front of the lens the light that bounces off you goes through the lens and is scattered along that lenticular plane background light passing through the lens is also distorted in the same way which is okay as long as the background is like solid colors or includes lines that line up with the lenticular plane the best way to describe it is it's a real life smudge tool in photoshop like if you smudge something along the line it doesn't matter it's still gonna look like the line but the illusion completely breaks down if you stand in front of anything that's like not straight lines which is the main downside to this method only works in certain circumstances also even in the most perfect conditions you're still going to get like a blurry splotch used in this way it doesn't have the ability to show clear images but again not bad at all for a piece of cheap plastic like look at that already makes the back wall disappear it's good but i was thinking like what are some ways we can improve upon this technology like how can we make it work against all surfaces and make it produce a clear image well remember you actually can get a clear image when the lens is up close to something this is the same stuff as the 3d holograms this looks pretty clear and 3d so i thought what if we could just replace this 3d hologram with a picture of our background that would work for one specific area but again it's not very dynamic what if we had a picture that constantly updated our background like using a screen now we're getting somewhere so maybe we can make like a screen suit shield cloak using these lenses and screens that will perfectly blend us into any surrounding sounds awesome but immediately tons of problems with this idea one of the main issues that we need to solve is the perspective issue kind of like those 3d paintings from one angle it looks fine but as soon as you get off a little bit illusion completely falls apart again this brings up another problem and that's that we see in 3d this is really hard for me to demonstrate on camera because it's a 2d video but in the real world it's super apparent i guess the best way i can show you this is if you close one eye and just look at stuff your hand and everything else around you notice how everything flattens down and it becomes a bit harder to tell how far away everything is you still can kind of estimate the depth because your brain is really good at you know picking up visual cues but just notice how everything flattens so in order to truly get the club perfect we not only need to solve the perspective issue but also the 3d issue which makes everything even harder but again these lenticular lenses can help remember they have the ability to project light from different angles which allows them to either show multiple pictures depending on which angle you're looking at or they can show one picture in 3d both of which can be useful to us because remember those are actually the two problems we're trying to install trying to make it look 3d also trying to show multiple images to multiple angles but the catches they can only do one of those things so we need to figure out another way to do the other one so i think i've got a way to do this and it should make a really convincing cloak for one person we can use the lenticular sheet for its 3d effect we project two stereoscopic images one for the left eye and one for the right eye cut them into strips and splice them together that way the lenticular lens will show one perspective to one eye and one perspective to the other so that's how we'll get our 3d image then we can use some ai and computer vision to detect the person project the correct perspective this is what's known as the parallax effect and it just might work like you can actually get apps on your phone that do this text your face and adjust your perspective accordingly so it appears like your phone is a deep void so what if we just replace the void with a convincing background should look like the phone's see-through i'm gonna tackle this one step at a time though so let's first work on like the ai and computer vision and projecting the right perspective and then we'll double the cameras splice the images so we get that 3d effect so to scale everything up we need some nice high-res screens high-res tv will probably do it and some nice camera equipment which actually reminds me about the giveaways last time we gave away a ps5 congratulations on the winner of that so i figured this time around you know we're gonna go get a tv might as well get you guys a tv too if you want to win this one all you got to do thumbs up this video and subscribe then hop over to instagram and follow us there we'll post a picture for this video so just like that and we'll go through the comments and likes and everything and pick a winner i really like these giveaways guys i feel very fortunate to be able to be doing this for you so if there's anything you want uh related to building or cool technology drop it down below yeah we'll give it away next time all right to the store so we headed on down to micro center looking for a tv and some camera equipment and actually when we pulled up there were tons of people waiting outside for it to open we're kind of curious actually and we got to chatting with the managers and it turned out they're basically the only physical store that carries products like the high end 3000 series graphics cards which are clearly in high demand they've also got tons of like 3d printers and other electronics and diy stuff it really is like tech heaven true like you really don't see this in any other stores anymore they got 25 locations all across the u.s so i picked out a tv that should be big enough to cover my body then we went to check out the cameras but not before doing a little jaylays or promotion on their computers i wish they have a ton of by the way look what i did that's okay and if standard computers aren't enough for you they also got a custom pc builder to spec out the best pc for your budget like micro center's motto is to keep the quality at a low price to actually build a relationship with the customer like check this out they're actually offering you a coupon code for a free pair of wireless bluetooth headphones again haven't seen any other stores doing this so check that out if you're interested all right got the tvs cameras back to the shop so i threw together a program that uses an ai face tracking neural network to track my face can then use that position of my face to adjust the background to be correct from my perspective to get the background image i'm just using a wide angle camera that way we can punch in on different spots and adjust the perspectives accordingly with software it's not perfect but you can sort of see the potential right like i'm just using a standard webcam to track my face and i haven't really fine-tuned everything yet and if it's unclear we're basically trying to turn my laptop screen invisible and make it look like glass so that way anything in between the laptop screen and the camera on the other side will be invisible you might think this is sort of similar to just holding up your phone with the camera open and like scaling everything right so you see the perspective keep in mind the laptop's stationary i'm the one moving around not the camera like if you moved around the camera you could potentially sort of get that effect but no the software is doing all the work here so that's pretty neat so a little bit more coding i was able to add in depth tracking too just a simple implementation basically it takes the size of your face tries to figure out how far away you are from the camera no matter if you move the computer or yourself or both together can now read your perspective in comparison to the computer and project the correct image onto the screen again i still don't have it dialed in that well yet but again you can see the potential like when someone walks behind the screen it looks kind of convincing but if they were between the camera and the screen it would look invisible but again there is a lot of lag things aren't matched up correctly so it still needs to be optimized a little bit more now i'm gonna be honest guys i'm not a programmer i'd say my programming knowledge is on par with like driver's ed mentality just do a bare minimum and try not to kill anyone so to help out i talked to an expert in the world of computer vision and augmented reality he runs a youtube channel called augmented startups which would be your first place to check out if you're interested in this sort of computer vision ai currently working on a fully autonomous computer vision drone so very cool stuff so after some talking we settled on using some specialized ai computer vision hardware that should give us a more accurate and faster track uh we then actually played around with some 3d room scans because before we're just using basically a flat image but when we add a 3d model it definitely adds another layer of realism to it like it kind of looks like we opened up a portal to a new world fortunately this method isn't very dynamic because it requires you to have a super high resolution 3d room scan of wherever you are in terms of like dynamic invisibility and being able to go places and just be invisible i think we'll probably have to stick with the camera method but he did give me some helpful tips on that he showed me how to smooth out my tracking you mind just showing me how to move that virtual camera around so then i scaled up my original design to the bigger monitor we got and again this led to some more problems first the scaling and motion settings were all off again just due to the increased size of the screen perspective was way off and the brightness was also messed up too because right now i'm using a single camera system to pick up the background background picture is coming from like a small area in the center of the screen but from someone who's looking at the tv from the front it doesn't always line up with this cone field of view from the cameras any place that's mismatched the image is going to look a little bit weird like ideally we could have the entire back of the screen just be one giant like camera blend all the images together to make the perfect display but that's extremely complicated to do so instead i spent just hours trying to figure out how to manipulate these images warp them to produce a convincing background after a bit more research i realized to actually show a believable image we're gonna have to make it 3d somehow i mean for some scenes where the background is like a flat plane like my wall here it doesn't matter too much but if there's a bunch of different objects some in the foreground some in the background 3d aspect is important because as you move around closer objects will move more than the further ones and you can see this happening with our full 3d room scan but again we can't be getting full scans of everywhere or going but i did a little bit more research and i think we can actually solve this issue with more ai this is so cool guys this recently developed program can take flat images and use context aware layer depth in painting to render 3d parallax motion yeah i'm literally just reading the abstract off this paper you know again not a programmer but just look at how cool this is we can go from a normal flat image to a fully rendered 3d video they've got all their code on github if you want to look into this more but yeah we can use this to render out our camera images to 3d then use our original face tracking ai to see where the person's looking from and show the correct perspective this does still take a bit of time to render so if we stay in the same spot it has time to render out 3d picture but when we're moving around we can still use our standard flat picture and tracking in real time hopefully this makes sense though i'm trying my best to explain it and again i'm not a programmer so this took forever to do but finally with a bit of tweaking i think i got a pretty convincing effect working and also i want you guys to be seeing exactly what i'm seeing i can't really do that if i'm trying to hold a camera up to my face because the you know things trying to see my face what i did instead is had the ai track the camera using a qr code i mounted to it so if we set everything up as you can see anything between the tv and the camera is essentially invisible just a matter of tweaking the settings so they're perfectly and match with what we're actually seeing overall it does a great job but there are still a few problems still see some reflections from the tv glare the warping algorithm still messes up slightly tv image is just a little bit softer than real life but if you really dialed in and keep the movement pretty steady the effect is very cool like it looks like you disappear so lastly we need to control alt delete those bezels [Music] well i broke the tv i hardly even touched it turns out lcds don't like it when you rip the sides off tv just shocked me uh kind of tasting metal but i've kind of always wanted to do this and i think this is the perfect excuse all right well i guess let's get another tv i'm thinking oled this time because it should be a little bit more robust and easier to modify like we might even be able to curve it around us oh i broke the oled only took me like five minutes this time turns out oh leds don't like being messed with either they're even more fragile imagine like having a lot of money and then just like letting it on fire oh like this video yes what i got it's another tv place your bets now if you think i'm gonna this one up too clearly tv bezels turns out there's a reason for them i guess that makes sense so if we can't actually get rid of them we need another like creative way to make it look like we got rid of them so again i was playing around with these lenses and look what happens if we actually bend them up around the bezels bezels disappear kinda and i was already gonna add these lenses to the tv anyway so i'll just make it curve up on the edges and that way it should blend the tv image with the background image so i covered the entire screen with these lenses leaving a spot for the detection camera and i honestly think it looks cooler this way it kind of looks like a mysterious magical box that harry potter might actually have and i can make a battery powered with the help of a battery and a power inverter the last thing we got to figure out is how we're actually going to wear this thing like we could just hold it up as a shield or something but i mean that's kind of unoriginal it's been done before i kind of wanted to curve around us but we can't do that i don't want to keep that harry potter vibe even if it's not like a full invisibility cloak so i decided to mount it to my back that way we can cover it up with like a snap off cloak when we're not using it then when we want to go invisible we just rip off the cloak it breaks away revealing the screen making us invisible so in order to still get that pass-through view i mounted the camera to the tv with a metal bracket that wraps around our chest because it is very important that this camera stay in the same area in relation to the tv so the framing doesn't get all messed up and yeah that i think should do it real quick though before i test this here's some projects that you guys made and sent to me [Music] we got the wolverines star wars and captain america awesome job guys definitely keep sending me these projects on instagram at jayla's video or just email them too super inspiring love doing this segment all right let's give this thing a shot wait wait wait yes i got all the harry potter stuff on no magic no green screens check this out [Music] so as you can see it's kind of convincing found it works best though with slow movements and like medium lighting conditions because if too bright the screen just gets washed out and if we like rush too fast and it's too jerky track and program can't really keep up and the image lags a little bit but when it does work oh it's super cool come on tell me that's not cool no green screens no nothing i'd say it's like a 90 invisibility kind of looks like we're looking through glass sort of and comparing it to the plain lenticular lens i think it's better especially up close uh but even from far away when like with all the software turned off and the tracking algorithm turned off it's still kind of like dynamic camo it'll still act kind of like a chameleon and give us the same colors as our background now normally this would be the part where i'd edit like a super cool montage or something but this is just a hard video to film like perfect circumstances i just be filming nothing trying to show a video of invisibility but hopefully you guys think this is cool like i think it has potential even if it does look a little goofy i still don't have my legs covered and also the 3d effect definitely needs some tweaking i didn't think it was that believable again it's hard to show on camera but i'm gonna have to leave that version too it's one thing i do really want to try uh is using the special 360 lenticular lens right now these lenses only change perspective along one axis but with these 360 fisheye lenticular lenses it changes in all directions it just uses the same technology but just in a fisheye pattern so in theory we could simplify this whole thing down get rid of the whole face tracking thing and just use these lenses to show the correct perspective for whoever's looking only bottleneck now is the resolution like you're basically trying to fit the data from every single perspective all into one image so just like if you zoom in far on any image it's going to get pixelated but better screens are coming out every single year which is only going to help but there it is guys it's my take on invisibility for now again maybe we'll come back to this in the future i don't know if you have any suggestions let me know down below so once again drop a thumbs up if you did and of course subscribe for projects like the falcon wings and just lots more thanks guys peace [Music] you

Channel: JLaservideo

Views: 1,559,992

Keywords: Jlaservideo, DIY, how to, tutorial, Harry Potter, Invisibility, real life invisibility, invisibility cloak, Artificial Inteligence, harry potter invisibility cloak, engineering, spider-man invisibility, invisibility shield, lenticular sheet, quantum stealth, harry potter sorcerer's stone

Id: K2XMuj3LimI

Length: 19min 32sec (1172 seconds)

Published: Fri Apr 30 2021