A.I. Learns to FLY

hello how we doing i'm back for another video and i know what you're thinking evan how can you follow up such an incredible video and i know i know i probably peaked with my connect 4 video but i will try to approach the same level of action you guys experienced in my last vid yeah in all seriousness connect 4 was a mistake and i'm very sorry about that but today we're doing something which i think is really cool ai learns to fly which before i start i have an announcement to make well actually in this video i have like three but the first one is drum roll please hello drum roll please okay i guess i'm not getting a drum roll hey oh that's it okay great great to have you on the team anyway the big news is that i am now on twitch so if you want to watch a confused coda googling tutorials then head over to twitch.tv code bullet and i'll see you there okay back to the planes and [ __ ] so my overall plan for the video is to have an ai player flight sim and have it learned to not die instantly and maybe then learn to fly to a checkpoint or some [ __ ] i don't know we'll figure it out as we go let's just jump into it so first i need to make a flight simulator and to do this i'm going to use unity which is a fancy as [ __ ] game engine which you can use to make anything your heart desires unfortunately though my heart seems set on making buggy pieces of [ __ ] because this is all i've managed to achieve [Music] and uh before i start the recap of the ship fight which was the flight sim i've got some very bad news to share with you guys and i know you guys are probably sick of hearing about this virus but i think it's important to use my audience to help raise awareness for others who go through the same things i have been through uh that's right i have caught the smooth brain virus its symptoms are really bad and they reached their peak when i forgot that twitch streams were deleted after two weeks and lost a decent amount of footage of me creating the flight sim sorry i'm just okay okay okay but luckily i have you guys because you guys came in clutch and clipped some moments while the videos were still up so i can actually give you a pretty accurate montage of what happened so i started like any academic would i added a mustache to my 3d raptor and added some mods to my chat because you guys are toxic as [ __ ] i jumped right into it i should name stuff let's name this body no body that's what's going on why is my my y key is mapped to the zed what's that z what has happened what have i done have i actually [ __ ] my keyboard [Music] all right it's just i'm pressing y on my keyboard what the [ __ ] that's kind of what i'm going for here [Music] that's what we got that's a plane beautiful model [ __ ] i built it myself if you would believe that all right so the model is done and looking mighty fine if you ask me now we just need to make this [ __ ] airborne and we're done easy i don't know what to do all right this is the dumbest way of doing this ever so that's not great like it just stops wait can i not go forward and up and down oh i'm doing else ifs evan [ __ ] this is this is not going as well as i thought it would yeah so getting the model flying like a plane was a bit more difficult than i expected but you know your boy when times get tough steal code from someone else and luckily unity has this as a built-in feature the asset store allows you to download models and code that other people have made so yeah i kind of just scrapped literally everything and just [ __ ] downloaded it and guess what good news i've downloaded all the streams from now on haha so yeah i can actually give you full recaps of what happened without skipping huge segments yeah okay new stream and you know what that means we need to pick an avatar for the stream yep that's good perfect okay so once we plug in the code that i didn't write she flies like a beauty fantastic oh yeah that's pretty normal plain activity yeah i'm pretty sure they bounce yeah that's that's normal so the plane is done but look around the terrain is boring as [ __ ] so we need to fix that so i channel my inner landscape designer to create something beautiful [Music] the legacy of dick runway has begun but seriously let's get some terrain happening time lapse it's a time lapse time lapse [Music] and just some finishing touches [Music] and now as pretty as my plane is it's not super detailed or like colored or like realistic or like uh yeah just accurate in any way and let's see if you've been paying attention what do we do when we don't want to do something ourselves that's right we steal it yeah it does look pretty cool now and the propellers spin and [ __ ] oh very nice okay now what's really important is that we oh hello hey oh hey hey buddy what's up uh not much no not much you look good have you been working out uh not really no well i'm pretty sure something has changed uh did you get a haircut no uh oh i see what it is you must have gone to codebulletshop.com to pick up your stuff from my very first merch drop oh yeah wow that that's a good hoodie oh my god oh okay yeah yeah anyway i got matched now finally after three years or however long i've been doing this [ __ ] for we got mad we got a shirt which has [ __ ] you spider on it and we got a pull over we got some hoodies this one says code [ __ ] anyway uh buy my [ __ ] oh we also made a 2021 calendar which has awesome designs for each month like hey look at potato and [ __ ] march check it out at link in codebulletshop.com if you're too lazy to type it okay back to your regularly scheduled [ __ ] where will we before that awesome segue to the plug oh right it's time to add explosions if my ais are as good as they normally are then i'm pretty sure we'll be seeing more explosions than flying so we gotta make it count luckily unity has a particle system which can simulate and render hundreds of thousands of small particles and you can change them to look like anything including fire explosions whatever the [ __ ] this is i can do anything it's really cool stuff and with such a powerful tool at my fingertips i couldn't resist giving up and stealing it from the asset store so after minutes of blood sweat and downloading i've got some pretty awesome explosions happening oh beautiful yes yes all right making pretty good progress now we've got a plane we've got explosions we've got a dick runway everything you need for a good flight sim now it is time to air that [ __ ] for the ai we're going to be using ppo which stands for policy proc polyproxy [ __ ] what is it proximal policy optimization yeah yeah yes anyway ppo is probably the most powerful reinforcement learning algorithm to date how does it work uh no idea honestly no [ __ ] clue all i know is that it involves neural networks and magic but luckily other people know how it works and they've coded it so i can just do what i do best and steal it from them uh looking back on this project did they actually do anything or did i just copy a bunch of [ __ ] from other people and slap it together oh no i made dick runway i made dichrono we're good we're good and you cannot take that accomplishment away from me anyway ppo from the outside it works pretty much identically as deep q mining all you need to do is punish the ai for [ __ ] up and reward the ai for kicking ass so we punish the [ __ ] for dying and we reward them for not dying and that's it machine learning is not hard okay so rewards are done now we just need to define the inputs and outputs to the neural network so first up is inputs just shoot out a bunch of lasers and get the distances to obstacles in those directions and unity has a built-in ray car system which does exactly that so i slapped like 28 lasers on this [ __ ] and we're good to go i also gave it its speed elevation pitch roll your you know all that nerdy plane [ __ ] and okay that's it the inputs are done and the outputs of the neural network are just the controls for the plane okay we're up to speed great now let's get to the action oh also just a heads up uh this is editing evan here uh the recording for the first bit of this training got corrupted as [ __ ] so i prepared to see some trippy [ __ ] uh is it okay it's just doing that it's just running into the wall okay not the best start to the training but i'm pretty sure ppo takes a while sometimes so let's just wait and see what happens [Music] uh uh so uh hmm uh yeah that's some bad [ __ ] news uh not exactly what i was expecting but you know maybe trading will just take a stupidly long time but do not fret i have a plan and the plan is simple if it's taking ages to train one plane then all we have to do is add a few more planes and by a few i mean two hundred [Music] oh [Music] all right so that should speed up the learning by yes two or three hundred times okay so [ __ ] ton of planes ppo learning go [Music] [Music] okay i think i might have [ __ ] up here and [ __ ] up i had because i might have misspelled plane controller in the config file meaning the planes were just doing random [ __ ] and not learning at all was that that's fun we're having fun right i love spelling mistakes that cause days worth of wasted time so it's gonna do this later but [ __ ] it let's do it now we don't want the planes to just be flying around in circles all day so we're gonna have to give them targets to fly towards i've put 20 or so targets around the map and each plane is given a random target to get to and if they run into that they get a huge reward and they get assigned a new one then rinse repeat you get it okay ppo learning with correct spelling take two okay so step one is learn to fly i hope they have more success now that ppo is actually working okay start was not fantastic was not textbook but we're working on it that's the whole point trial and error we've nailed the error just blasted through that guy oh and it's dead never mind [Music] that was great [Music] oh my god can we get off the [ __ ] ground [Music] oh this is hard to watch come on we got this we got this airborne oh yes [ __ ] that guy and we're off beautiful beautiful hopefully it shouldn't take too long to learn to fly yep never mind straight into the mountain okay oh my god [ __ ] all right up up up you want you don't want to go up that was close almost a spawn kill but we're good i'm not loving the trajectory up up above the [ __ ] okay it's actually looking really good like it's nailing the flying i think oh no oh no never mind never mind just did that to spite me the dick all right let's try again take off we know how to do this never mind [Music] goes to show you're never sure how [ __ ] the ai is always worse than you expect and there we go again you need to take off straight away it should not be a complicated oh my god that one was hot oh my god just let us take off fleas okay come on we're looking good we're clear and we're off beautiful okay let's hit some targets maybe are we there yet i don't think so we haven't quite nailed not dying instantly so let's just focus on that first then maybe look at some targets [Music] [Laughter] beautiful beautiful what the [ __ ] no oh after i nailed it what's up [Music] okay uh let's head towards the target oh that's the wrong target but we got extra style points so who the [ __ ] cares okay to our target let's go [Music] gonna want to watch out for that mountain and the ground also [Music] oh no oh no no no no no okay this will give us a chance to reset reevaluate and aim for that target okay and miss that mountain please oh we have passed the mountain somehow yes okay we're getting there there she is there's the target and we're going the other way [Music] whoa we're getting pretty close oh there she is this is gonna take [ __ ] ages to get isn't it okay so we're just checking out the area evaluating what the best line of attack [Music] is oh that looks good that looks good i never mind bro oh my god are you kidding [ __ ] you oh all right let's make our way there you know the route now you've studied it well don't you dare don't you [ __ ] get off okay let's try again shall we [Music] this that's perfect come on come on oh oh did i did that count oh it did that's the new orb yes yes you did it chief you did it [ __ ] yes oh okay one down [Music] [Applause] [Music] [Music] oh there she is easy easy easy you didn't try you didn't even try watch out boy you're a failure [Music] hubble good try good try good first attempt you weren't even [ __ ] close but you know good first attempt oh wow oh two from two two from two no no i feel too good to beat you ah i could dream though i could dream [Music] is downtown perfect form takeoff that's to say things were looking good although it is time for our greatest challenge yet there she is upon the mountain okay this takes [ __ ] ages uh and i'm sure you're sick of hearing my voice so enjoy chipmunk evan while he has a mental breakdown all right oh uh oh quality stuff my man i thought that was never gonna happen right come on this one should be easy easy you've learned something i mean that's the point that's the entire point of this but it's still surprising it doesn't have this one again does it oh i swear to [ __ ] god if it's got the high one again oh it looks like it oh my god now you've run into the mountain oh my god are you kidding okay [ __ ] this [ __ ] this i'm out i want to know what happens if i let the ai control all the planes but one and i control the other one and then set all of their targets to be me okay i'm ready let's [ __ ] him up okay let's see how this goes i'm hearing concerning noises which is always problematic but oh my [ __ ] god okay yeah no turning around turn around [ __ ] that i'll deal with that later but now just ignore whatever the [ __ ] going on back there i'm just going for a cruise [Music] oh god oh no oh no oh [ __ ] that didn't last long okay that was fun but it didn't feel like a very fair fight so i had an idea how we're gonna even up the odds yes yes okay wait only one of the guns is firing pathetic try all three yeah all right let's [ __ ] them up okay guns are cool but they're pretty hard to aim and so i have an idea of how we step it up another notch [Music] [Music] sword of spinny bop [Applause] [Music] god [Music] [Music] you [Music] the ultimate sword of spinny puck okay are you ready for the final upgrade the ultimate weapon the sword of ridge wallet sponsorship oh god oh no it's too powerful is he shooting ridge wallets as well [ __ ] hell what a maniac he could end us all wait wait is that is that is that that burnt titanium ridge wallet oh that's not all it's also using their carbon fiber forged carbon fiber aluminium ridge wallets as well what devastation i just hope the planes aren't hoping to rfid scanners because that shit's getting blocked as [ __ ] oh wait wait what's that behind the plane oh [ __ ] oh old ridge wallet purchases are backed by lifetime warranty the value is apocalyptic well that was fun i was just getting a bit carried away there anyway full seriousness you should check out ridge wallets they're really cool i've been using one for two months and it's just fantastic i'm never going back compared to my old wallet it's like less than half the size and more pocket space is always a winner and this is uh potentially a weird point to make but it's like really fun to use you feel like a ninja when you whip it out that is a bad sentence out of context but whatever when you whip it out and flick out a card it's nice so yeah thanks again for ridge wallet for sponsoring this video and you can visit ridgewallet.com codebullet10 to see their holiday guide and use code codebullet10 for 10 off with free worldwide shipping and returns link is in description okay we did it another video in i don't know how long this one was two months month in a bit that's pretty good that's all right you know not too bad uh do check me out on twitch i don't know when i'll be there i've been kind of like recently i've been moving in certain other excuses here but i will be on twitch uh pretty soon whatever you'll catch me there i finally got twitch.tv code bullet i was the big cb for a while because some [ __ ] stole my code bullet name uh but we got it back so that's awesome uh yeah so check that out check out my merch yeah a lot of [ __ ] announcements happening today thanks for watching thanks for bridge wallet for letting me do that dumb as [ __ ] sponsored i really enjoyed it yeah so yeah whatever i have nothing to say here i just like putting a little ramble at the end of the videos it's fun i enjoy it check out my twitch check out my merch buy the calendar we actually put a lot of effort into the calendar it takes a lot more to make a calendar that you think there are a lot of months and uh we added a few little easter egg details in there here and there uh so yeah had a lot of fun with the calendar so yeah pick that up uh you could maybe get some stuff before christmas but i don't know if the shipping will be done that was my bad uh we should have had this video out earlier but you know me anyway bye bye [ __ ] check me out on twitch and i'll see you there bye

Channel: Code Bullet

Views: 2,451,032

Rating: 4.9201179 out of 5

Keywords: artificial, intelligence, coding, processing, java, machine, learning, genetic, algorithm, evolution, computer, science, programming, comedy, educational

Id: D5xX6nRWDko

Length: 27min 46sec (1666 seconds)

Published: Wed Dec 16 2020

Reddit Comments

[u/MagicJinn]

I actually didn't like this video at all :(. I'd happily rewatch any video of him, but this one literally has him stealing all of the code, and then narrating 15 minutes of plane footage.

[u/KlausOnTheReddit]

The return of the King

[u/Turbo12155]

can anyone tell me what the song is at 19 minutes 40 ive heard it somewhere before i think in critical role.