Runway ML Tutorial - How To Use The Best AI Video Generator of 2024

Runway allows you to turn text to video image to video and video to video that have resulted in some of the most amazing AI generated videos I've ever seen so if you want your videos to stand out online or to use it in a movie I will go through what I've learned about Runway to generate the best AI videos how to use the motion controls expand image and the other crazy effects and I'll Deep dive into my new favorite feature the motion brush so let's dive into each feature one by one so by the end of this video you'll be able to use Runway like a champ number one make an account we're now on Runway ml.com and here you can see Advanced creativity with artificial intelligence Runway is an applied AI research company shaping the next era of Art entertainment and human creativity the way you make a free account is just to click this button now just create an account you can use Google and apple and now we're on the inside if you're wondering how much can you generate for free I'll go over that when we talk about pricing later because you've signed up let's go to number two text to video as you can see on their homepage they have so many popular AI magic tools and I'm going to try to cover every single one in this video but to begin let's click on text SL image to video I'm going to make a prompt here with a kangaroo wearing oversized sunglasses writing a skateboard down the mountain there are some settings here as well that I'll show you but for now let's click on free preview the reason you want to do this is because you get four generations that you then can select between and then render out which saves you credits and there you go I really like this one as the inputs so I'm going to click on use this as the input and let's generate also I want to test if I just don't do an input just the text I'm going to generate that as well I'm going to try two other prompts as well like this Penguins having a picnic on the moon and the octopus juggling kitchen utensils we got the first generation back here whoa slow motion on this one and the kangaroo is kind of warping a little bit but pretty good so far just remember that this was with an image here is the first one with purely text generation yeah I don't know here is the Penguins on the moon having a picnic I mean this was pretty good like they just stole a pizza box and here is the octopus generation apparently the chefs are making the octopus and it didn't really do the prompt right but hey that's on me and the main issue is that it's not so customizable with only text you don't really have so much customization so let's go to if you're afraid AI is taking your job or maybe you're just stuck in a deadend job right now well I have some good news for you there are still high paying in demand jobs that you don't need any fancy degree or experience to get a job that's where careerist comes in they've helped over 11,000 students including 4,000 successful graduates with graduates over with graduates earning an average of $77,000 a year their fast-paced manual QA course is your perfect entry point completed in just 6 months with expert coaching from industry veterans at top tech companies gain valuable realworld project experience to impress employers and join a supportive Alumni network for ongoing guidance but what truly sets careerist apart happy students check intuitive learning platform check active supportive Community check this course is an investment in your future opening doors to higher earning potential and exciting career opportunities convenient payment plans make it accessible and their competitive course cost ensures you get the best value so don't let fear or lack of experience hold you back any longer it's time to take action by clicking the link in the description down below for 10% off of careerist manual QA course so you can start your journey to a thriving remote career thanks to careerist for sponsoring this section of the video so let's go to number three image to video so as you can see we're now on the image Tab and we can drag and drop an image in here I'm going to upload this photo of this weird man with with an iPad and now let's talk about some of these filters as you can see the first button gives you the seed which you can customize to keep the same style if you want to do it again interpolate Smooths out your frames upscale you can turn on automatically you can also upscale after the fact and remove Watermark then when we go to the second tab you can see General motion you can put it all the way to 10 or one and it will give you more motion and talking about motion we also have camera motion that you can customize to your heart's content my absolute favorite is zoom in and we're going to play around with them a bit the last one is motion brush that I will have an entire chapter in this video about for now let's have the general motion at 10 and click generate here is the result yeah it's definitely warping in space I kind of like that he's trying to look at the iPad like hey what's going on here um let's try to click on the image plus description to see if we can actually manipulate it a bit let's try man showing an iPad to the camera and generate again here is the second version okay that is I don't know better or worse but I can definitely use this in a video where if only the screen changes actually I like how the lighting changes around the face so this is really good I'm going to generate an image with Dolly I'll also copy this prompt okay that was not not what I was looking for but hey let's download upload it paste the prompt and this time we're going to click on camera motion I'm going to try to make a paralax effect by using the pan to the right and the horizontal to the left let's save it and generate here is the result and it actually managed to do kind of a parallax effect which is really impressive you do see that it kind of warps more but let's test something else let's do the scenic city Pull It in here prompted drone flying over beautiful Seaside City and this time I want to see if I can make the Drone go up and then tilt downwards a little bit while it's zooming in let's save here is the result and it actually is able to generate things behind the buildings here which looks so cool I actually had no idea I was able to do this the new camera motions are actually holding up pretty well I really want to try one more yeah that's exactly what I wanted let's upload prompted drone flying over New York and this time let's change the motion control to tilt even more down keep the vertical up and zoom in I'm also going to try one that just Zooms in and tilts up a little bit here's the first generation that should tilt down I mean that's incredible let's watch that one more time Jesus Christ it's almost like that Inception where where the world is bending here is the second variation that should just fly through the city and tilting a little up and there we have it Jesus Christ this is such a cool shot and the craziest part is that we can actually extend this so if I just click on the extend 4 seconds instead of 4 seconds it's now eight so let's take a look at the extended version so we still had this and now this is completely new from the extended version to me this is some of the best video generation that you can get from AI currently and I mean I'm very pleased with the result imagine using this as some sort of establishing shot I think you will see it a lot coming in YouTube videos and even Netflix but besides text to video and video to video sometimes you maybe took a video from your phone and you want to turn it into AI well that's why they have number four video to video you can find it by just going down to video to video in the bottom left and here you can drop your video I'm going to test on one of these Tik Tock dances just like this and see what happens drag it in there and it says that only the first 15 seconds of the video will be processed now that it's uploaded you can see we have all these different options to the right you can style reference from image so we can maybe put this style on top of her we have presets where they have all the clation Cloudscape even abstract and gradient and you can even prompt it yourself I found good success with the image and presets but let's just test it out let's try a woman dressed in a steampunk outfit dancing at Burning Man we can select the style strength and there is also advanced settings that we'll look at later and a big mistake here is to generate the video cuz it takes quite long so just preview the Styles first here you can see the different Generations I think we need to do some better prompting preview styles again I mean it's not really getting that much better okay let's just test this one now instead of using a text prompt I'm going to use the presets I saw this pet digital that I think looks really cool and let's preview that as well this is how it looks like yep it's like forcing a dog in there let's try sci-fi preview she turned into a building let's try the clation one this time it turned into a kid in front of her let's put the style strength to Max what have we done should we test this one write yes in the comments down below okay if you want it let's generate last one we're going to style reference from an image actually let's try this gamer girl to see if we can get any of these crazy colors I'm going to put the style strength down and they also have advanced settings as you can see the style weight lead more to emphasis on the style rather than the input video the structural consisten y tells us that higher values make the output more structurally different from the input video frame consistency basically means that it tries to keep the frames closely together they also have upscale rol Warrior Mark effect foreground only so this is kind of cool if you have a character in the front effect background only this one as well maybe masking out a character and compare wipe that will wipe from the original output to the generate results kind of like a before and after now I'm going to just keep everything on the basic and preview style damn she turned gamer girl real quick all righty then let's test it out here is the first iteration of her at Burning Man and uh yeah I don't like it it looks very kind of what would you call this kind of blurry or especially the beginning ain't that good so let's check out the other results now I do have to say that they're using gen one video while the text to image and image to image uses the Gen 2 model let's see the second example that had the clation style at 100 so it's actually keeping it pretty consistent but it gets really blurry the character does look kind of cool though so it's doing the dance and everything like that hey I mean it's not horrible and I just can't wait for it to be a little bit better like I mean they definitely have technology now to make this not ass blurry so hey I'll actually give this a thumbs up I wouldn't necessarily use it in a video there are a lot of good examples out there of people using this so I may just have to learn how to use it better here we have the last video to video that was the style reference of the gamergirl you definitely see the neon has been well it's a lot of neon here and it also looks kind of good the face doesn't look half bad here and if you ask me if it matched the style well it definitely did so now you understand video to video and you might find a use case for it but what I love to use the most inside of Runway is actually number five motion brush so you may have understood I like to start with an image or text to begin let's use this picture and then click motion brush as you can see we have five brushes to choose from and we can choose what happens to that selection so the first selection let's just select her in the for ground here just make it around her and now we can choose what happens to her so we can put her to the right we can do the vertical axis which is up or down you can do proximity which means further away or closer or ambient which kind of just screws them around a little bit for this scene I think the best would be to go to the right and go further away from the camera and then we want to apply some motion to the waves as well so I'll make a bigger brush here and I want to have this wave kind of Crash over the beach so let's put them to the right and let's add some ambient noise let's save and we'll add a prompt to the image as well and click on generate here is the result and as you can see we actually can control the image pretty well look at how beautiful the waves are actually crashing down and the girl as well seems to be reacting to the water going to to the right kind of warping a little bit of course but still my favorite way of using Runway take these Pixar looking birds click on motion brush and let's try to just animate their heads the first one we're going to look to the left the second one we're going to look up the third one we're going to look down and the fourth one look to the right let's see what happens I'm actually very excited to test this so let's generate here is the result maybe I shouldn't have put the slider so high up but this is crazy he kind of like walking away like somebody you know you don't want to tell somebody took a stinky silent killer hey bro I'm just going to back away from the space so motion control is awesome but they actually have more which is number six AI magic tools as you can see we've literally just been through the first ones here they also have image to image text to speech they have train your own generation infinite image expand image frame interpolation erase and replace backdrop remix image variation even 3D capture and 3D texture and the rest of the ones are on the screen now that can help you a lot for your specific use case and you might be wondering and you might be wondering for all of this how much does it actually cost so for the free plan you actually get 125 credits and each second of video generation you uses five credits so if you want the 4 second videos that we just created that's 25 credits so for free you can get five of the videos that I just generated this tops up monthly but as you can imagine pretty limited you can see the prices here for the monthly and this is the price for the yearly and what really changes from the free one to the standard is that you get 625 credits per month you can upscale resolution and remove water marks longer text to video and video to video and some other great perks the next level up is basically the same just more credits and higher quality exports and the same with unlimited so is it worth it well if you can only get a couple of really high quality Clips at the standard package well I'm on the $12 package where I just want a few shots to make my videos better I'm not trying to make an AI movie but I'm just trying to increase my video quality so for me to get some of these incredible shots it's definitely worth it so check it out in the link in the description I'm not affiliated with or sponsored by Runway ml I just think it's one of the best video generation softwares and if you want to see me ranking Runway versus Pika and stable video diffusion there's a video on the screen right now so just tap that and I'll see you in next one

Channel: AI Andy

Views: 32,636

Keywords:

Id: hk8l3ISfwRM

Length: 17min 22sec (1042 seconds)

Published: Mon Feb 12 2024