Text to Video is Here! | Runway Gen-2

Gen 2 text to video is here let's jump into it [Applause] everyone welcome back to learn how to edit stuff my name is Ian and today is a historic day why well text to video is available now to everyone with a Runway account Runway accounts are free by the way you can go to runwayml.com and sign up for a free account right now and generate videos with nothing but text for example a beautiful lake at sunset or snow-capped mountains in Switzerland [Music] or a futuristic geometric dome made of glass in the woods the possibilities are endless this is a very exciting technological breakthrough for editors especially but content creators in general because now you can just generate the things that you don't have or generate more of the things that you don't have enough of you don't have to pick up a camera you don't have to go into after effects or Cinema 4D do any 3D modeling or simulations you don't do any of that anymore you just type in what you want and generate it and that's it you of course can use it for more traditional footage like I already showed or you can make really cool abstract things like this or this or this and this and this you can even generate animations and then Roto them and then composite them back into your video there is so much you can do with this so how do you use Gen 2 thank you for asking and I'll tell you for a thumbs up on this video a comment in the comment section below and subscribing to my channel of course thank you in advance let's jump into gen 2. head over to runwayml.com and log into your account or create a new one then find the Gen 2 icon on the home page or go to the generate videos tab from here you're going to see a prompt box and you're going to type inside that prompt box type whatever you want for me I'm going to type in colorful paint flying through the air open up the settings tab where you can choose to upscale your result interpolate the frame so the motion is a little bit smoother remove the watermark or input a seed value then click generate and after a brief wait you will have your generation and anything you generate will automatically get saved to your Runway account and that's it you have made your first generative video using gen 2. congratulations now without Gen 2 if I needed a shot like that for something that I was working on my options are actually pretty limited I can try and find something similar on a stock footage website which is going to be pretty Limited in scope and also other people have access to that footage so it's not really unique I could try to grab a camera and some paint and toss it around in my garage which would be extremely messy and very time consuming I could try to make it myself in blender or after effects and likely spend hours if not days trying to get it to work the way that I wanted it to work or I could hire a professional film crew to shoot this footage for me which would be hundreds if not thousands of dollars to produce but now as of today I have a new Option and that option is to generate exactly what I want exactly when I want it and it only takes a couple of minutes and a few credits and I don't even have to leave the comfort of my studio life is good now with any AI model that you're using your results are going to boil down to prompt engineering but luckily Gen 2 works really well with simplified prompts as well as complex prompts so you should be up to the races pretty quickly for example I would type in a tree and get a result that looks like this or I could say a tree on a grassy Hill in the American Midwest and get a result like this or a tree on a grassy Hill in the American Midwest in the style of professional cinematography shallow depth of the field subject in Focus beautiful lighting smooth Dynamic motion and get a result like this or switch it up and say a 2d animation of a tree on a grassy Hill in the style of hand-drawn animation 2D character animation cartooning Style now for me personally I like to set my prompt structure up in this way you do your initial prompt first followed by in the style of and then after that you add all of your style modifiers and I've experimented with quite a few but what do I know I only work it Runway so right now I'm going to take that tree prompt and I'm going to demo some of my style recipes for you guys I will put the prompt up on screen so you can copy my homework if you'd like let's roll it thank you oh I forgot to mention if you want you can add an image reference to a company your prompt the image reference is meant to enhance your prompt with things like color palette and general structure and is not meant to be an exact one-to-one video representation of your image that being said adding an image prompt can definitely add amazing qualities to your generations and once you've mastered the prompting you can take it one step further and add color grade to your footage to make it a bit more Dynamic maybe add a denoising pass on to it or perhaps some film grain whatever effects you want or need to add after your generation is complete feel free to do so to spice things up a little bit and that's it that's gen 2. it's pretty crazy you can do a lot with this technology but I do want you to understand that this technology is still extremely new like as I'm putting out this video it's just been released to the public new like have you ever seen film footage from the early 1900s it looks nothing like what you see today because technology evolves over time and that's what we can expect with Gen 2 right today is the worst that it will ever be and it's only uphill from here and with any new introduction of Technology there comes some element of retraining your brain and understanding how to use something brand new in order to benefit you and your workflow but luckily I'm here to help you on that journey and with that we have made it to the end of this very exciting Gen 2 video I'm excited to use it more myself I'm excited for you guys to go out there and use it right now life is good we're all very excited about it if you like this content and want me to do more Gen 2 Explorations on my YouTube channel give this video a thumbs up so I know that you like it and the algorithm likes it so I can make more content like it and of course if you don't want to miss a future video make sure you subscribe to the channel and click that notification Bell and if you just want to say hi or compliment my trees drop a comment in the comment section below I'd appreciate it all right now go get out of here go to runwayml.com right now sign into your account or create a free account if you haven't already and go play with Gen 2 and take your imagination and put it into a computer and create infinite things my name is Ian this is learn how to edit stuff and I will see you in the next one [Music] thank you [Music]

Channel: Learn How To Edit Stuff

Views: 13,659

Keywords: Runway, RunwayML, Text to Video, AI Video, Create video with text, Text to Video Generation, video generation, learn how to edit stuff, ian sansavera, video editing, video creation, generative ai, ai video tools

Id: p_N1fjXrIbs

Length: 6min 28sec (388 seconds)

Published: Wed Jun 07 2023