How to Create A Short Film with AI | Midjourney & RunwayML Tutorial

imagine a world where you can create entire films with just a computer and an internet connection it may sound like a dream but that future is closer than you think in this tutorial I will take you behind the scenes of my latest project and show you how to use AI tools to not only come up with a story but bring it to life it's never been easier to start making your own AI powered films so let's get right into it so first things first come up with a rough idea for your story line you can develop it on your own or get some help from your AI assistant Chad GPT to come up with a shot list and detailed description of your main character to make things easier I've prepared a prompt that you can use to get chat GPT to describe the main character develop the story and break it down into scenes just replace the story synopsis with your own and send the message once you receive a response take a look at how chat GPT interpreted your story you can refine it further if needed by using additional prompts when you have a list of shots that you're happy with you can move on to the next step so I know a lot of us have these big exciting creative goals for 2024 whether it's building a side creative business or learning a new skill and it's natural to wonder where to even begin skillshare is the sponsor of this video and let me tell you why it's the right platform to Kickstart your goals skillshare is an online learning community with topnotch classes created by industry leaders and it has these custom learning paths that are handpicked just for you and are designed to take you from beginner to Pro in no time these learning paths are meant to guide you through the learning process let's say you're interested in learning animation this learning path right here is designed to teach you the principles of 2D animations and how to create a storyboard from scratch you will learn all the way until you're ready to bring your animations to life using specialized tools and create stunning animated scenes skillshare offers learning paths for different experience levels and a variety of categories like graphic design specialized tools like the Vinci and blender marketing and much more so if you want to invest your time in learning something new this year skillshare is the perfect platform to take your career skills or side Hustle to the next level and if you're one of the first 500 people to sign up through the link below you will get free access to the entire class library for a whole month to turn the story into visuals we need an AI image generator if you're familiar with generative AI you've probably heard of mid journey in my opinion it's the best image generation tool available right now mid Journey works on Discord and I'll provide the official guide below which will help you set it up when you reach step five type SL settings in the chat box hit enter and here switch to version 6 for more realistic images now you're all set to start generating images for your story to do that select the/ image command here's where you need to type in the scene description that you generated using Chad GPT as the prompt for your image I recommend using this structure start with the camera angle followed by the detailed character description and then pay in the scene description before running the prompt I usually double check the keywords to make sure the scene is properly described for example Chad GPT imagine this as a daytime scene but I prefer it to be at night instead so I'm going to change that you can also add additional keywords if you see fit but try to keep it simple at the end of the prompt you also need to specify the aspect ratio of a generated image for me I aim to Output my final video in 1080p so I'm going with 16 by9 simply type in two hyphens followed by the ratio then hit enter to generate the image mid Journey will take a few seconds before showing you four amazing and detailed images to choose from if you're not satisfied with any of them you can click here to generate more variations and if there is something specific you want to change or improve in your image simply modify the prompt and generate again once you're happy with the results the U buttons below the images allow you to select your chosen image for example if you want to use the fourth image simply click on u4 to separate it then right click on it and choose save image to store it on your computer I recommend saving a few images that you like and making a final decision later on once you have a collection of usable images for your entire story you can consider factors like color and character consistency to short list your selected frames in my project I numbered the images in chronological order to keep everything organized so I spent quite a while trying out different AI tools to animate these images One tool that caught my attention and has been gaining popularity lately is p Labs many of you requested a tutorial on it so I gave it a try unfortunately the results I got were nowhere near what I expected if any of you manag to get good image to video results with pabs please let me know in the comments below another option is stable video defusion and I do have a video on how to use it however the setup can be a bit complicated and you have limited control over the movement a hassle-free solution is to use genu from Runway ml I chose this because the runway ml subscription comes with a whole set of powerful AI film making tools that you can use directly on your browser the also have a library of video tutorials to help you get started and I will leave a link to it down below once you're logged in Open genu click here to upload your image here you can adjust some essential settings before generating click here first and make sure you enable interpolate upscale and remove Watermark click here to adjust the intensity of the general motion you want to see in the scene or you can use the camera motion settings for more control which I tend to use most of the time here you can be more specific with camera movements like panning and rolling I usually slightly adjust both pan and zoom settings another useful feature is the motion brush which allows you to apply motion controls to specific areas however I won't be using it today instead I will go ahead and generate using my current camera motion settings after processing this is what I ended up with just keeping in mind that sometimes you will get great results on the very first try while other times you might need to adjust the settings and generate again until you're satisfied with the outcome you can also use the image and description tab to add keywords for any moving elements you want in your scene to guide the AI even more there's no magic formula here so make sure you experiment with different settings for each image once you have a result you're happy with go ahead and click C here to download the clip I have all my Clips in one folder and I've named them chronologically now you might be thinking we're pretty much done here but in my opinion the next step is where you can really get creative and make your project stand out to edit the final video I'm going to import my Clips over to premere Pro now if you're not familiar with premere Pro and want to learn how to use it to create professional videos I highly recommend jordy's new class on skillshare which I will link down below this class will help you get started with basic editing techniques video effects and so much more I'm going to show you a quick breakdown of my editing process in this project start by dropping all the clips over here to create a new sequence I found the perfect music track on epidemic sound based on which I've adjusted the video Pace I've also added some sound effects to bring everything to life once I was done with that I got several stock footage and Motion Graphics from invat Elements which I overlaid on top of certain scenes another important creative step here is color grading and this will depend on the final look and feel that you have in mind I will make the project file available on my patreon so if you're subscribed thank you so much for your support and feel free to grab the file to get a closer look at my settings and how the edit was put together to export your video press on contrl and M here you can adjust some settings set the preset to Adaptive High bit rate I usually enable render at maximum depth and use maximum render quality down below if you're exporting in 1080P you can increase the target bit rate to somewhere between 25 and 35 click here to choose a saving location and finally hit export to render this sequence and hey if you make something cool using these tools please share it to the world and make sure you tag me if you got questions or ideas for what I should cover next drop them in the comments below and please make sure to like this video if you found it useful other than that stay creative and I'll see you in the next video [Music] [Music] peace

Channel: MDMZ

Views: 63,425

Keywords: ai video generator, ai video, text to video, ai movies, ai filmmaking, text to video ai, runway gen-2, ai video generator free, ai video editing, runway ml, ai short film, image to video ai, animate images with ai, ai movie tutorial, gen-2 tutorial, midjourney tutorial, ai tutorial, ai video maker, runway gen 2, ai video editor, ai animation, how to create an ai film

Id: 6qOjhiYvmgE

Length: 9min 55sec (595 seconds)

Published: Fri Jan 12 2024