New in Runway - Lip Sync (spoiler alert: it's awesome)

oh hello and welcome back to learn how to edit stuff Ian will be right back but what you're watching right now is actually a lip sync which just got released into Runway all you have to do is upload an image or a video file generate or upload some audio and then you're good to go well that is absolutely bloody brilliant then you combo it all together you start to add some snazzy effects and you're star to make some really cool [Music] stuff if I can't float with the tape the paper rip it clean slate here we go dropping like gono po FL till we Bubble Up don't know all right we're jumping in the runway to check it [Applause] out so once you sign in a Runway you'll want to head to the generative audio tool and upload your media either a photo or a video or you can use one of the demo images to test it out as well for the audio portion you can type out some audio and choose a voice with textt to speech or upload your own audio file file type is going to be MP3 or wave and the file needs to be less than 60 seconds total and your image or video needs to be human or like human adjacent or like as close to human origin as possible basically have normal human facial features if you're opting to use a video clip and your audio file is longer than the duration of your video when the video gets to the end it will actually play backwards and start to Boomerang back and forth so just know that going in honestly that feature is pretty handy and helpful if you're going to be creating your video in Gen 2 which we're going to be doing today so I'll show you how to do that once we get to that part I did a weird fan thing there but we're going to go with it okay so I'm going to head over to the text to image tool and enter a prompt a medium closeup of a male Detective from the early 1900s wearing a trench coat and a hat he is standing inside of a home library at night warm color palette shallowed up the field professional portrait photography and I'm also going to add a negative prompt ugly bad deformed improper Anatomy blah blah blah basically all the things I don't want my image to be all right this image is looking good and now I'm going to give it a quick upscale with magnific to bring in some additional detail and now I'm ready to bring that image into Gen 2 so if I know my audio file is going to be short basically around 4 seconds I can make a video and add some camera movement to it to make it more [Music] Dynamic well that is absolutely bloody brilliant if my audio clip is longer than 4 seconds I'm only going to focus on some general head movements using motion brush I'm going to select his face and hat give it just a touch of upward motion and some ambient noise and I'll also add a prompt the man is talking now I have a 4-second clip of this guy talking and when it gets to the end of the clip it will automatically play Backwards in lip sync to match the duration of my audio now let's pop back over into generative audio and load in our video that we just created and we'll quickly record some audio for our character I'm going to just read off a script real quick so bear with me ladies and gentlemen gather round for the tale I'm about to unfold is as Twisted as the alleys of this godforsaken city you see in my light I've worked and night is neither friend nor foe it's a canvas painted with the sins of men a stage where the Shadows play the lead role and truth truth is a fleeing mistress always just Out Of Reach so that right there was Speech to speech in 11 Labs not a necessary part of the process but you know I'm filming this tutorial maybe I wanted to Pizzazz it up a little bit I wanted to give my detective kind of a grably cool detective voice you get where I'm going with this use your own voice use text to speech use whatever you want let's keep going and now you're going to upload your audio clip into Runway and click the generate button if you want add some additional effects maybe some color correction maybe some handheld camera motion and ladies and gentlemen you've got yourself a real Nic looking AI video ladies and gentlemen gather round for the tale I'm about to unfold is as Twisted as the alleys of this godforsaken city you see in my light of work the night is neither friend nor foe it's a canv this painted with the sins of men a stage where the Shadows play the lead role and Truth truth is a fleeing mistress always just Out Of Reach honestly super exciting addition to the runway Suite of tools I'm very excited to continue to use it and explore it I'm excited for you guys to continue using it and explore it drop a comment in the comment section below and let me know how you plan on using it and as always thank you for subscribing to my channel I appreciate every single one of you I promise I'm going to start to make more videos again I've just been really enjoying being a dad and hanging out with my son in my spare time but I'm shooting this tutorial at night I usually I shot the tutorials during the day but now we're shooting them at night so hopefully we'll have a little bit more time to make more videos for the channel thank you so much for stopping by Smash that subscribe button drop a comment in the comment section below hit a thumbs up on this button and I will see you in the next [Music] [Applause] one

Channel: Learn How To Edit Stuff

Views: 6,147

Keywords: Runway, Lip Sync, Runway Lip Sync, generative audio, how to make mouths move with audio, AI, AI lip sync, AI speech, AI talking, learn how to edit stuff, ian sansavera, runwayml, runway AI, gen2, generative video, generated video, sora, open AI sora, AI video, AI audio, AI text to speech

Id: ByQiy9yzOAc

Length: 5min 3sec (303 seconds)

Published: Thu Mar 21 2024