Use AI to swap characters in any video (Viggle Full Editing Guide)

this right here foreshadows the future of AI video creation this type of Technology will be the reason why millions of people will start creating videos with AI this is Lil yotti coming out at his concert that he's performing super dope video AI warper was smart enough to use vigle and put the joker as Lil yachty and you're like how did you do that well that's what this whole video is about I'm going to talk about how you get a character with only an image of that character onto a video and look it you get the front of the character the side of the character the back of the character all from One Singular input image all right so these are the six things I want to discuss in this video and I'm going to go rapid fire I'm not going to waste any time we're going to talk about why this is a new type of tool and why vigle will be the most popular I want to talk about the process so how vigle Works we're going to go over some examples we're going to do a basic tutorial then I'm going to discuss how you can actually take these outputs and improve on them and then we're going to discuss how to create a music video with these AI tools let's dive straight into it so vigle very simple all you need is an image of a character and then a video of a character's motion or you can use a text prompt the character in that image will then take the character's motion and it will create a moving character so ultimately there's two types of things you can do on vigle and in order to create anything you have to go to one of their 10 animate channels so there's two different types there's mix and animate let's start off with the mix one so I'm going to go ahead and use this image of me that I created on Mid journey and I'll actually show you later how to create uh images of yourself on Mid Journey this one is a little cartoonish slightly for the video I'm actually going to use this video right here this is the video that I'm using of this person coming up and doing this little dance move in this Warehouse here and so after we do that all we need to do is select a background I always choose because I like to do post- production editing and we can turn the fine tune on which makes it slightly higher quality so now let's go ahead and run this while that is running I'm going to do another one which is animate which for this one all you need is an image because we can use a text prompt so let's go ahead and drag an image in of myself right here that same image we're drag it in but instead we're going to be using a text prompt and these basically point at other popular videos this one is Joker blowing up the hospital and so we can do that as a motion prompt and we can choose this for a background from template and then finetune on so these are done I blended this image with this video right here and this was the result look at that that's so solid and you can see here it makes it on a green screen and we can actually make this this higher quality which I'll get to in a little bit and then here this was using the animate the image that I put in and I used the motion prompt Joker blow up the hospital and it referenced that video and here's the output this one isn't on a green screen not too bad I mean look that does not look too bad and again I'll show you how we can make this look better so I just showed you an example of both we used a video prompt which was the one of the guy dancing in the warehouse and then we used the text prompt which was the uh Joker scene and both created a moving character of the reference image so now that's basically how vigle works and so let's look at some ways that people are using it so this is Eric who's very talented with like control net and he used that same input video as I did except he used some additional layers on top of it and I'll actually get to the layers that I use on top of the video in a second but look at how clean this looks it's just so damn consistent and just got great like detail on the clothes and I just think it looks very good and so here this person created a video and it's kind it's of this statue and soono see that now it turns it in and it starts dancing thought that was was pretty creative and so this was mazad HRS and it's not just like lifelike images look at this one you can actually take these draw images and you can actually create these like colored pencil drawings on Mid Journey you can just generate them and then you can remove the characters you could then create the background and then have those characters move on the scene and I think this is very interesting this is a viral video that I made of Sam mman and uh ilas sudk but you can do like choreograph dances and so now that we've done a basic tutorial and we've gone over some examples now let's go uh to the fun part which is actually using tools to improve the quality of the of the outputs so this video right here is straight out of vigle the first thing that we're going to do actually is we're going to use topaz Ai and so we're going to go ahead and we're going to upload a video here we're going to upload the video in topaz and this is an upscaler so we're actually going to 2x upscale this thing and we are going to use the iris model because we really want the face detailed to be recovered so let's go to 7 days and the input condition let's go low quality and we are going to now hit export and this should take a few minutes all right so now it is done so we can click here to view the export let's take a look so this should be in 4k and it should be significantly higher quality I can already tell the face is higher quality and just the overall body looks higher quality yeah that looks a lot better wow and look at that that's pretty solid kind of looks like me so now that we have this video we can then come to face Fusion that I'm using on run diffusion we can upload the video right here now we need a photo of me which is just a screenshot right here and it should find the reference image let's go ahead and we are going to do a face swapper then a face enhancer and raise the face enhance to about 95 and let's see what this does and now it's done and so face Fusion is being used here to basically fortify my face on the already upscaled version of vigle so we took the output of vigle upscaled it using their face model which didn't know my face it just smooth the face so it was just more consistent and then we use face fusion and a face enhan ener on top of that so there's basically three different enhancers on top of the vigle output and let me show you the difference between the two so let's go ahead and download this so here is that version Look at how clear that my face is the entire time there's no inconsistencies see like right there it kind of goes out of focus a little bit but it basically maintains my face pretty well the whole time it's actually very good from this angle right here and so this is what this version looks like so here's the original look at that so it's like flickering the face is flickering doesn't really look like me super blurry and here it is now there it is three layers of enhancements on the top and so now we're going to grab the lyrics from jigle jiggle which is like my money don't jiggle jiggle it folds I'd like to see you wiggle wiggle for sure it's like a meme or something from like a year ago but we're just going to paste this into sunno and we're going to do it on the custom mode so we can use our own lyrics and um we're going to do a quirky tune so this is the song that I like the most so here check this out [Music] and so what I've done is I used an app called replay that's free to stem out the vocals from that song and so now we're going to upload the first 15 seconds of the stemmed vocals and we're going to go ahead and put these here it's already uploaded we're using a lip Sinker then a face enhancer now let's start this okay so now it's done and keep in mind this is just the stem so I'm going to put the entire song on it but this is what the output looks like sounds like okay so it looks it looks okay but it's GNA sound a lot better with the full song watch this so now that we have that what we're going to do is we are going to open up Premiere Premiere Pro um and now what we're going to do is we're going to go to new project vigle we're going to create a new project on Premiere now what we're going to do is upload those two things if we want to create a music video um or just like a music snippet or a character singing so this and this import now we're going to drag these in like this Yep this is lined up so we'll mute this layer this is what it will kind of look likey don't fle fle it folds I like to see you okay and so maybe we could make this bigger like we could uh we can go like this so we can zoom in maybe a little bit right [Music] [Music] here and so since it goes out right here maybe we can zoom in on like behind him like this [Music] and so then we can grab the whole thing we'll create a quick uh nest of everything and then we'll do a little color correction to make it look a little bit better if you do some color correction then it'll kind of blend my guy who kind of looks out of place from the rest of this video um and so like if we just click on one randomly now it kind of looks the colors kind of coming together the intensity doesn't need to be that high but we can take a look here my money all right so now all we need to do is add some subtitles here let's go ahead and we are going to hit text create caption from transcript and we're going to have to do some manual work I bet it's not going to pick up my money so my money don't Viggle Viggle so now we have the correct captions added all we need to do is select all of them now we're going to go to the essential graphics and hit edit we're going to move these to somewhere in the middle maybe down a little bit and then what we're going to do is we are going to change the size to like 70 now we're going to use New Order which is my favorite and we're going to go and we're going to definitely change the color not sure what two yet let's go like I love this like dark orange with a very thick stroke um maybe go seven right [Music] there all right that about does it now let's export this bad boy all right so there you have it don't fle fle it folds I like to see you vle anyway that's it so vigle it allows you to do some stuff and then you can add some uh cleaners on top or some upscaler and face fusers on top to actually give it some stylizing other people use animate diff you can use all different types of tools to rest stylize and yeah so this is what we went over it's a new type of tool I believe that people are going to be super excited about a tool like this because of the fact that they can use their existing footage they can use their friends directly in these videos and then they can uh use vigle to kind of bring new life to these videos and we went over the process uh we looked at you know what the basic process of vigle is we looked at some examples some ways that people are using it we did a basic tutorial in this video I used face Fusion which is on run to Fusion I also used topaz Labs which is a little bit more expensive but that was to upscale it and improve the face using the iris model and then we created a little music video with it using the face Fusion lip sync model which isn't very good yet I was just showing you some ideas in the future you're going to be able to add lip movement to it and it's going to get significantly better within the next month one month to three months it's going to be 10 times better mark my words I've seen some demos already and yeah that's kind of how I see it all playing out and yeah we created a little music video did a little bit of manual editing in Premiere Pro yeah so thank you guys for watching and I'll talk to you guys later subscribe

Channel: Riley Brown

Views: 4,266

Keywords:

Id: LlUQkVZdHnM

Length: 14min 26sec (866 seconds)

Published: Tue Apr 16 2024