Incredible face swap with AI in Stable Diffusion

hello there in this video we're going to look on new Incredible way to swipe faces with new extensions inside this stable diffusion that produce very stunning result and even more we can add complexity not just by swapping faces but swapping faces from one model and taking pause from another model and apply it so we'll have it swipe the face change the pose and creating incredible New Image as we're going along first step we need to go and install necessary extensions that we're going to use for this go to extension tab going to the available tab click on load front and from here type group or r or and it's will have this extension that we needed and it's enable face swapping this is what we going to use click on install it's if it's not yet installed next what we want to do going with control net and then control net go down where it says SD web control net manipulation and stuff you want to click on this and same click on install if it's not yet install it after this go to the tab install it and click on apply and restart I notice if you don't do this way some libraries and models won't be downloaded for the extensions we're going to use also in my extensions usually I disable extensions that I'm not actively using I'm not going to use in this project I found some of those extensions that will conflict between each other and in some cases will provide errors that it's not usable for you so in this case I disable everything and I have it only enable control net Roop is what I'm going to use and build in extensions as well after this we want to go inside the settings and the settings we're going down to the control net and control net options I want just to be sure I unchecked do not append map because I want to see what control net will create map in the end as well I set the maximum models to the three and can sketch size to the three you don't need to do this for this specific video but it may help you in the future so just general settings when you're done in the settings be sure click on apply and reload UI so we're going to use it RPG V4 checkpoint model and because we were using this with these sampling method we're going to use DPM plus to M cars as well we're going to switch to 768 height this is a recommended settings for the specific checkpoint or a model as well we're going to use the 55 sampling steps with again rpg4 recommended to use it anywhere from 35 to 75 steps this is where you can achieve the best result so let's go ahead right now and try to render see what we have so far and what I'm going to use it is photorealistic Rembrandt painting portrait of beautiful woman and as negative I'm putting nude in nsfa W and this is what we have you can of course try to generate multiple till you find something style and everything you like it when you find something that you like the style we can click on reuse seed so next Point what I want to do it is change face if we look right here you can see we have the face of the person that the AI generated but I want switch with something from photo or other person I have we've done this sum before but it was a little bit involved more steps by putting multiple control net using masking and all effect with a new the group we can do much much easier this so let's go ahead right here below you can see now we have a drop down on a group we go extend this and we'll need to put it our image in so I'm going to drag and drop image inside here this is what we're going to use Next Step will be sure we want to enable so let's go ahead enable this go down and we want to use the restore face for this be sure you check on restore faces above Also let's go decrease to 5.5 on CFG as way above scale let's go down scroll down right here we'll use it gfp gain as a restore faces and I think rest is should be just fine let's go ahead click generator now notice as we're generating it's actually going to do very interesting job so it will generate image as we have it before the face does not look very close as it's going till we come to almost end and you'll notice right here we'll have it swap the face it's happening look on this face does not look closer and now should processing command processing processing our Swap and there you go look on this it swapped face it's a perfect emerged face with position what we have before we actually can do even better than that before we actually swap the faces on this I mean it's very easy to do this we're going to use control net and in control net I'm going to take this image put it inside here enable we're going to use it actually that pause where is our open post right here there is our open pose what we're going to use and in previous sometimes I'm using canning to have its same features of the face now we don't need it because swap face take care for us to do on this one so I'm going to select open pose and also what I want to do I want to click Pixel Perfect Pixel Perfect will analyze size and resize the sampling for our control net specifically to the size of the images what we want to do so we'll leave it right there this will be by default and let's leave it balance it control mode for now be sure to enable everything and let's go ahead generate and see what's happening okay and let's look right here you can see it is probably look on this face it does not look closer but I like this moment because if you look on the server it will start all this magic happening going inside and there you go we swap it look on this we swapped in a face look similar with what we have before but it's also using control net to have the pause I signed very similar of course we can switch to random seed and try generate different ways see how that will look as well if you want different variation okay and right here the rendering again I like it look on this the faces look different till we come to our script this is nice script of the Roop which is go ahead take it and swap the face you can see how much easy and faster to do this okay let's do one more experiment I'm going to reuse a seed for this new one but I want to switch the difference so if you notice we was using JF Jane and let's go to the code former right now as a restore face if we need it and ability generate and also to the compare we'll do another ones without restore phase so you can see the different how the restore phase is affecting okay right here is almost done and this is will be with different type of restore face it's look very similar but I think other ones work a little bit closer to our original image okay and let's go set no restore faces now let's look at our result this is one with a jfp gain and this one it is you can see just slightly changed with a cord firmer and this with none obviously it's not sharper the look on this there you want to use the restore phase because that sharpness this is without and you can see definitely it's blurness right here add okay so it's add blurness to the face versus other one okay let's run one more experiment to see it I want to say to the random no seed we're going to batch count let's go to the eight different images I want to put the also cat so I actually I don't want a cut and right here if I want to spell properly okay and right here let's go it says barocco Rococo it's a type of the style it's a time periods which is also effecting on the coloring so we'll do this we also maybe let's go to s a car so it will be a little bit different our sampling method very close to what we have before remember there is star faces need be enabled here all that stuff and we'll just pop up this little bit more to maybe about seven on our CFG so a little bit more flexibility you know can create more art in this case Pixel Perfect all of this set properly I want to actually keep it a little bit more to control net maybe pauses this is kind of play around do we want to do more prompt or we want more control net so we'll see how we want to do control net we'll have it same pausing well let's do this let's go keep it post and I position similar honor we enable this one we have it in one face and remember if you have it more than one face you can specify here how many you have it and Zero by default after will detect and we're going to use it gfp gain for this restore phase one it's maximum upscaler we don't need it to do upscaler in this case because it is image higher I think it's good I'm going click generate I'm pausing this video till all generation gone for the images and we'll check them after it's done okay so right here we're done with our render let's check and this is our original image if you remember we have before I'm just open preview and this is eight images notice on this I love how lighting if you check right here see the Shadows how apply same face change on the highlights on the eyes these I mean it's done perfectly look at this this is perfect Rembrandt triangle are done with change here but same face swap I mean that is so easy so fast to do and of course we don't need to have it same pause so for example right here in control net we can have total different pose for our model we're going down and we'll have a different face we want to swap so they can reference two different images as well and let's go ahead right there we'll have it available explosion smoking something more interesting stuff going around let's go ahead and render as is rendering and notice right there we have a perfect pause from our control net so we have a position of the head everything the angle is a different right there for the face so it will be yeah I need to figure out how to take that face and swap with a different angle now and of course it did excellent job let's go check right here look on a position on eyes mouth proportion here and let's look on what we have image and you can see it is perfect it's very nice matching the eyes I'm looking on a size very nice position Nose Lips it's actually put it positioned head in different way for us but at the same time all pauses and everything it was applied to our model from control net well hopefully you found this video interesting go ahead try try play around I'll put a link down below for all the resources that you needed for this if you don't know how to install control net I will have it video also for you to check as well write the outputted video for you there right there probably right here there right there will the video be sure click on this video and watch how to use it control net how to install control net if you don't have it and as well with stable diffusion thank you again for all your support have a great day

Channel: Vladimir Chopine [GeekatPlay]

Views: 53,291

Keywords: Geekatplay Studio, Vladimir Chopine, Digital art, AI art, MidJourney, Stable Diffusion, Dreambooth, Dall-e, Free resources, Free learning, Digital art for begginers, face swap, stable diffusion tutorial, stable diffusion guide, deep fake vs original, deep fake, stable diffusion art, deep learning, stable diffusion installation, stable diffusion gui, face swap tutorial, face swap video, face swap ai, stable diffusion how it works

Id: QFanAQmJMPw

Length: 12min 37sec (757 seconds)

Published: Fri Jun 30 2023