Consistent Faces in Stable Diffusion

hey everyone today I'm going to be teaching you how to create a consistent character and stable diffusion so the face is going to look exactly the same every single time now one of these methods will actually work across different models the other not so much if you're going to do it with carons it might glitch a little bit but let's see how we can go so what we need to do first is we're going to need a random name generator now this is an system that we've been using for a few months now but it works and so what we need to do is come up with the name so what we want first is we'll go with a feminine name uh we'll ask of five options and a random surname and let's see we will pick let's go dutch and Spanish um you can mess around with these as well like to give you different variations and whatnot so with this it will actually mix Dutch and Spanish and it will create names that people have with those heritages so we'll generate those and it'll give us five different names as you can see these aren't very common names so you're not going to see an actor's name in this this is crucial if you're going to create a unique name or a unique character rather you don't want to name it the same thing as an actor because then it will start making it look like that actor even if that's not what you want so let's go with this first one now we'll go into stable diffusion we're going to be using realistic Vision 5.1 let's see what it gives us there we'll go with that as our sampler keep it at 20 width and height we don't have to mess with that yet we just want to see what she looks like first so we'll go to the random name generator and go this one okay we'll put that name in there and what we'll do is I'll actually bump this up so it gives us more of a portrait okay yeah that works boost this up to 10 randoms as you can see for the most part it's given us the same character like you can see perhaps this one and this one look different to the rest of them this one looks a little bit younger but for the most part they all look pretty similar let's say we want to tighten this up a little bit so let's say we want to bring this character here and bring it more in line with let's say her here there and we'll send it over CER in painting and we will select the face cuz we only want to edit the face at this point all right that one so I'm going to open it up and actually drop it into our R tab so now if you don't have RP installed you need to go into the extend extensions here available now mine won't be showing up because I've already got it installed but yours won't be so you just write rup r o in there and just install it restart stable diffusion because if you don't you might get some glitching and this will show up and we'll just drop it in there enable that let's generate it it's changed the face closer to what we actually wanted so we wanted it to be that more youthful sort of look and as you can see it's done that see this was the original it's fixed that doesn't look like that anymore looks like the younger version which is great because this way we can actually if we are going to create a Laura file with like the same picture we don't have to render 10 billion photos just to get 30 good ones the hair is going to be an issue if you want a specific style for your character um so changing their hair with this system won't actually work if you like this tutorial let me know by pressing and like And subscribe to this channel lets me know that this is the sort of content that you're into now there's another version or another method that I tend to use as well and that is let's just restart this put it at 1024x 1024 now this is quite important I've actually included white background um in the description or in the prompt at 1.2 because we needed to have a white background Now using control net which shown you how to install in the previous video so the link will be in one of these sides what you'll do is you will need to load up this image that I'll be leaving in the description I've created a face grid where you've got nine different angles of the same character now this will help you in case you're generating a face that looks to one of the sides up or down and I'll drop it into the first control now okay enable that switch over to canny but we will turn the pre-processor off because we've already created the can you can't see it here it's all black but it's all good uh control net is more important now you'll notice that with these faces sometimes certain angles don't look that great we can actually fix this within painting but it's not that crucial what we just need is the shape of the face so the we need the the same angle of the the eyebrows the same shape of the nose the lips um it doesn't matter if it's not 100% because it's not actually going to take this image and pler on top of the other one what it's actually going to do is take the shapes and then recreate the face using that okay so that's perfectly fine for what we need we'll just run off another one see what it gives us yep that's fine so it's fixed some of the glitches sometimes if you run it a couple of times it will either glitch out like crazy or fix some of the glitches so we'll send that into photo we can actually take this image crop it export it as a JPEG all right so in this case what we're going to do is we got the exact same prompt that we had before but the only thing is I'm going to take control net off go back to RP and we're going to load up that small image that we just had a second ago okay so we're going to have that one we're going to enable that leave everything as it is and we're going to going going to ask it to give us 10 images now every single image should have the same face or very similar let's see what it gives us R does take a little bit longer to process cuz what it's actually doing is it'll create the image and then it will apply the other face on top of it with the face restore now usually I'm not a big fan of face restore because a lot of the images that I do aren't photo realistic um so as I was saying before if you're going to do a Cardon I would go about using using the name method that will probably give you the same character over and over again there are going to be some times where it will glitch out it'll change the hair color it change the face of the shape of the face uh but usually using the name when it comes to a cartoon character will actually work out so let's see what it's given us so as you can see for the most part it's pretty much the same character even hairwise some sometimes it's given us like insanely long hair here but for the most part it's given us pretty similar hairstyles U for all of them the makeup tends to be exactly the same it hasn't really gone overly you know over the top I hope you enjoyed this video and if you got any questions let me know in the comments down below I'll get back to you as soon as I can in the meantime check out these other videos that I've got on my channel n

Channel: Sebastian Torres

Views: 87,348

Keywords: stable diffusion, ai art, stable diffusion tutorial, retouching photoshop tutorial, photoshop alternatives 2023, photography, ai artist, ai tutorial, controlnet stable diffusion, ai photo editing, ai photo generator, ai photo, fashion photography, use stable diffusion, how to use stable diffusion, consistent faces, realistic vision model stable diffusion, stable diffusion extensions, stable diffusion character sheet

Id: 6RP0HXYUqGo

Length: 8min 12sec (492 seconds)

Published: Thu Aug 17 2023