How To Install ControlNet 1.1 In Automatic1111 Stable Diffusion

control net has been such a big part of AI image generation for quite a few months now and today I want to show you how to install it in automatic 1111. Now by chance if you don't have automatic 1111 installed make sure to check out the video in the description below otherwise this video won't make any sense for the rest of you once you start up automatic 1111 on the top tab here you're going to see a section for extensions click on that and just below we have some sub tabs here by the way you can check for updates here so every now and then just click on this and make sure all the extensions that you have installed are updated here right beside the install tab here click on available and we're simply going to click on load from if for some reason you don't have this link in this extension URL box I'll leave it in the description below but it should be populated by default so let's click on load from instead of scrolling for it we're just going to enter control net in here and we're going to look for yeah interesting for whatever reason I don't see it in here which is very odd so the other thing we're going to do here is install from URL so I'm simply going to paste the link in here if the same thing happened to you there should have been an option to install SD web UI control knit for whatever reason it's not showing up in my available folder here so we could simply paste it there and then click install it shouldn't be too long as you see here it's processing so that means the installation is happening and then you see at the bottom here where control net was installed then we're going to go back to the install tab here we want to double check for updates and we see here that we have the latest versions and then all you have to do is Click apply and restart UI once the UI is reset if we scroll down a little bit here we're going to see a section for control net we click on this Arrow there's a drop down for all the control net settings however we can't use it just yet as we have to download the models for it where you can find the models is on hugging face and it's really up to you if you want to download all of them each file else is 1.45 gigabytes personally I'm going to download all of them myself but for this demonstration I'm just going to show you three and the main ones for basic control net posing are depth also make sure you're downloading the dot pth file and also click the arrow to download it as opposed to right clicking and save as just below is kany which detects edges and outlines so we're going to download that one too and then we have the open pose model here let's download that as well now we're going to put those files in the appropriate location so head over to your stable diffusion UI folder it should be stable diffusion web UI and within this folder you'll see a folder for extensions you want to open up that folder if you've done a fresh install most likely you'll only have this one called SD web UI control knit let's go ahead ahead and open that folder and then we just need to find the models folder and open that one up too now you're already going to see all the yaml files for control net so there was no need to download them earlier from hugging face and then finally we can go to our downloads folder or wherever you've downloaded these files I'm just going to select them all and then push them up to this folder here drag them into there and you'll see that they'll be populated in this folder and we see them highlighted here if I change my perspective here you see that they're highlighted in Gray and now let's do a restart on automatic 11 11. now on top of control net there all these other extensions that we can also add so let's go back to our extensions here let's click on available and load from and we're going to do the same thing that we did earlier and search for control knit but these are all extensions that work with control knit so we have the QR code generator the open pose editor segment anything which I'll talk about again in a different video but I encourage you to install all of these so I'm just going to hit install for this one and go down the list and then we'll cover them in future videos it doesn't take very long to install them I'm just knocking through them just a few seconds for most of them once you're through that list go back to installed click on check for updates everything is the latest so we're gonna again hit apply and restart UI now you're going to notice at the top you have even more tabs up here but the ones I wanted to highlight is the open pose editor there's also a 3D model section let's say you have a 3D model from Das 3D or something like that or you can use this 3D open pose interface as well you can move around pose the subject even down to the hands and the fingers and then we have in paint anything in QR code now that the models are loaded let's do a couple of test runs here I'm not going to go in depth on control knit today but I'll definitely dive deeper in a future video I'm just going to set my aspect ratio here 640 by 832 we're just gonna go with 25 steps and our prompt will be man in a suit just something super simple and I'm using rev animated yeah sure why not and then we're going to go down here to the drop down on control knit and first we need to upload the posing image that we want to use so I'm going to use this one you want to click on enable you can click on allow preview if you'd like and if you have a weaker graphics card you could use low vram and the first one we'll do is canny as I said it focuses on edges and outlines we'll leave all the default settings for now and we'll leave the control mode on balanced and yeah everything looks good let's go ahead and generate this first example here's a preview images not bad for a simple prompt and really default settings and as I said earlier you see the map here everything in white is the edges the outline of the subject we'll use the same image and change this to depth and let's generate this image here's the image using depth you'll notice it doesn't pick up the hands as well as edged it and if we look at the depth map you'll notice the hand here is a bit more white than everything else in the backgrounds in Black that's basically how depth works it looks at the foreground the middle ground in the background and then we'll take a look here at open pose for the last example and here's the open pose example and you'll notice that it's a very different faux photo mainly because it just focuses on the pose with Edge it could still look like the original photo as well as depth but pose as the name suggests just focuses on you know where the arm is where the shoulder is the body that kind of thing and the background is even totally different compared to the others and if we look at the posed map I think you can call it this is basically what it focuses on to create the image pretty self-explanatory right so I've got a lot of content to cover on control knit alone I also want to cover the Forum let me know in the comments below which one you want me to cover first but I'll eventually get to all of them in the meantime if you happen to be new to this Channel and you're looking to install automatic 11 make sure to check out this video and until the next one I'll see you when I see you

Channel: Monzon Media

Views: 20,716

Keywords: How To Install ControlNet 1.1 In Automatic1111 Stable Diffusion, controlnet, automatic1111, stable diffusion, controlnet 1.1, automatic1111 tutorial, stable diffusion tutorial, controlnet tutorial, ai art, stable diffusion controlnet, controlnet stable diffusion, controlnet automatic1111, automatic1111 controlnet, controlnet install

Id: EPvKNZlR9Dk

Length: 8min 15sec (495 seconds)

Published: Tue Jun 20 2023