How to Install ControlNet for Stable Diffusion's Automatic1111 Webui

hi I'm Opie and today we're going to take a quick and dirty look on how to install control net for use in automatic 1111's web UI for stable diffusion now control net is a neural network interface structure that allows for better control of your diffusion models by adding additional constraints at least that's what it says according to the website simple terms it helps you generate better and more controlled outputs of stable diffusion now in this video I'm going to guide you through the process of installing control net including the necessary libraries and extensions and downloading the required models so let's begin before we can install the extension we first need to make sure that the opencv library is installed now you'll do this from a command prompt if you're on a Mac or Linux hopefully you already know how to open the command prompt if not Google is going to be your friend here since we are on Windows here though I can show you if you need to get to command prompt quickly you can open up the folder that you have automatic 11 11 installed in you can right click anywhere in the folder select open in terminal and that will bring you to a command prompt from there we will issue the command pip install opencv tag python and after a brief download depending on how quickly your internet speed is it should install opencv and we will be ready to move on to the next step so now that we know we have the opencd library installed it's time to install the control net extension into automatic 1111 and here's how we do it first we want to make sure you have your web UI interface open and you want to go to the extensions tab which you'll find across the top here at the end inside of here you'll go to the tab that says install from the URL and inside the URL for extensions get repository you will place the URL obviously for the git repository now don't worry about typing that out it will be down in the comments section where you can copy and paste it that way if you're like me you won't accidentally misspell something and have everything not work correctly once you've got that in place just click the install button and after a few moments it will download the extension and tell you it's installed into your folder and it will tell you to use install tab to reset so the next thing you'll do is you go over to installed here uh it's I like to be sure to check for updates make sure that uh the extension the control net is checked there hit apply and restart UI and that will activate the control net extension you'll know that's done correctly if you look down here either on text image or image to image you'll have a new section down here that says control net but you know be able to open it up you'll see all the options for it congratulations you have the control net extension installed we only have one more step before we can use it and that's to download the pre-trained models now that we have the control net extension installed we will need to download the control net models the original models are available on huggingface.co but they're very large each model is around six gigs roughly for a total of somewhere in the neighborhood about 45 gigs you are definitely welcome to download these models and these models will work just fine however as of the time of the making of this video a wonderful user named The Ally has created pre-trained models that are less than one gigabyte each now these can be found on civiti.com and uh you can find them under the user the alley you can search for that you can search for control net or I will leave a link in description for how to get to either of these sets of models now either way you will need to download um at least one of the bottles to use I strongly suggest actually having all eight of the models uh and you can find them uh if you're doing the hugging face route you can just click on the download file button here to download each one of the individuals if you ever can eat depth HED mlsd normal open post scribble and seg or if you're on the Civic AI you can find scroll down uh form on the page where you can find the models and you will find each one of those here and you can go through each individual model and there is a download button over there for each one of those and you'll simply click on it to download it once you have downloaded all of the models you will need to put them in the stable diffusion folder under extensions under SD web UI control net and there's a folder in here called models and they will need to be placed right here and as we see here I've actually copied in uh the models that I already have downloaded I actually have the the full models uh the six gig versions and then the smaller less than one gig versions uh both of the um ones that the alley made and there there are two versions there are the pre-trained models and then there is a pre-trained difference once we have all of those there they're not required you are however required to have at least one model and obviously what you can do to make sure that works is you can back in to your stable diffusion back down into your control net click on the refresh button here and you should see all the models now listed now each model needs to be paired with the appropriate preprocessor for example if we can use canny you need to use either the originally trained candy model or one of the pre-trained candy models down here same with depth and depth lures HED depth and diplers both use the depth models uh HED uses the HDD model obviously mlsd here uses the mlsd model here normal map uses normal uh normal models here open pose and uh uses open pose as well uh scribble and fake scribble both use the scribble model segmentation used in the SEC model I honestly don't know what uh pity net uses so if you know that feel free to leave it down in the comments but these are obviously you need to pair the appropriate pre-processor with the model however use of the particular use of control net is not in the scope of this particular video this is about installing it and if you've reached this point you have successfully installed the control net for automatic 11 11. now there may be one issue you might run into and that's what we'll take a look at next now some people have had issues where they were running an older version of radio when installing this extension and we're getting radio errors when they're trying to generate I don't have any sort of um screenshots to show you what that looks like but if you are trying to generate images with the control net and are getting gradual errors you can fix that by upgrading the version of gradio that you have to 3.16.2 now in order to do that we will do that from the command line so we will bring up our stable diffusion folder uh if again if you're on Windows if you're on Mac or on Linux just go ahead and bring up your command line like you normally would right click inside of here if you're on Windows and go to open internal which will give you your terminal screen here and the command to install this specific version of radio is PIP install radio equals equals 3.16.2 and if you don't already have that installed it will go ahead and run the downloads and install that for you good have everything working and fix any issues you may have with radio so you basically give the command as you see here it does a bunch of uh downloads for gradio and gets everything all set up and installed once it is done you should be ready to go and there we have it once we get to this part here it is installed and you should just be able to uh restart your stable diffusion and theoretically that should work if it doesn't I strongly suggest reaching out um wherever it is that you get your information um and seeing if somebody can give you some assistance with that but that is how you install control net for automatic 11 11. hopefully you found this video helpful as far as installing control net for automatic 1111 for stable diffusion if you have any uh questions or any additional videos you'd like to be made just drop them down in the comments and have yourself a great day

Channel: TheUbie - Music, AI, and more!

Views: 61,284

Keywords: stable diffusion, stable diffusion tutorial, ai art, controlnet, stable diffusion automatic1111, stable diffusion automatic1111 controlnet, automatic1111 tutorial, stable diffusion ai art, howto, controlnet tutorial, controlnet install

Id: LnqNyd21x9U

Length: 9min 19sec (559 seconds)

Published: Mon Feb 20 2023