ComfyUI EP06: Using ControlNet in ComfyUI to Control Results as Desired [Stable Diffusion]

[Music] hello welcome to configure a tutorial episode 6 in this episode I will explain you how to use control net to control the result of your image to start using control net you have to download more custom nodes first so let's go to the manager and go to install custom node in this custom node you search for control okay and you will find that there will be the control net preprocessors and you click install and this this one is said that you need to download the required model from the install module okay so we have to install two things first is this custom node and the second step is the model okay so I will install custom node first and just tell us to restart configure right here and it will download many things for you okay after you finish installing uh control net preprocessor custom node now you should have this one as no add node and preprocessor if it's not available for you you should check the installation with you can fix it by update the configure and manage it again okay to update you go to your computer I folder and go to update okay and configure and python dependency okay this one if you already update it will be this short sentence that is okay if you tell you that you get the last change okay let's just change and if you press and here it will try to check all the requirements that you have to install okay and if you finish this and you should restart home for you again it should be okay and you should have pre-processor node okay after you finish installing the preprocessor now you can use it you can right click and add a preprocessor in the preprocessor there will be many stuff that you can choose I will choose the one that easy to understand first which is the pause you can choose the open post preprocessor if you look at this node it requires the image input and output as image so if you want to understand what this stuff do so you have to load image as the input and I will use our image that we already generate in the previous episode so I open the image the one that we already did okay this one and then we will try to preview the image output first to understand what this node do for us okay if YouTube prompt it will try to detect the position of the pause of the our reference image okay it will detect hand detect body and it takes place because we enable it okay if you don't want to detect the face you put it disabled and if you cross it again the first will be disappear okay if you don't want to detect and you disable here you can choose or you want to detect only the first is up to you okay it's up to you for now I will detail uh everything first to get the result of this open post image okay this open post image this image we can use to control the stuff of our output for example if I want the woman to wear the yellow t-shirt okay I put the yellow t-shirt in the prompt and here from you will see that she is wearing yellow t-shirt however the post is changed right because we change the prompt and many things can change after we change some prompt so if I want to maintain the post from this post okay but I want the yellow t-shirt so I have to use the control net to control it so I I will try to use this image to control this but to do that you have to use another node okay it's called you search for control you will see that control net apply okay content apply it input many things but output as conditioning okay so it means that control net actually control net is the thing that can control okay can condition something of our case sampler so the thing that it to make it work you put the original prompt to be the conditioning to make it past the control net node okay and output conditioning F to be the and output is conditioning to be input of K sampler and I put it in the positive note okay and image this one also require image so we use the image from the preprocessor okay and I use this one this one has to come from the the image that already pre-process something for you okay and for the control net you drag out it you can choose the control net loader this one can choose the model of the control net if you don't have any model here you have to go to manager and install model and search for control and then I I suggest that for this tutorial you need you need this one open post okay and the tie okay and I suggest that you you should download the depth and line ads too okay this stuff like that open post depth and tie okay this stuff is the model that very very powerful so if you already download and you hit refresh now you can choose that model in this node for this one if I want to use this open pause to control the pause so I have to choose the open post okay after that if we already connect everything that not only the tips prompt to be conditioned we also use control knit to add more condition okay and if we queue from now you can get the result that is the woman wearing the yellow t-shirt but has the same pause okay same Force as this original image so it you can also change many stuff right so you can change the prompt to be maybe beautiful oh no no beautiful maybe is the handsome handsome man handsome Asian adult or something like that to make the result as male okay however this meal face also has the control from from this face so maybe the face we will look like look more like a woman okay so you if you don't want to control the face so you have to disable the detect first okay this is about it and he'll prom again with this option the image we will not control the face so the face can can also change more than before okay it is look more male or or you can put his angry face [Music] and Griffiths you can also do it because you you don't have any control of the face of the original image okay you want me to angry most so you put more weight and Q from you super angry okay this one is the basic of the to use control knit to control the output however if you change the reference image to be the uh maybe image that is not human for example it's the cat if it's not human this preprocessor open post preprocessor cannot work if you try the result of the process it will be blank and it cannot control anything okay so if you want the reference image that is not human you cannot use this open post preprocessor you can use other preprocessor for example the debt for now I use solid that depth map preprocessor if you change to be this one then preview image and use image to apply to control net not the open post one okay this one I delete I use sewing map that's map instead okay so I delete open Plus preprocessor and I will try the same problem okay it's still handsome Asian man okay and we try to control by using that oh the result is strange because we still not change the model okay we still use the model open post to control the result but control using this that so it's not uh it's not mesh okay if you use that to control you have to use the deck model okay and try again and it will now control by using that and create this angry man Catman or something is controlled by the dead okay and you also can specify the strength to control the result maybe only 70 percent of 0.7 so the control will be less is uh look more like a man or something like that it's super strange for now so if this is called this preprocessor and this model okay but for now I will explain you another model that can help you upscale the image better than previous episode okay so let's go so I will load the existing workflow from the one that we got problem from previous episode which is the one that we used hi if you remember this this one I will try to kill prom again for you okay so you see the result that is very ugly and very strange this one we use ultimate SD upscale to upscale using Thai which we have a highly noise strength is 0.65 is very high if it's very high it can generate some separate image and try to put it back together as one image this is the problem of our previous episode right let's see the result first see this one is super strange because 3 noise is very high so to fix this problem you have to control something so I will use the preprocessor first control net preprocessor but we use Thai High pre-processor okay and we use the image as as input okay and maybe we preview this output first but what what is time this preprocessor is make the original reference a little bit blurry and and to to make it try to control over our picture so if you've got already got the preprocessor now we have to load controlling model right use content apply and use image from preprocessor to apply control net and conditioning we use from this one okay use condition from positive from and output condition to positive of ultimate SDF scale and for the control net model you use control net loader and you use the tie okay tie if we config like this and kill prom again now the content will use this reference to control all our picture for you and let's see the result you see the result is is not not another woman it's the same okay the same outfit but has more detail you see so it use this picture to control over all image however if you look at the result it still has some strange stuff okay and some blurry stuff is because the preprocessor is blurred image too much so you have to lower this value okay maybe only one is okay if you put only one and try to kill prom again you see that the pre-process image is is more look like original one okay so it can control more let's try another let's try to see the result you see this time is is much similar to original image however if you want to to be exactly the same as original image you should lower this this noise okay you can use maybe only 0.35 and used with the control net it will ensure that there will be no change okay you use the loading noise value and use Ctrl net to control more again you will see the result you'll see this time is much similar to the original one okay and it's better than not using any control net so this is how to use control net with ultimate SDF scale okay to use the multiple control knit together you can do it too first I will try to copy all of this node to be to paste as another set of control net so I hold down the Ctrl and drag to select all this node and copy and paste after you paste if you want to move it all together you hold the shift and drag okay for now you've got another set of the note so if I want to change the reference image a little bit to use this woman host and use this background okay so I have to change the preprocessor maybe I will use the that again put its image and image out to control it and so the preview image is preview from pre-processor right and we have to change the model to be the date and to make it work okay to make it work you have to chain and connect the control net together so instead of use this conditioning directly at Key sampler I use this conditioning to change to another control net and use the output of the second control net to the case sampler here so it means it's chaining like this this one and this one okay and we will try to look at the result first if it's good or not if it's not work we have to change the strength okay let's try first you prompt got this open pause and cut this debt okay this depth and the result is look like this okay uh is because this depth has the white area here here the white area is is mean in the front and the back area is in the black so it's uh it try to control and use this both control together at the same strength is not okay so I will lower the value of the street maybe only 0.6 lower the strength of this death control so let's try the to see the result again now the woman has the body you got the the strength from from this open post more and for the background you you lower the strength so it's still okay even if I put this problem you see in the coffee shop so they they might try to make the street has coffee shop somewhere I don't know but this control next can control the result together with your prom okay so it might be better if I don't specify it in coffee shop okay and maybe well maybe on the street okay on the street it's might be better no this is the power of control net and of course you can mix and match manage stuff together and you can manipulate the pre-process image first and let it combine in the more advanced way than this which I will explain to you in the future episodes okay but for now so I think it's a little bit long for this clip so I have to end it here thank you for staying until the end as always thank you bye foreign [Music] [Music]

Channel: AI Angel Gallery

Views: 6,787

Keywords: ai, stable diffusion, comfyui, tutorial, ai art, digital art, generative ai, สอน, เอไอ, artificial intelligence, sd, controlnet, tile, openpose, depth map, ultimate sd upscale, control, preprocessor, manager, model

Id: B6qilXLls0o

Length: 21min 13sec (1273 seconds)

Published: Fri Aug 25 2023