How To Change Clothes In Stable Diffusion With Inpainting & ControlNet

hey everyone welcome back to our Channel today I've got something super exciting lined up I know you must have seen those ads for paid tools that claim to magically change your clothes in photos well guess what today I'm going to show you how to do it for free using stable diffusion with just a few clicks let's dive in before we begin make sure you have everything set up you'll need automatic 1111 web UI installed for running stable diffusion and then you'll need the control net extension for automatic 1111 installed as well to install this extension go to the extensions tab in automatic 1111 click on the install from URL Tab and enter the URL of the extensions page here click install and when it's complete restart stable diffusion once you have control net installed download the Open pose model for control net and place it in the control net folder in your stable diffusion directory lastly we'll need an inpainting checkpoint model I recommend using the realistic Vision or Clarity inpainting model as their very good download this model and place it in the checkpoint models folder in your stable diffusion directory now the fun part let's change some clothes head over to the img2 IMG tab in automatic 1111 click on the inpaint tab and upload the image you want to transform easy so far right next paint over the clothes leaving nothing out now the magic happens with prompts I'll be transforming this image into something more formal and professional using positive and negative prompts here are the positive and negative prompts I'm using for this image after that let's adjust the configuration settings I'm using the clarity in painting checkpoint with the uler ancestral sampler let's set the sampling steps to 30 and CF FG scale to S set the inpaint area to only masked and masked content to original Now set a very low to noising strength between 0.5 to 0.7 finally hit that generate button and voila your clothes are transformed but there's a catch sometimes the pose might go Haywire as you can see from this output image the pose doesn't match the original image at all that's where control net comes to the rescue let's not settle for good when we can have great if you have the control net extension for automatic 1111 installed you'll find this new control net toggle expand the toggle and enable control net select the open pose checkbox and choose the open pose model in the model drop down also enable the low vrm and Pixel Perfect checkboxes that's all you have to do we don't need to change any other setting here click on the the generate button and this time our image will be generated using control net here's the output image compared to the one generated with just in painting as you can see by using control net we were able to preserve the pose of the human this is why using the control net open pose model is extremely helpful whenever you want to change clothes in stable diffusion you can also see the pose detected by the open pose model in the output so now you know how to change clothes in stable diffusion using inpainting and control net but what can you do with this skill well here are some cool prompt ideas for changing clothes in stable diffusion the most common one is turning your boring images into professional head shot for LinkedIn or job interviews let's upload this image in the inpaint tab and repeat the same process as before we paint over the clothes select our checkpoint model enable control net and generate the [Music] image and Bam now you have professionall looking head shots that you can use anywhere besides this you can also turn yourself into a fashion icon you can find some cool prompts on our website with some examples and inspiration so there you have it with stable diffusion you can become whoever you want Rockstar Chef fashion model the sky the limit I hope this tutorial was helpful if you have any questions drop them in the comments below don't forget to like subscribe and hit that notification Bell for more awesome tutorials until next time stay creative

Channel: OpenAI Journey

Views: 593

Keywords: stable diffusion, change clothes, ai cloth swap, stable diffusion inpainting, controlnet, automatic1111

Id: uWYjx_MewlE

Length: 5min 3sec (303 seconds)

Published: Thu Jan 11 2024