Stable Diffusion Now Has The Photoshop Generative Fill Feature With ControlNet Extension - Tutorial

Greetings everyone. As you know Adobe Firefly announced the industry shocking generative fill feature and now it has come to our most beloved extension ControlNet. Today I will show you how to use it. First of all update your ControlNet extension to the latest version. Restart your Automatic1111 web UI. Make sure that you have downloaded the necessary models from this link. For this to work we need inpaint model. Click here and download. Put the downloaded model inside your sd-webui-controlnet models folder. Open your Automatic1111 web UI. I am using realistic vision version 20 for this experimentation. You should see ControlNet version 1.1.208 here. So this is a real image that I am going to use as an example. We are going to use text to image tab. We are not using any prompting. I am using the best VAE file here. If you want to see that VAE file on your screen like me go to your settings tab. In here you will see quick settings list. When you click here you can see the quick settings and select them like me. Then restart your web UI after saving. Okay then I will select my downloaded image which is a real image like here. I will mask it for example like this. I want to do generative fill in this part of the image. Now it is much easier to use ControlNet with predefined selection. Select inpaint. You should get preprocessor inpaint here and you should get the model here. If it doesn't see model click here and it will refresh. Select pixel perfect. Select enable. Select ControlNet is more important. Select original resolution of the image. The image is 1280 to 1024. Then hit generate. You don't need anything else. And here the ControlNet generative fill method. Let's compare it. So on the left side we see the original real picture and on the right side we see the generative fill feature of ControlNet and it is amazing. And this is 100% free running on your computer. You don't have to pay expensive Adobe subscription and it is just amazing. You can also play with other sampling methods and see how it is working. You can also apply high resolution fix and see how it is doing. Please make a comment and tell me your ideas. If you don't know how to install ControlNet extension don't worry I have excellent tutorial for that. Sketches into epic art with 1 click. In this tutorial video I have explained how to install and use ControlNet. Moreover, in this new style transfer extension ControlNet of Automatic1111 tutorial I have shown how to do a fresh installation of Automatic1111 web UI and also how to install ControlNet extension. I will put the links of these tutorials into the description so if you don't know how to install ControlNet don't worry just watch these two tutorials. If you have enjoyed please like, subscribe, leave a comment share. If you support me by joining on my Youtube channel or on my Patreon I would appreciate that very much. On the description of the video you will find our Discord server please join there. I also have released amazing DeepFake tutorial video as well you may want to check it out. Also our discord server is keep getting bigger. Please join and enjoy the latest developments in the Stable Diffusion and Artificial Intelligence. Just click join server. Hopefully see you in another amazing tutorial.

Channel: SECourses

Views: 21,643

Keywords: stable diffusion, stablediffusion, controlnet, control net, adobe, adobe firefly, photoshop, generative fill, generativefill, adobe generative fill, photoshop generative fill, adobe photoshop, firefly photoshop, extension, automatic1111, automatic, automatic 1111, web ui, stable diffusion web ui

Id: ot5GkaxHPzk

Length: 3min 35sec (215 seconds)

Published: Thu Jun 01 2023