WOW! ControlNet 1.1 Tiles Tutorial - High Resolution for Everyone!

Hello friends are you stock generating low resolution images with your red potato PC and just wish you could generate the big stuff the full HD 4K even 8K resolution images just like the big boys and girls now you can even with your old potato PC as long as you have a GPU with at least 4 gigabytes of vram so you can run stable Fusion but apart from that you go them let's have a look at control net tiles and hey what do you call a group of pixels you want to change society resolutionaries so today we'll be using control net and if you don't have that installed I recommend you checking the previous video which I'm gonna put in the top right corner now if you're on a computer if you're on a mobile you're gonna have to check the video description so I have this image here that I have rendered inside stable Fusion this is a 512 by 512 image and we will upscale it far beyond than what your GPU usually can handle and we will do this with control net tiles together with something called ultimate stable Fusion upscale what you're going to do first is go into your extensions and you're going to check available press the little button here load from search for upscale I did that with Ctrl F and then typed up scale and you're going to find this ultimate as the upscale and just install that click the button here and then apply and restart UI after that you're gonna go into image to image and we're going to load our image here all right so I've loaded my image here which is an old man portrait in 512 by 512 we're gonna add the default negative Styles here you can find that in the video description below now you don't need to use the prom now I'm using the same prompt that I used when I generated this image you can just run it blank but I've noticed that you will get a little more detail when you do run prompts for this we're going to leave everything default here except for the denoising strength now you can play a little bit with this it's going to be dependent on your image but I found for this particular image for the first pass between 0.1 and 0.4 was fairly good now for the second pass you need to go lower but for the first pass you could go a little higher we're gonna set this to 0.15 then I'm gonna check control net here I'm going to drop the same image down there we're gonna enable that and we're going to set our preprocessor to tile resample now if you don't have this you need to update your control net just go into your extensions press check for updates you're probably going to see that there's an update for control net then apply and restart and then go back after that you're going to load your model and here we're going to load the control 1.1 SD 1.5 tile now it's very important that you have the one that says one e here because this file and this model was updated after control net 1.1 was released so if you have the old file which says U instead of e you need to download this file and also if you don't have it at all download this file and put it in your extensions control and models file just like in the tutorial for how to install control it remember you know in the beginning where I pointed up to the link you're gonna leave the rest default here as well except that little control mode here I'm putting this in control net is more important now this isn't super important you can play with these and see how it changes your image as for the script here we installed the ultimate SD up scale if you can't see this you need to restart your stable Fusion if you still can't see it after that you are probably inside text to image and you can use it in texture image you need to be inside image to image once you've set that you're going to change this target size type to scale from image size that will mean that you will ignore all these settings here and just resize image by two times you can change this however you want now I prefer two times here now I'm going to use the four times Ultra sharp model I'm going to link that in the description below if you want to download it if you do just download it go inside your stable Fusion folder go into your models ESR gen and just drop it in there see here's my 4X Ultra sharp point pth the rest of the settings here we're gonna leave default I played around a lot with the seams fix here to be honest I checked some of the FAQ and some of the settings I saw on Reddit and I did a lot of testing and then on that honestly on a general scale for most images multiple images I wasn't able to reproduce good settings apart from just using none and I can quickly show you this as I did a test in Photoshop all images will have tiles and if you look at an original image here you might look at this and say well this looks fine Seb if you look closely there are tile lines here ear and you can see that more clearly here we can emphasize this a little further so here you can see a line going down here is a line the side here and here's a line here's a line so there are a lot of tiles in the image and the seams are showing and I did a couple of tests for this with uh this is just nothing so this is I mean it's fairly okay I did a couple of tests with band pass and you can see here's a band pass which actually gets bigger here's another band pass where it's similar but not a lot of changes I played a lot with the padding you can see changes in the image especially in the middle here it gets a little better but it's still fairly big on the outside I played with a half tile offset and very kind of changing the seams to be these lines and it doesn't really help the image if you look closely you can see all the lines same with various blur settings here's another one which doesn't just doesn't get better at all and as well with the intersect just add some sort of a grid going around here and here I found the settings from the official FAQ if you compare this to using nothing at all this is the FAQ settings this is nothing at all I mean it's I wouldn't say it's an improvement at all but perhaps it's just for this image and perhaps it works a lot better for other images I don't want to bash on anything it's just in my testing I couldn't reproduce better results with seams fixes so I haven't been using seamsfixes so we're setting seamsfix at none but if you find a setting that you feel this is much better than none send me a message on Discord tell me your settings I'd love to test them after this we're scrolling up and we are generating but now it's going to generate four tiles 5 12 by 5 12 and then mesh these together and as you can see here we have an image that's very similar to the left one but it's twice the size or four times the size if you depending on how you want to count and if you care about maths now what you can do with this is just take this 10 24 10 24 just drag and drop it to the left here and now you can generate again and now this 10 24 by 1024 will go 2048 by 2048. now this will take significantly longer because it now has to render 16 tiles instead of the four that we did before but it's still generating in 5 12 by 5 12. so we shouldn't be a heavy load on your GPU just a longer session so it's just like generating 16 images in a batch or 16 batches of one image depending on how they coded it I'm not sure to be honest so here now we have a 2048 by 2048 pixels made in well about 30 seconds on my RTX 3080. now I can go even further with this so if I drag and drop this again and generate again it will do two times once more now this will take significantly longer even on on my computer because now it's going to 4096 by 4096 pixels so now it's generating 64 tiles instead and now if you're a fairly Advanced user of stable diffusion you might have seen some other YouTubers doing videos a while ago on the stable Fusion ultimate upscales extension and you might think to yourself or write a comment that says wait a minute Seb this is just the ultimate extension doing all the work I've seen this before it's just the same tiles and let me show you in a bit we just need to finish this render first and then I'll show you what I'm talking about because we're doing more than just upscaling this with the upscaling model and that extension and that's where control net ties into this but um we'll get to that in a second now our four thousand by four thousand image has finished and if we do a comparison let me show you here we are losing a little bit of detail in every step at this stage of development that is to be expected but let me show you what I'm talking about this is original 512 by 512 this is our 10 24 by 1024 still fairly good now we're moving up to the 2048 by 2048. you can see it much more clearly when we jump up to the four thousand by four thousand image if you go back and forth between two and four you can see here there's a noticeable difference and if you look at the skin this is two thousand four thousand two thousand four thousand this one looks a bit smooth and we're kind of losing detail and this is sort of the issue with this tiles workflow at this moment I'm hoping it will be improved and maybe it can already be with the settings but if we zoom in on this this is 100 you can see in the eye here that this is a lot of detail this is a lot of detail and it it's it's fairly crazy to be honest if you compare this to person up here we have the I here so here are the eyes side by side this is our original render 512 by 512 and this is our upscaled 4096 by 4096 I'm gonna try and render up 8 000 my 8 000 to get a real 8K okay just to show you that the thumbnail wasn't a click bait but we'll get to that in a second I wanted to talk to you about what control net actually does for this let's go back a couple of steps here and let's go back to our 5 12 by 512 image when we're rendering this you saw previously everything was great you can if you're using denoising string here to change the image let's say we want to change a lot of the detail and we're generating this we'll get four tiles to create the new image it will look similar to the original will be very close to the original but it will be another image because we're adding more noise it'll be a different image as you can clearly see here the wrinkles are deeper and there's a different color tone in his face now if you didn't use control net for this let's disable this and now we're mainly using the ultimate as the upscale and image to image and the tiling here will still work however since we're using a higher denoising we're losing the coherence of the image and as you can see our result is all over the place and it can be seen much more clearer with the denoising strength one now we will lose everything about the previous face here and we will get more new faces and again if we enable control Nets even at the nursing strength one we will retain this space now the image will be changed much much more than before but we will see the resemblance so even though you can't actually see the changes between using control Nets or not when you're having a denoising string of say 0.1 0.2 the difference is there and I've checked it in detail in Photoshop looking at the curves and everything so I tried my best to research this for you guys anyway this was my workflow that I've pieced together by other people's tips and tricks on while both my Discord on Reddit testing stuff by myself and I feel that this workflow works really well now you could do something like go back to denoising the settings we had previously and I know some people just instead of going by steps like I did they do a scale to like four here instantly let's just Type 4 and let's generate this and while this works as well it takes a longer time to generate this image so you can't see the process as you go through the steps now with the denoising strength of 0.15 it's not going to be a lot of changes but if you have a higher value you might want to see the steps as you iterate forward here are the two images side by side where the left one these are both 2048 by 2048 where the left one has gone through steps and the right one went four times upscaling and it's up to you to decide which result you prefer best for your image and it might be different for each image or you find something that you prefer best it's up to you anyway let's try and see if we can generate that 8 000 by 8 000 image so we're going straight from the 5 12 by 5 12 we're doing this at a maximum 16 scale I'm gonna start the render and then I'm gonna go get some food because this will probably take a while I'm gonna fast forward it for you guys and I'll see you in a bit all right so I not only had time to eat my second dinner I also had time to eat it because this took about 30 minutes and to the left here we have our previous 4K image which were um which we did in steps and as you can see this image is a little smoother in texture something that you will notice while working in the steps workflow that we did in this video the second one is our 8K resolution that we went from a 512 image straight to 8K and here we have much sharper details in general however the image is not gray I mean it's amazing don't get me wrong it's fantastic that we can get an image as big as 8K I mean you could go even bigger on a low vram GPU basically anything that can consistently output 512 by 512 images in in batches so this has been 256 tiles but we're starting to see it break up a little bit you can start to see here you can see the tiling going on in the simple background here on the image you can't really see it and if you zoom in here's a hundred percent of 8K we have lost a lot of the detail here I mean there's detail but it's sort of fake detail you know eyelashes aren't supposed to look like this if we look at the 4K image at 100 while it's not perfect it's not a photo it's actually much closer to reality looking at the eyelashes and the eye here now would this image with this 8K be better if I ran it from the 4K to the 8K but it also would smooth out the textures even more I think it would mess up the image I think if I find something that I will try moving forward is working in less steps I still like the steps approach because you have you don't have to sit and wait 30 minutes for an image and then I'm not don't know what to get out of it but maybe work in like upscale four times instead of two times maybe do that that way it might retain more texture and Detail in the image but we'll see it's all evolving this if you find a workflow that you feel is the perfect one let me know in the comments below and until then this is pretty game changing anyone can generate high resolution images on there almost potato pieces potato gpus at least four gigabytes and up I hope you learned something today if you like this content like And subscribe but I'm not your boss do whatever you want appreciate it though as always have a good one see ya

Channel: Sebastian Kamph

Views: 159,868

Keywords:

Id: EmA0RwWv-os

Length: 18min 16sec (1096 seconds)

Published: Thu May 04 2023