Fixing the Seams from a Tiled Upscaler in ComfyUI

hi so this is yet another video on upscaling been something on my mind recently and this is sort of how to fix some of the problems of upscaling whether it's um ultimate or any of the tiled up scaling this is tiled up scaling I quickly go through what tiled up scaling is tiled up scaling we go to our original image here tied up scaling breaks this image into into small sections and process enlarges them processes them individually and then puts them all back together again so this particular one this isbu large refiner chops it into nine images three across three across three across three down three down three down and does each section separately and then puts them back together again so the result is a better image at the end of the day but it comes with problems when it does just this square with this prompt it tries to put everything in there for a steampunk Castle the lot in there and and you can uh reduce that slightly by changing this PL this prompt around but I'm not doing that that in this case cuz I I want to show the problems and how to fix them as well so the result is we go to the result uh it goes through the upscaler and comes out the other side looking a lot more beautiful all of this stuff looks great however we have a seam here and another glitch there and a seam down here as well that that's not as bad bad as it might be but but we we have and this has gone through at dinor 35 we could reduce this a bit if we went down to 25 but uh if we went down to 25 we wouldn't get all the nice stuff happening in here so you can't win there's a tradeoff always with a tiled upscaler so this was attempted a workf to get round that and there's two sorts of problem really there's um problems where it's um imagined something you don't want and there are problems where you have a tile showing so the first module here is to sort out how the tites so we we'll and the second module is is doing the hard stuff so we make this group never and then we can sort out this seam and it does that by reloading the original image here this the original image we made this image from and what we do is produce and process a little bit of that to cover up the join uh so we cut a little bit out of that blow it up and stick it over the join in very simple terms so you can see where our join is so what we do is we open in preview Bridge here we open in mask editor and we paint over our join that's Rec Co there's a little bit there as well try a little bit there so that's that's gone over our join so if we save that to the node we can see that that's there and then what happens to go through this quickly is the mask is blurred the image has dropped down the mask is blurred and you don't really need to understand what happens here but um essentially and then a bit of this is chopped out and dropped into that so we'll run that and there we go uh that's quite improved not probably not as improved as I want where we can see between the two it's very good there so we probably want to to to make that a little bit uh a little bit wider May so we can open in mask editor take it over that way and over that way a little bit there we go that's better still and I think that's done really um now what we can do we can do a really fine tune that I think it's a little bit dark here so we can actually correct that if we go to minus three and try that and there we go better still and these changes are instant so you can do Point whatever you want really it it it's a little bit saturated with could go minus 6 on the saturation but you get my drift that's even better um you get my drift you can you can find un it to your H container so that's the soft stuff done however I put it through boy twice and the result and I put it in at at 0.5 quite a highy noise and the result is here now our buildings here have gone even more Super gorgeous they are great but we got a few glitches as you would would expect at 0.5 so we got extra landscape here castles God you name it we have it in here we have the big seam obviously even stronger now you can see R all the way down and we have more castles over here and all this and we got sort of extra Horizon here for some reason so what we want is to take this back to this here so um so we do exactly the same thing and this is set slightly differently the mask is isn't blur as much uh I think we might we might make it a bit more than that we make it 10 pixels but you can adjust this to your heart's content you can you can adjust it after youve all this you can do after you've done your Generations so it's not taking any time really blow radius to 10 and we'll start by painting out the stuff we don't want so we don't want all this lot here so we open your mask editor paint out the extra castles and we got extra extra castles everywhere here not sure I like the old Sun much there either and how you go here is up to you really um you can find tune it however you want really I find it's often best to not make the edges to uh obvious straight joins are obviously going to show more we got a little glitch here we get that and I think the glitch there is on on the original so we can't actually get rid of that but uh that's a very Min thing and I can't really see anything else so we've save that to the node so here we are and uh that's worked pretty well we've uh so our Starry sun has gone let's go to get these three in there so we can see so pretty good um we've got our new we fixed about everything I think that all looks great ah but our seam is back so of course the seam is back on this so it's come so it's quite simple to uh go back into mask editor you can be fairly generous with this cue that it takes a moment um because of the Mask blurring is quite um processor intensive and once again we have the color cast and the color cast is the the same as last time essentially you get a a slight change in uh in colors or nearly always so um the uh saturation can go down five brightness can go down three they're usually the same settings so there you go uh you can see that that has uh fix that it's even better than last time actually I I was more bit more careful on the uh on the settings we we still have the slight seam here if it worries you that can be got but uh I'm not really sure I am too fast about that so this is the original image coming in the sea is better let's have that let's do a proper job so we open that in mask it's not much for an alteration I would just do a little bit like that I think save it to node run that and see if it changes and there we go all done a slight ghost cuz you got a little ship there but you I think you see what I mean you can find him to your heart's content so we need to take a little chunk out of there and there we go go even that's gone so I hope that was uh helpful and useful I should put this workflow in the uh in the words underneath the video and as I say this will work with the ultimate upscaler it's completely agnostic as far but it must be a tiled upscaler CU it's fixing the problems that that only they suffer from so that's it thank you for watching and I hope you enjoyed it

Channel: Rob Adams

Views: 430

Keywords:

Id: V-ASlpPI87Y

Length: 8min 16sec (496 seconds)

Published: Sat May 25 2024