Blazing Fast AI Generations with SDXL Turbo + Local Live painting

Video Statistics and Information

Video
Captions Word Cloud
Reddit Comments
Captions
super fast AI Generations on your potato computer this is sdxl Turbo and I'll help you get started with it I'll even show you a super cool way that you can live paint with it it's free and you can use it both in automatic 1111 and comfy UI hey do you know what's worse and raining cats and dogs hailing taxes AI today we will be live painting like this so now I have a prompt painted flower and I'm painting blue like this if I swap it to pink here and keep painting my image is adjusting to that and we're getting some pink in here we can add some more pink in there we get more of that flower you can change this to a beautiful yellow let's add that in there and let's go up with that now we're getting more yellow into this maybe want some yellow down here and here's our beautiful flower I'll show you how this works this is super easy to get started with we're also going to be generating images in automatic 1111 and this is live renders coming in right now with a highes fix so we are generating images through the highest fix so we're getting some extra resolution here live so these are four live images of a cat in a hat super quick let me show you how you do it both in confy UI and automatic 1111 if you want a detailed in-depth guide with text and images we're also going to be following this Patron guide available for all of my subscribers so check that in the link description you can also just follow along in the video but if you want more details and step-by-step instructions check out the patreon guide all the links are also going to be in the description below so check that out first we're going to download the model from hugging face there's a base model I'm going to click this link here which will get us to this page you have files and versions here and this sdxl turbo and sdxl turbo fp6 safe tensors the difference is very little between them the bigger 14 GB one will give you slightly better quality but is it worth it probably not so you can just just download the fp16 if you want to if you're using automatic 1111 you're going to go into your folder place that into your models stable Fusion folder drop that in there if you're using comy go into your comy UI models checkpoints and then put it there now there are a couple of improved custom models I'm linking these in the patreon guide so you can check those out if you want to we're mainly going to be using the base model today but you should know that there are improved models like this turbo Vision XL here and you can see here from the images the results are pretty good now if you don't have automatic 1111 comy installed I have more instructions for that install instructions going to be in the patreon guide but also I have videos for free on my channel as well I'm going to use this workflow here so I have this image of a fox here in a little bottle so if you just take that and drag and drop into comfy here we have a base sdxl turbo workflow and if you use an automatic 111 don't worry I'll get to you in a bit so first off you're going to make sure that your sdxl turbo here is loaded then basically you can press Q prompt you're going to have the default settings so I'm getting the same image here and if you want that change you can change here now we have beautiful landscape scenery glass bottle with Galaxy inside cute fenic Fox so let's change this into glass bottle with sunset inside of it and now we can see we have a glass bottle here with a sun set inside of it now they see they set it fixed here if you would generate again you will just get the same image so if you want another image make sure to set this to randomize now when we generate you're going to get a new image every time as you can see here in our live results coming in so I'm just pressing prompt Q prompt here and if I auto CU this and just keep generating you can see the speeds here at a new generations coming in I'm just going to stop this so my hard drive isn't full with images of bottles with sunrises in them now if you're loading this workflow and one of these nodes turn red you're going to have to go into your manager found in this little here so click the manager install missing custom nodes select the ones that are missing and press install now I don't have any missing custom nodes currently but they'll show up similar to this image here now we're currently running this at 512 x 512 you can increase this 1024 for example but you will lose some speed in the process and some coherence as you can see now we have two bottles so the best way to to do this would be with a high-r fix which I showed you in the beginning in automatic 1111 so here for example we ran 512 by 512 and then we upscaled it so these images here are in 1024 x 1024 but they started off as 512x 512 to get the composition right if we started off with 1024 from the beginning we would get similar results like this and we can see if you change this to Cat Let's do cinematic zoom in for you cinematic still of a cat in a hat and let's generate that and you're going to get some weird cats so if you're getting a lot of this go back change it to 512 by 512 generate again and O we have a cute looking cat here now you could go as high as let's say 768 by 768 and it will probably still work and if you run a couple of generations here you can see they're all pretty good some this one here is trying to break here we have a piece of the Hat merged with the ear kind of so kind of breaking so the more you ster away from 512 by 512 the more problems you're going to have now if you aren't getting results like this and you change some of the settings maybe you downloaded a different workflow what you can check is make sure that you have a steps between one to three around that and it low CFG so here we have a CFG one let's set this to example to seven and you can see oh where's my cat and a hat well it's there but it's kind of broken and it keeps getting broken so make sure that your CFG is low you can run up to maybe two but here it's breaking again so it's say 1.5 it's breaking a little bit again at one you know it looks it's it's looking pretty good if you lower this to 0.5 you can see again it's breaking so I would say CFG of one especially with using the oiler a here you can in increase the steps count so here we have four steps we're not seeing a noticeable increase in quality if we do this with a lot of steps like the regular models we're getting an error because the max steps here is 10 so let me try this in 10 with the turbo schedular well it's actually worse so stick with cfg1 steps between 1 and four and you get pretty good looking images and the same can be said for automatic 1111 let me launch a new one here and once you have installed the model if you can't see it up here press the refresh button choose sdxl turbo and we're going to put in a prompt here cinematic still of a frog in a Golden Crown I'm using 512x 512 here let me zoom in a little bit for you guys I'm using the highis fix here so I'm upscaling this by two you can change the upscaler if you want for example you can use the esron 4X which is a default one if you have maybe the CX or the 4X Ultra sharp those are pretty good as well I'm going to use the ESR G4 X because you're going to have that installed already I'm going to lower the d noising a little bit maybe 6 and make sure that sampling steps is one and the CFG is one let's see what we get here so now we're running a different sampler we're running the 2 m caras instead of the oiler a but we're getting a frog here in a Golden Crown and if we reuse the seed here and we change the sampling method to Oiler a we're actually getting a very very similar looking image and if you want to compare the Samplers with sdxl turbo you can run a script here XY Z plot so let's set sampler let's see let's click a couple of them here caras SD caras Oiler a Oiler Co Plus+ SD we can do a 3m1 some people like DDM uni PC and let's get started so now we're doing a comparison of Samplers within sdxl turbo at one step cfg1 we're using a high-risk fix so we're going for 512 x 512 up to 10 24x 1024 and as you can see here in our results many of these are looking good we see no deser mod difference from many of these Samplers here and the 3M DD IM and the uni PC didn't even work for us so feel free to use any of your regular sampers like 2m Caris or Oiler a now let's remove the script here let's just set the seed at random again let me show you one of the other models here so we've loaded turbo Vision here Excel super fast Excel based on new turbo Excel yada yada and if you run the exact same settings here it's kind of not working as you can see so if you change this up let's set the sampling steps at four for example and we're getting much much closer to a better looking result as you can see here so for some of these models that have been merged with the Excel turbo to increase the quality you need to improve the steps so instead of one step you can do three or four but keep the CFG low still oh and you can also Lo some Styles into this so these styles are available for my patreon subscribers there's a lot of styles here both that I have made myself and that I've collected over the last year added from people in my Discord and whatnot so let's add cyberpunk in here let's see if we can get some cyberpunk frog so we got kind of that neon cyberpunk collar let's add some more stuff let's go futuristic and well maybe sci-fi let's just add everything on top here so we're getting a frog that's uh more looks like sort of a humanoid character that's kind of cool let's remove a couple of these let's change it into a graffiti style so now we have the Frog painted on a wall here I mean that's kind of cool so some styles are not going to be great for sdxl Turbo so bear that in mind let's try the anime one here let's change it to m Masterpiece girl riding bicycle and here we can see that it's uh it's more closer to the style that we loaded let's have a look at that live painting thing I'll have all the workflows available in the patreon guide if you want them for easy access they're probably going to be somewhere in the description as well I'm now dragging and dropping the Live Paint sdxl turbo workflow and this doesn't require a lot of changes so it's currently La launched as the XL turbo so just make sure you you have that name there if you get a red error when you start this recheck it and Rec click that there if you press Q prompt now you will get a painted flower like in the example here and if I start painting here now let's change the stroke here to red and we have a pretty small one here so we're going to increase this at 50 for example down here at brush width and now that we're painting you're getting a big one here but now you might be saying well Seb I'm not getting any red in my image well that's because comy isn't actually generating anything so if you would press Q prompt again now you would get the red into here now it's not a lot of red but that's not really the point but again when you paint it's not making any changes well that's because you need to First click extra options up here and then Auto q that will make your comy keep generating so whenever you press Q prompt now this will keep generating generating generating new images all the time and that's what makes it able to give you live changes so whenever I paint now you can see that it's actually changing and if I put some blue in here it's going to start putting some blue in here as well so whatever you paint in here now you can put into the image you can clear this and restart you can change the prompts we can say porcelain statue instead now that was a bad example because porcelain is always white but let's do colorful painting of a swirling nebula and that's going to get us that so we're getting a lot of yellow in this and let's get some blue into here so now we're getting our beautiful swirling nebula here but that isn't all you can actually do more than just paint with this I'm changing the background here to to white but but hang on now if you clear the cameras well you don't have to clear but you can actually load an image so if I load an image in here now it got kind of squished doesn't matter say colorful anime cat so it takes whatever I have in here and outputs it and I can keep painting on top of this doesn't matter so you can input basically whatever here and if you want to stop this just press the AL to Q there and it stops generating because since it's autogenerating all the time it might be uh a little hard on your computer so after watching this you might be asking well can I use the other models here as well well let's just test here so we change from the SXL Turbo here let's take the turbo Vision let's change to four steps here so that's going to take a little longer we're going to put Auto queue back in and we're queuing this up so let's clear this and let's start painting here so let's put some let actually get a larger brush so we have some red here some red up here put some white into this so now we have our cat kind of joining us here let's put some we already had some I there but let's actually oops that was white let's put some put some blue eyes in here and let's actually put with red ribons we're going to put some more red so he understands what that is and up there and up there there we go so yeah that's kind of cute so you can use this even with the custom models just make sure that you increase the steps for this the CFG is still one like previously but uh play around with it as much as you can I hope you had fun and learned something as always I'll see you in the next video see you
Info
Channel: Sebastian Kamph
Views: 39,817
Rating: undefined out of 5
Keywords:
Id: WigWNkxxB_E
Channel Id: undefined
Length: 14min 42sec (882 seconds)
Published: Mon Dec 11 2023
Related Videos
Note
Please note that this website is currently a work in progress! Lots of interesting data and statistics to come.