Krita AI diffusion, A look at v1.15 update, bugs on older hardware and new cool features

hello and welcome to stream tabulous So today we're going to take a look at the AI diffusion 1.15 update by akley for Cryer uh this update has a lot of new features to it which make it more powerful than it's ever been which means you can uh edit your artwork and use it in ways um better than what you've been able to do before uh this gives it features which are on par with um adobe's Photoshop for its generative fill but you're actually able to control it uh which helps stop certain glitching and we'll talk more about that after the intro and we'll get on with the [Music] show [Music] okay so we're just over here at his uh GitHub for akley and uh if we come down we can actually see the AI diffusion here we can also see Cryer tools here as well these are very very handy if you don't have them uh it allows Auto selection with your outlining which is fantastic now if we click on the AI diffusion here we'll come across and we find our AI diffusion now if you don't know how to update it I have a video on that which I'll leave in a link below so check that out but it's as easy as clicking on the download which will bring you to this page here and downloading the zip file extracting that zip file overwriting the existing and then when you open up um your crer and the configuration for the AI it will give you the option to update it just make sure that you check everything that way you get all the extra features and uh yeah it adds a lot to it so uh we'll go over and we'll take a look at that uh before we do I just want to give a shout out to Civ AI uh or civit AI for the furnace Model they've just dropped the lightning model which is not coming up underneath um the filters if you click on your filters and you refine it and you say trained or lightning for some reason it's not coming up uh I don't know why hopefully that's just on my end but either way I just want to let you know that they did drop a lightning model um I mean even though it's designed at fantasy creatures it does fantastic jobs of doing humans as well and you can always come down and you can see some of the um types of renders people are getting from it and uh some people have shared their prompt information which is fantastic so you can go through and you can test it out yourself and uh see how you do I am currently downloading this one so I haven't uh tried it out um after it's done I'll probably do a video and we'll discuss that later on so we'll come over and we're coming into crer and I have a image open here and we can come through and we can see here that I'm running the plug-in version 1.15 and it has a lot of new core components and components to it which make it better than it's actually ever been before and I'm finding it fantastic I say go through and install everything um the only thing I don't have installed is this um model here because I already have it so right let's take a look at it so essentially what we have is uh um you can click on something and you can discard it now so if you didn't like something that you've actually rendered like this one here you can just right click it and you can go discard okay these are just me playing around with it and I'm going to show you how to do this and what we've got also we have the ability to copy prompts so if we've got the prompt say for generating the model I can actually copy The Prompt and get it straight back up there which is really handy I'd love to see the ability to have a button on the side to actually extract The Prompt and save it as a text file I think that would be great um and perhaps also the ability up here itself to import and clear would be nice to import your prompt fromex file and to clear hopefully we see that on a later date but the impl um implementations made are absolutely fantastic um someone asked on one of the previous videos with the lightning models theirs wasn't coming up with find it Styles lightning um that was implemented with the 1.15 model so you didn't do need to update to get that and I recommend it because uh it likely has all the workflows and that in the background to get those lightning models actually working better uh when you come over and you take a look at a lot of things like um Civ AI and we come down you'll usually see a list of what they're actually running and I haven't actually checked this one we'll see if it's there okay we can see our guidance and the steps that they're using and what we're looking for here is what sampler they have it set on that's a long read I'm just uh I ask scheming at the moment okay so we can see our sampler here is DPM Plus+ SD and sgm sampler now notice when we come across to uh here we don't have those Samplers um I would love to see the DPM Plus+ without the uh 2m I'd love to see the 3M and some of the other Samplers come in but we don't have those yet which is um that's a little bit sad but there's probably a reason for it with the way he's implemented these um from uh for the criter AI and the way these workflows are using it's probably more designed for the way it does the in painting and that so uh yeah but hopefully he'll implement the other Samplers at a later date so we have that set up on lightning and I find that um this lightning sampler probably is probably is using a um a sampler which has been renamed which he has found the best to use with the models to make it more simplistic to people so they know when they've downloaded a a lightning model use the lightning sampler and as I said that's likely also doing workflows to make sure that it's working fast and better as well um maybe we'll see lightning and then something like um the Plus+ or the you know coming down the um where are we got lost here maybe we'll see these so it might say lightning uh DPM Plus+ uh SD or uh sgm and so forth at later date maybe we'll have more Samplers and be able to play with those more because as I've said in the past Samplers make a massive difference on your render and what your render looks like so let's take a look at these new features and and uh what I'm loving on it so if we come down here and thanks to Cosmic uh the pen I'm going to use that to select the area which is just absolutely wonderful and has been saving my arm an absolute lot so we're just going to come through and we're just going to highlight this part of the image here that going to come through and I'm just going to copy this prompt cuz this is what I want holding a glass beerstein and uh yeah my brain doesn't want to know how to spell Stein so I keep misspelling it okay so when not actually on anything at the moment we're just on the layer and then we can come down and underneath here and it's probably going to be buried under my head yep so we're just going to move that off to the side we'll see a drop down now and we can click that and we can go the default which is the auto selection which will just have fill but we also have things like expand so if you want to expand the image um you can select that and it's a lot better because uh it takes the image into account rather than just the prompt information so rather than getting a random generated image it controls better what it's actually doing so this is absolutely fantastic I'm loving this one down here uh generate custom cuz if we click on that and hopefully it's not all buried we can see it here okay so I have already selected entire image there's a little bit buried under my head but don't worry about that we have automatic uh content we have selection borders and we have select mask I'm finding entire image because what's happening is when I'm wanting to change a part of the image if I have it as an entire image the AI looks at the entire image and it can see and pick up hey there's hands there so I must be generating something to fit this area with the hands I need to put the hands back the other thing is if I do holding glass beerstein and I just have it on automatic and I have the strength all the way up it will actually likely generate a miniature little person with full arms full hands holding that beer stein so having it as the entire image it's able to look at that and say this already exists I am just correcting this one little area here we have another drop down here which is usually on neutral and I'm finding that both neutral Works uh fantastic I have been using it on neutral but I've also played with imp paint and I'm finding that works absolutely fantastic stick I'm not ticking uh the focus but I'm doing seamless so it's blending in and not getting the um the color Distortion around the outside as much so it's as simple as doing that and we've already got our Juggernaut lightning s um selected up there and we come down and we go generate custom and we just wait uh this is a larger image than I normally work on and it is reading this entire image to generate and we can see I've played with it I've generated a few here so if you get bad hands or whatever you can just generate another one but um these add-ons which are added are fantastic and there's a lot of um new implementations which I'm finding uh just absolutely brilliant so we'll let this render and we'll take a look at our result I'll probably end up skipping forward we'll let this one run so you can actually see the render time time on the old GTX 1070 um keep in mind this is a larger image uh also when you're using things like um these extended workflows uh it has a lot more than the AI actually has to process like reading the entire image it's not just generating a tiny small refill or uh in paint here it is going through scanning the whole image working out what it has to do so that does take more so in here we can see we have the glass beerstein there's a little bit of a mark up on the fingers and as I said we can generate that and uh yeah we can add to the negative prompt if we need to um you put perfect um perfect hands up here you can modify that any way you want to try to get that image better but uh what we're looking at here is the way that is blending is fantastic for um the way it is working and you can see it's doing the out painting uh which I've mentioned before we come under our settings and hopefully you guys all know where that is now so it's a little Cog which is buried under my head and we come through to the uh diffusion you can actually adjust how much that fans in and um paint outside of your selection now you do want it to paint outside a little bit so it uh fans and feathers in better uh but you can control that depending on your image uh sometimes more is better and sometimes less and we can see here this is pretty good we have a little bit of a abnomaly on the thumb there but as I said you can come through and you can generate these until you get absolutely perfect for what you're looking for and in my case there's one that I prepared earlier and I absolutely love that I love the way uh the fro is coming out it sort of matches the splash that we have there so I think that's great so we'll go back to that and we'll leave it on that one so and again it's the same with down here we can just select the inside of here and we can say uh small more gold coins it's using the entire image to work out what it's doing it's doing its render and uh yeah I mean the the changes that are done uh giving it more abilities that we actually seen in Adobe so um I don't know if it's been accidental or uh if it's been deliberate with the way he's looked at it but he's worked out the secret Source um so to speak now obviously Adobe is automatically uh working this out in the background and it's probably always been looking at the entire image for the way um you might as well call it the inpaint system works uh but the ability to control it is a lot better it gives it um more usability because you can actually select on here and say I want to remove content so if you're removing a person uh from an image on Photo restoration uh you can do that more easily by actually having that in and we can see our gold down there and we can render that as many times as we want so we can do three renders and then we can select which one our favorite is and put that in there so if it's Corrections that you're doing or whatever it's just so much easier to actually do do now um yeah I'm loving it I think it's absolutely fantastic it looks like melted gold in the pot did say gold coins uh sometimes prompt strength helps so remember you can highlight that word you can hold down the control and press the up arrow and you can add weight to the word so it pays more attention to it there we go so the ad content absolutely beautiful we've got a uh a fantastic one there that's Blended in beautifully as we can see uh still preferring the one that I did earlier the the more gold coins just loved it I think that worked really well so we're going to stick with that one let's talk about bugs so Cryer AI diffusion um 1.15 I'm running into some bugs with it um these are bugs which I've seen in automatic 11 and they were fixed by altering the bat file and adding arguments so basically when it was doing something um it would use different methods and not full Ram to um to fix the actual issues so it still worked I'm running into something which I believe is the same in the AI diffusion for kryer and we'll go over and we'll take a look at it and we'll talk about that a little bit more okay so I've just copied the uh error and I put it up on a text pad here so it comes up uh runtime error expected query uh key and value to have the same D type but got query dtype structure C10 half key dtype float and value dtype float instead okay I have no idea what that means uh I'm not a coder I'm not a programmer um I am basic it is what I used to do I like to call it basic it uh essentially it's you know the ability to actually be able to navigate the internet more proficiently to find forums and know what you're actually needing to type to resolve issues this particular uh issue when you're searching it basically says put the arguments in there to um to F to fix the issue which I've talked about an automatic 11 uh this doesn't have that ability so we come over into our configuration and under performances we can set it to low Ram which I have done uh usually I have been finding that I can have it on medium 6 to a 12 gig because this is an 8 gig graphics card and it is generally really good I've only ever seen the uh eror once was on the face tool um so I'm not surprised to see it in this but I'm seeing more bugs in this than what I should be seeing so let's discuss and talk about it so we're going to come down we're going to select this image here we're going to come through and we're going to add the um the control layer and we're going to set it to face okay I'm just going to pop up here and I'm going to copy that prompt across so I should be generating the exact same image um with his face on it so we should get his face but a different image essentially so we're going to hit generate and we're going to see what happens here we're going to see it kicks out that eror and it doesn't matter if I'm running a 1.5 model or an sdxl model I am consistently getting this error um it would be nice to see perhaps underneath these settings a checkbox to um put those argument in to fix the issue and of course that would need rebooting of the actual um server to implement those arguments so it essentially add it to the um the boot log or the boot up process and we can see here that it's kicking out that error um so unfortunately we're unable on the um older Hardware to use that feature I will reach out to supicious Firefly on his Reddit and U mention it and hopefully he can fix it hopefully he watches my videos and sees it and can actually address the issue which would be absolutely fantastic so remove the face layout so let's have a look at the uh next bug which 1.5 has so we're going to select this area here now it's automatically put expand fantastic feature we're going to hit expand this is going to take longer to come up with error but it's going to come up the same error expand shouldn't come up with the error um I mean we're able to expand perfectly fine with 1.13 without this issue and there is a workaround which I'm going to show you guys on um how you can still expand in this um and work your way around the era which is something that you shouldn't have to do so this is a bug uh interesting enough it was the same bug that actually happened in um Adobe Photoshop with the generative fill so I find that to be um interesting so here we are here we can see that we've got the um same error popping up uh but that shouldn't pop up on generative expand so I'm going to put a dot in there that's all I'm going to do not going to do anything else and then I'm going to hit expand again and then we're going to wait and what we're going to find is that dot and we'll call it the magic dot is going to resolve our problems it's not enough information for the AI to say okay they want this in the um in the expand and they want um you know a cat in the expand or a bird flying in the distance um so it's just a DOT so the AI is going to look at the Total Image which is what the gener of expand is designed to do do and it's going to go okay I am generating this image here but finishing it off and fixing this area here now I did test this out earlier and I got some really bad results and I'm not sure what was causing those results uh but after walking away and doing some research to try to fix that error and coming back and um doing this video and doing a couple of little test runs uh it's working fine so we'll see how it goes on this one maybe I speak too soon and maybe we'll have a issue where the image doesn't look anything like um the rest of it so let's find out it's almost finished you can see one that I've ran here so I'll compare that and show you guys in a moment anyway almost done 1.15 is fantastic it just has some bugs but um everything has bugs um especially you know updates and we can see here that that is absolutely beautiful so we can deselect that we can see it Blends in perfectly with the scene and we can see this one here which I also did earlier blends perfectly with the scene as well a little bit of white wash on the side there but it's uh and a little bit lower quality uh you could put the word 8K in there which would fix that quality up and blend it in better uh overall the scene does fit little bit of muck there it looks like it was trying to generate some sort of building or something on the corner perhaps uh we don't have anything like that in this one here but we do see it did generate a rock so yeah that's the way around it for the generator to expand is put a dot in there so there it is that's uh the crer with AI diffusion um by want say akle I pronounced it correctly in the beginning so I say supicious Firefly a lot CU I can pronounce that a lot easier uh which is the Reddit users name um that creates the plug-in um so yeah I will get over and I'll um mention that to them um the problem is you know it's hard for them to fix these sorts of issues when they don't have my Hardware uh the old GTX 1070 is getting on um it certainly does need upgrading but something I can't afford to do um maybe the end of next year if I'm lucky but after having a bunch of hard drives die and uh yeah um just a lot on the books for this year um it's something that isn't going to happen at the same time I don't mind using it CU it shows you guys you can use old hardware and of course if we're really really lucky suspicious Firefly might be able to actually um put some sort of implementation in to actually fix these bugs and then I can continue to use this hardware for a longer time which would be absolutely fantastic spending money is not something I can afford to do so um yeah I mean it's a fantastic program and with the new lightning models I'm able to do sdxl uh almost at the speed of 1.5s and as you can see generate absolutely fantastic images so yeah don't forget to of course like subscribe and get the Bell on for notifications and share this video to your social media and hopefully it um helps out others and hopefully it helps you out let me know in the comments below uh what graphics card you're running are you having these errors on the hardware that you're actually running yourself and uh yeah what are your render times what resolutions you're running at I'd love to have some sort of knowledge of that because that's what we call Real World um scenarios where we can see those Real Results rather than paper test results uh based on um fractional information so of course there's a lot of things with makers of graphics cards and the type of ram that they're using uh is the overclo there's just lots of little things that make massive differences so bit of wind coming through blowing the green screen down in the corner there but yeah like subscribe get the Bell on for notifications let me know if you're having these problems uh 1.15 is great it's given us a lot more power than we've had before uh which is fantastic if you're doing photo Restorations which is mainly what I do um of course I do like doing the occasional little bit of artwork with it uh gives me something that you know I haven't been able to do for a long time because of the arm and you know thanks to Cosmic and this handy little thing here I've got more control for editing on that so I'm enjoying that a lot trying to learn how to um do my digital painting again which is a tough one so I will see you in the next stream table this video thank you for watching my video and sticking around to the end if you like my videos it really help me out if you could like And subscribe it helps the YouTube algorithm to push my videos out there to more viewers which in turn helps me and helps everyone so thank you for watching my video and hanging around to the end and I will see you in the next video

Channel: Streamtabulous

Views: 2,237

Keywords: Android, photos, restore, art, Android photos, old photos, photo Restoration, fun, entertainment, Android apps, Ai, Ai art generators, stable diffusion, computers, krita, adobe, paintshop pro

Id: 5-nmaiq11Mg

Length: 28min 18sec (1698 seconds)

Published: Sat Mar 09 2024