How to Make Game Asset Art with AI (Free and Easy) - Stable Diffusion Tutorial 2022

hey everybody welcome so the other day on my Twitter I asked you what you wanted to use AI for and most of you answered for work then I saw that a lot of you are game designers so my idea was today I'm going to show you how to turn rough sketches like this into really nicely Illustrated maybe World of Warcraft Style game illustrations that you can then use in RPG inventory systems so this is the style we're going for right breath of the wild has really nice icons representing items in the game as does World of Warcraft and with the techniques I'm going to show you in this video you're going to be able to make art that gets really really close to that in not a very long time at all so let's get going now what we're going to start out with is very rough paintings of what we want much like my other video If you haven't seen that where I make a bigger concept art piece and here are the three items I'm gonna make a chest a potion and a mace the way I did this is I very quickly sketched it on an iPad but you can also make it much more roughly on your PC with a mouse or for example even in paint people can make this art in Microsoft Paint and it will still end up very very nice using stable diffusion if you make sure to follow a few specific steps that I'm going to show you now what I'm going to assume is that you already have a working stable diffusion installation if you don't do not fret check out the links in the description of this video the reason I'm not showing you how to do that is because it gets easier every single day and some steps do change so I will just keep the links in the description updated and you can pick out whatever version works for you best what I have here is a local installation of stable diffusion and that just gives me some more power you know I have a good GPU installed in my PC so there's no reason for me to use a cloud hosted version of this if you don't no worries there are several ways to do it without a good PC what I have here is the one many people know it's the one that makes images with prompts where you just enter text but what we're going to use is the image to image algorithm here in the second tab where you can upload an image describe it here and it will output a nicer version of it so let's upload my first rough painting of the chest here it is this is just my drawing on a black background now the very first thing we're going to do is we're going to enter a prompt and here is where you describe what you want for example I want of course video game art right that narrows down what we want it's not going to be photorealistic we want a nice little painterly look much like these here right not pixel art but just a nice illustration look and now what I like doing is adding the artists I wanted to be inspired by and you know you can change this to whatever style you want but I researched some good game artists and decided to go with uh Shady Safari a very very talented concept artist and Ariel Fain who worked on World of Warcraft and Calvin Boyce who also worked on World of Warcraft Now by mixing these three artists we get a nice little blend of them and that's what I'm going for now we describe what it is so of a wooden treasure chest with an emerald lock that's here this this latch or let's do latch actually and a leather belt describing this part Here and Now what I don't want it to miss is that it has runes on all sides now don't fret don't necessarily you don't have to write it exactly like I'm doing you just have to develop a very um kind of an implicit understanding of what you need to enter here just through trial and error I've developed my writing style doesn't necessarily have to be yours so don't worry too much and now we will enter some more terms like uh World of Warcraft just to narrow down the style a little bit and breath of the wild for example has a pretty neat look as well and now with the final couple words we will just pray to the AI gods and just write 8K intricate detailed just for good luck and now let's check out the settings down here here we have the sampling steps now this is basically um how much time it spends working on the image effectively so 50 is good for some simple starting out you can also go lower if you don't have as much power don't go higher in this step quite yet we will do that later so 50 is a good starting method sampling method just leave it on the default klms is nice all of these here are are good we don't have any faces so we don't need to fix it we will upscale later using real ESR again that just gives us a bigger output so don't don't um check anything here and the batch count we want a few variants a few options to check out so let's set this to four classify our free guidance scale we want the image to follow the prompt a little more right at the start so let's turn that up to around 11. and the denoising strength is super important much like my other video we're going to turn this way down for this first step we want it to stay pretty close to the original input image this one for the first couple steps so set that to somewhere between 0.3 and 0.4 the seed remains blank and the heightened width always leave it at 512 at least for now because anything higher than that will personally crash my computer so I just leave it there and now we can already click generate and just wait a little if you want to know what it's doing you can open the terminal here and just watch the progress and here we already see a few results we can tell it did basically understand what we wanted it made it closer to the shape of a chest this one's kind of nice the emerald is looking really cool it added some nice detail here you can tell it's trying to make wood into this which is exactly what we asked for and this one here made a weird lock I don't like this one it made our Emerald round don't love it and this one has our belt so what we're going to do is we're going to mix these we're going to take aspects of individual pictures that we like and put them together in another program now if you don't have Photoshop don't worry you can use which is a free open source alternative to photoshop or whatever tool like that you have at your disposal so what we're going to do is we can just right click and copy go into Photoshop or similar and paste the image very nice you can already tell it's way better than our original sketch and we're going to mask it right so we click the mask and just remove the parts we don't like in this image I for example don't love these rocks here it's not really what I wanted we're going to go back to that and what we pretty much the only thing I really like is actually the belt so what we're going to do is we're going to delete that mask again make a new one and invert the mask so we remove everything and then we just paint in that belt just paint in the belt and actually maybe I did like this side so let's return that side and now we're going to pick the next image where I focus on the emerald I like the emerald from this one the most so let's take that one and already let's export that I name them by iteration so I have a clear you know set of iterations that it's cool to post later on you know for development or whatever so you can see your progress so this is going to be number two just save it at top quality we don't want to lose anything it's very small anyway and time for the next step so what we're going to do now is we want to refine a little more right so there's more detail in here we can therefore let it be a little more creative with the denoising strength we can turn that up a little bit and then just run it again and here we go Isn't that cool look it really got creative with things now it put a little green in there which is interesting it um added a little holder around the emerald which is a cool idea we're losing the belt I don't love it that it's losing the belt so we might have to do that separately but this is a really neat one that's also a cool one that still has some kind of belt so we're going to take the belt from this one here and otherwise Let's see we have a nice overview I love this one this is this is what I was going for so let's take this one as a main one just paste it on top of the others now let us find the belt again mask it invert the mask because we just want the belts and just draw that belt in there and now save it I think it still looks a little rough around the edges so I think we can we can raise the denoising strength again a little bit so it doesn't stick too close to the original shape of it but also turn up the prompt to make sure we don't lose items in little parts of it again and generate all right here we go now you can tell it already went much more creative and it didn't lose the belt on this one this is kind of cool it still has the belt and it's really giving us that World of Warcraft feeling isn't it so now what we're going to do is we're going to pick the one we like best this one here and just put that one straight in here you can just drag it over and to make sure we don't lose what we like about this we're going to click here on output info copy the seed that's going to keep the general information right the shape and so forth and paste it in here now we like this enough so we are going to just give it more sampling steps right 150 set this to 150 and we're going to get the maximum quality out of this now we're going to turn the denoising strength back down a little so we don't lose too much and generate the full version of this one and here we go look at that it's even more refined than this original one and gave us a couple of really cool options to choose from it's basically up to us to choose which one we like best this first one got a little weird sharp and sharpness going on I don't like that and something happened in the corner here but we can remove that easily in Photoshop this one does have the look I'm going for that's really neat and this one's pretty cool too I kind of like the top of that a little better it's more refined now we're going to bring this over here in Photoshop and mix it again and I want to keep my latch here keep my belt I like my belt now I can just refine some individual elements and then we'll be done how to do that is by saving your image again and now we can use the crop feature so what I don't want to get lost is my latch which means I'm going to crop down to the latch remember to click shift to hold shift while you do it so you keep a square and we're going to select this area and now we're going to change our prompt we're going to say of a leather strap and belt on a wooden treasure chest everything else is not relevant so we're going to remove that and what we want now is of course we don't want to change too much so we're going to again set the denoising strength to down it's already there excellent and stay at 150 because we're in high quality now now I'm really having trouble with this belt buckle so what I'm going to do is use a process called photobashing where I literally just look up a photo of a belt buckle and Photoshop it in and then tell it to find it which of course it will because it's right there and maybe adjust the colors a little bit because the AI does tend to take over the colors one gives it so we're going to make sure it's a little more Brown like that and let's upload it and try again and there it is that's more of a buckle the way I was looking for it this one has a weird emerald on it which is fascinating so let's check them out close up interesting interesting it's very intricate compared to the style of the rest of the thing this one's just blurry that one's kind of cool probably gonna take this one and just run it through again let's replace the one we have with that one you just paste the image on top shrink it down maybe turn down the opacity so you can see what you're doing and the cool thing about AI art like this is it will probably perfectly match your original artwork like it's going to fit right in there and then you can mask around it and it should work exactly what I'm going to do let's paint around make sure you're only putting in the part that you wanted and make sure to turn the opacity back on and we have our first item the true size is this so that's going to look great anywhere in any inventory system if you want it bigger you can also upscale now lucky for us in many installations of stable diffusion there is an upscaler built right in it's called real ESR Gan and it's the fourth tab here in my installation where we can just upload our image so if we want to upscale the chest we put the image in there and click generate and this is of course much faster than actually generating the images so we don't have to wait very long in fact here's the image and we can see you know there's some artifacts but it's a really good upscale and I think this is 2048 by 2048 pixels wide let's move on to the next object and here we are our input image for the potion is now in here now the only thing we really need to change is just the description of what we want because everything else worked really well so we're going to do it and write of a bottle of potion let's do glass bottle of potion with green liquid steam coming out of the top and let's add some bubbles bubbling green liquid and now let's remember to change the settings back down let's bring it between the denoising strength between 0.3 and 0.4 and bring this back down to 11 so we follow the prompt like we did with the other one in the beginning and don't forget to remove the seat make it blank to randomize as it says and bring the sampling steps down to 50. let's see what happens and here we go remember the point of this is just selecting the one that seems to have understood best what you're going for so I guess I recognize bubbles in here which is not what we wanted it must have misunderstood that bubbling liquid is this thing up top that kind of looks like steam I don't know what that is this one has some bubbles in it looks like liquid that one looks like steam so that's maybe our best bet so let's take this one and put it in again leave the settings as they are and just wait again here's the second result the mouth of the bottle is starting to look a little better here that looks like a bubble so I don't love it and I think I know what we're gonna do we are going to take this image which I which is okay and fix it in Photoshop and change it around a little bit now the way we're going to do that is I need to turn this into clear steam this is obviously some kind of bubble or liquid it's not really working and the gray isn't really being understood as glass so the way we're going to do that is we're going to photobash again I'm going to go on pixels.com instead of belt buckles I'm going to look up steam that looks pretty cool that looks really neat so I'm probably going to use this and turn that green and bring that in here that's pretty neat maybe turn down the saturation a little bit and the lightness perfect okay that's pretty cool and I think I have to give it more hints that this is glass so I'm going to look up a well what Motif they have potions maybe they have potions that's kind of cool yeah I like that so let's use that all right that looks ridiculous but I'm sure it's going to work much much better than the images we had previously and now I'm just going to turn the denoising strength up a little because I feel like it's having some trouble with the image so let's put it at 0.5 and see what happens the rest of the settings remain the same whoo interesting okay that one's cool I really like that one it's dripping a little that one's really neat that's pretty much what I wanted and this one I like the bubbles the bottles getting a little weird so yeah let's work with this one very cool now let's just put a final step over this what we're going to do denoising strength down to possibly even the twos we really just don't want to get too far away from the thing we just want to clean it up a little bit right so let's do two nine and uh just run it again at 150 this time so it gets nice and Polished here we go here are our final results look at that that's that's pretty neat oh I like that it actually put that dent in there made it more clear gave it some definition I like that it looks more like a crystal bottle somehow this one's nice it's it's round it's closer to what we originally gave it that one's just crispy and this one is just kind of clean I like that but to fit with our chest right we want to keep the theme I will take this one and put that back into my Photoshop and save it look at that Isn't that cool great now let's move on to our final item the mace I think you understand by now what my process is so I'm just going to Time Lapse through this and we'll meet you on the other end all right that's the end of the video and here we go here's the result so remember we started with these super rough sketches that almost anybody can do even in Microsoft Paint and ended up with these gorgeous World of Warcraft style item icons this beautiful magical chest this mace weapon and a potion bottle with the tools I showed you in this video I hope you are able to reach results that are even better than this so I hope you have fun and if you like this video please please subscribe like and um press that little bell so you make sure you get a notification when I release a new video let me know in the comments if there's anything else you want to know any other videos I can make and feel free to follow me on Twitter where I post the results of work that I made outside of these videos my name is Albert and I'm going to leave you to it I hope you have lots of fun with stable diffusion see you soon

Channel: Albert Bozesan

Views: 264,123

Keywords: ai, ai art, concept art, stable diffusion, midjourney, dalle, open source, artifical intelligence, video game, game art.

Id: blXnuyVgA_Y

Length: 20min 43sec (1243 seconds)

Published: Sun Sep 04 2022