Stable diffusion prompt tutorial. NEW PROMPT BOOK released!

don't you wish you had a manual to help you out with writing prompts having this Secret Sauce so to speak for getting those extra juicy images I know I would too bad that doesn't exist but it does hang on let me check my notes who wrote this I was told it doesn't exist someone's getting fired wait I wrote this it's just me here anyway this compendium of texts it's almost like um prompt book let's check it out hello everyone so today we're gonna look at open Arts prompt book and what they have done is they have created well the la like a slideshow of information about how to create your prompts I just want to mention that this is not a sponsored video I just found this very intriguing so I just wanted to check it out and share it with you guys so let's look at that we are now at openart.ai which is a library of prompts and if you press this little thing of a jig here I'll put that in the description as well you're entering the prompt book so these are tips and tricks for creating your own prompts so I thought we were gonna check that out I haven't traded yet it'll be a fun read to do together I've just skimmed through it so the lint robots stable diffusion the model was trained yada yada developed by Ariana skip that so basically if it says the prompt engineering is basically you know writing the text for the prompt fancy words a couple of examples so this is kind of interesting you say start by asking a list of questions to Young do you want a photo or a painting like what's the subject of is it a person or an animal landscape you know special details like special lighting could have ambient lighting what environment is it in is it Outdoors do you want it like a dark color scheme vibrant or you know and and the point of view like how do you want to see this do you want to see this from the front or like a satellite view or what's going on and you can add lots of stuff like this little details when you have a specific art style 3D render or here's Studio Ghibli for example her movie poster we have a specific photo type you can even even add specific lenses camera lenses if you know stuff like that so the in the example here they had a photo of real life Shaggy Rogers so shaggies is usually animated and here isn't a photo real life it's cinematic lighting you have some sort of cinematic lighting striking from well from the side and it's creating the nice Shadows here and it's peaking from the Vans window the vibrant colors here I'd say they're pretty vibrant bokeh um well a little bit a little bit movie poster style well maybe here's just another example so skip that well one thing here they wanted a painting of a golden doodle and they wanted in the sky and I didn't get in the sky so here's a thing about the order of text you can put in the sky earlier in the prompt that will give it more weight and now the dog is not in this guy it's sitting on a table but you know the AI is interpreting this as in the sky more and again the order of words here's a cat sitting on the Martian table there's a cat that is sitting on a table on Mars you can clearly see the difference so it's important when you think about your prompts how your well now I'm using that word again engineering your prompts it's a silly word but you know whatever the word prompt engineering is a low over engineered in my opinion no biggie so now we're looking at modifiers modifiers are words that can change this style format or perspective of the image yeah they give examples here photography artists illustrations Aesthetics yeah sounds about right let's look at those photography yeah this is pretty nice a lot of the times I get people asking me about prompts and they say oh I want a photo of this and they just have photography well you're gonna get a photography just maybe not what you're looking for so you need to be a little more specific here they have like a close-up long shots you can wide shot is is pretty popular in the style like do you want a Polaroid image are you looking for a long exposure or like like what's going on the subject you know we talked about that briefly it's what you want in the image here's the subject this the Husky the dog lighting is is super important now the lighting isn't I say it's important but it's hard to get right I tried doing a full video on that and just you know I spent hours testing like getting photography lighting consistent but AI isn't doing that perfectly yet in my opinion and now you can get lucky and get like um perfect cinematic lighting or a butterfly light but um most of the time it's not that consistent and again environment or context area indoor outdoor here's clearly Outdoors you see here and they even put the lens and the camera here I mean the device isn't gonna do lots for you except like CCTV it's a big difference obviously but the lens now that's a whole different story but also again with devices if you put like hustle blood in there well of course you're gonna get you know specific style or better images because if you're taking photos with the hustle blood well it's kind of hard to see and then you know it's expensive camera so the quality is most of the time going to be pretty good but look at different lenses and what they give you that's a good tip and here they have some examples yeah the Polaroid the tilt shift is pretty cool like making miniature worlds product shot long exposure yeah it's pretty self-explanatory important Color Splash satellite view and here you can see we have some different examples the CCTV that that's clearly like surveillance camera and the Drone is pretty specific as well now this is interesting thermal I haven't thought of that yeah that's cool yeah and a couple examples of the lenses the macro shots that's going to be a very valuable if you're looking for that sort of thing you fish eye as well the different millimeters of lenses yeah you can just you know go wild there's so many great options I don't see how you would or where you want the telephoto lens in the AI um yeah I don't know if you know how you could make great use of telephoto lenses just put that in the comments and explain that to me I'd love to know for me it's just I'm thinking of yeah it's a zoom great cool now what anyway yeah we talked a little bit about the lighting um some stuff you can get consistently like the colors obviously and race God race or crepuscular grupascular pascular how do you even pronounce that crepuscular race which is basically God race we get the little rays and the dust in them like all the cool concept artists are painting art mediums oh yeah okay if you're doing like a painting like what kind of style of um what you're using like the chalk or the oil painting or the watercolor or whatever now this is clearly a sidewalk chalk graffiti pretty self-explanatory watercolor You're Gonna Get You know the the colors tend to mash together a little bit to float out a bit with the water this is pretty cool the fabric so like uh someone's been sewing this doll pencil drawings I've always gotten great results with pencil drawings when I did my dream Booth stuff of myself I did a lot of examples with pencil drawings on the AIS is amazing at pencil drawing so play around with that if you want and Clay if if you're working with the Forum and doing animations the jittery style of the animations work great with Clay because it looks well it gives the clay life so try that if you're working with the animations it's a pro tip from me uh artists yeah like a lot of people already have found out putting artists in your prompts and a lot of them makes your images look great and Greg Rutkowski doesn't like this um I mean fine that's his prerogative but if you put some artists in it's gonna look great so try and instead of just putting random artists in try and Google their names and see you know what what's the style what are they painting because if you're taking a list of artists and they have different styles you might get very inconsistent results and not what you're looking for just a mashup which could give some happy accidents of course in the in the words of the late Bob Ross but Google them see what they look like not what they look like what what their art looks like so a couple of examples this is a pretty different ones I haven't seen their records before that's pretty cool this is a little like you know the Asher Brown around style that's great if you're doing um old style paintings but all of these are good I guess I don't know I don't know about them here's a here's a good tip with making a landscape it's smart to give a set of the day like Morning Noon night and see some so I mean if you're looking for an Autumn image just put Autumn in there horror artist yeah I like Tim Burton but you know who doesn't Everyone likes Tim Burton this is pretty cool this is nice as well now here's is a way of mixing artists like if you take a horror artist like this that's very well most of the time very black and white and horror-esque and put that together with someone that's painting very colorful images you might get some very cool results so yeah try that anime I'm a little versed in some but not the actual artist when I'm doing anime stuff I usually just put dude you gibbly in there that's the easiest that would give you like an older style as well and you know that's cool if you want that sci-fi artist there's this oh there's what's his name there's this Japanese artist that made um sci-fi robots women robots in the 80s I can't remember his name now it's very very futuristic for his time if I find this name I'll put an image somewhere in the screen right now I probably probably did so here you have it cool huh photography artists I mean like there's a million of them I used Irving pan for some photos that was kind of cool and here we are concept artists probably 90 percent of the concept artist prompts on like open art and lexicon whatever you're gonna see Greg rutowski and it's you know it's it's pretty boring at this point so if you want some variations of that like check out Derek zabrocky or Emmanuel shio or well some of these guys shot is Safari never heard of it but broken Tower mirror looks pretty decent Advanced technique mixing artist Styles yes I would guess like okay okay all right so what they did here is they put Frank for Sarah and yoyushinkawa they put them together yeah that's pretty sweet so look at the artists who you like and try and make some creative mixes or happy accidents with that external links boy you're gonna have to check those out for yourself I'm gonna move on with this illustration Bob Ross toy yeah I miss Bob Ross that was fun fun times fun times cute panda origami art yeah that's pretty cool that's neat I haven't seen lots of origami art I saw some porcelain art Needle felted oh yeah okay isometric assets yeah those are always really cool low polished stuff Pixar renders yeah these are probably going to be very popular you're gonna see those all over the place Victor yeah you're not gonna get like proper vectors out of this but I have seen I haven't watched the video yet but there's this other YouTuber Albert dosman he does some tutorials AI tutorials as well and I know he made some sort of uh AI to Vector thing yes you can check that out if you if you want you might be one of his one-hour tutorials but it might be good comic style yeah pretty self-explan explanatorium caricature propaganda posters yeah they did some great posters back in the days and the propaganda times with the USSR and American and whatnot we even have some great propaganda posters in Sweden from back in the day I like that art style movie Post Yeah the great thing about movie posters is you get great art and great images the bad thing is you get lots of crap text that you have to clean up later so yeah that's you know the drawback but you have have some photoshop skills or photo payout or whatever can fix that in post maybe they say Splash shards I mean yeah I guess concept art digital painting oh yeah these are are these the old um like wooden Japanese wooden things I saw those in a museum once if that's the thing I don't know stickers I mean if you want to make your own stickers you can just you know take your um take your image into Photoshop and just add a stroke to it like a couple of pixels a white stroke and you get this effect it's kind of nice it's a little drop shadow here as well fantasy Maps weird Dungeons and Dragons uh people out there I did play that once or not ones I played many times when I was um when I was a kid but in Sweden we called it uh dragons and demons what's uh I don't think it was a clone but it was you know similar let's see what they're saying when it comes to creating character you want to First describe the broad description of them like male orc then adding more to them like metallic armor yeah let's you know I have this object first and then the details and then you know art size yeah sounds about right so they start with a digital orc and their art style or the artist and here they have you know adding the metal armor and what's this ah concept sheet yeah okay so they get this sort of style now what's the difference here that's the exact same thing oh okay the last image is made from using image to image and a higher scale to get better detail the strength was about 30. I think they must mean 0.30 the strength is usually a slider between 0 and 1.3 would be like little change Zero is no change one is full change emotions so scared Panda that's what it says here yeah I mean simple feelings can set the atmosphere of the scene yeah very cute sad girl toy currently here yeah she's looking kind of sad because here's a good thing that they put in like positive emotions obviously you're gonna think about people it's like um happy the whatever but here they have cozy like for an environment that's that's pretty neat so it is it's a descriptive of environments as well that's not really like an emotion emotion but you know what I'm getting at yeah and this this husky is really awful but you know what dog running isn't uh we all hope it's pretty ABS abstract one but get it last peaceful I saw instantly you know the Studio Ghibli style I like it it has this simplistic vibe that you know modern anime doesn't well some does obviously but uh yeah I like the style of that era negative emotions depressing yeah that's kinda here again this is a depressing environment that would um convey most of the time the color that works loneliness Grim regret try and work that in if you can Aesthetics psychedelic lion yeah so now we're talking like this is stuff I like trying to get some themes of color and and style isn't it like vaporwave that's the super cool because you know instantly they're gonna put blues and pinks in there this is Miami 80s Vibe all over it love it a couple of gloomy ones luminal space I don't know what that is actually you can educate me in the comments again after hours it's basically at night um brutalism yeah that's pretty nice because you're getting the architecture of it post-apocalyptic as well let's make some Fallout images historic yeah Danny DeVito I just had Danny DeVito in my GTA 6 style images it was a great great image of Danny I like this one it's like Baroque and still modern I think that would look great above his mantelpiece in his house Soviet wave yeah USSR now this is called even they put a car in the wild west and AI thought well I can't put a modern car in there it has to be a car that looks like it's from the wild west and actually worked it was nice Phil Maher is going to be you know a black and white style do you see that um what's that there was the artist the silent film Fillmore kind of style yeah that was great anyway move on magic words magic words what's this well this is a wizard obviously but what are the magic words oh HDR Ultra HD see 64k now that's a big that's a big image I usually end at like 4K and 8K 64k I haven't tried that one it could work so you're gonna get um well the idea at least is to get higher resolution on more detail in the image highly detailed I mean I think I think these are sometimes they work great and sometimes you know uh but I I throw them in a lot but as long as you generate enough batches you're gonna get what you want if you put like highly detail like 8K and octane render or whatever in there so might as well it's not hurting Studio lighting we have Morgan Freeman and again we talked a little bit about lighting before and it's a little inconsistent with the training of lights but some of this studio lighting is actually one of the more consistent ones and again code race cinematic lighting is pretty good as well I use cinematic lighting a lot you can just put the word cinematic in there professional yeah you can see that working training an art station that's really popular on almost as popular as Greg guitarski and I use this as well gives good results because there's a great art and art station like all around and if it's trending well it's amazing art so just throw it in there if you're doing illustrations or concept art or whatever unreal engineer if you're doing 3D stuff that's a good good thing to put in there you can put like octane render as well Vivid colors yeah I can see that working I usually try and pick the colors that I want to but like we had an example of vaporwave before I tried to do like retro wave synth wave neon purple pink green Etc you can be very specific with that you should do that for my um thumbnail images being very specific with the images and glowing light okay yeah that's this um stuff in the background here it's like the blur of the background or blur the background and lights sometimes you get these little Rings you can all I think you can almost see here's here's one actually here's one and here's the little one sometimes you get the big ones that's most people are looking for depends on what lens you have if you're not getting you know the the bulk you want I didn't even I don't even know how to pronounce that word bokeh bokeh anyway try that um Google book and different lenses and you'll get some examples of that high resolution scam okay that's pretty sweet historic looking photo add right resolution scan I hadn't thought of that actually so that's a cool thing let's sketch versus painting almost always sketch creates pencil images yeah I can see that painting adds colors fair enough all right parameters let's see what this is about resolution default is 5 12x5 till yes right because they train the model on images that are 5 12 by 512 and if you use images um or a resolution that's uh something else I mean it's possible but it's harder for the for the AI to understand that so the best results you're always going to get in 512 by 512 at least for now yeah and the CFG the classifier free guidance that's the scale so if you've seen my other videos and tutorials you know that scale is how closely the AI listens to the prompt and you can see it here the prompt is a red bird drinking water from a lake so a low prompt you know low scale completely ignores the problem they add us what we want and a high scale like in the example here 15 you you basically tell it telling the AI I mean you better make this image I'm gonna whoop you um you know 15 15 is all right it's a little high but it still works seven is uh it's a good balance but it's always it's also on the lower end of the spectrum if you're going like zero and four or whatever you basically I mean writing a prompt at that stage is basically useless step counts what default is 50. well yes and no it depends on the sampler I mean if you're doing like Euler ancient the default is more like 20 but most it's true that most Samplers have a default that's good at 50. you can see a more in-depth guide in my ultimate tutorial and they say you're usually higher is better but to a certain degree for beginners is recommended to stick with the default I mean yeah the diminishing returns are master of 50 are just ridiculous and you know you'll get longer render times so yeah stick with 50. it's fine for most images yeah the seed yeah default is always random and it's basically the on the noise the AI tries to make an image out of think of the noise as you know them back in the day when the TV had no programming on which is static noise in Sweden we call that the ants War so the black ants would be fighting the white ants none of them ever seem to win I think that was the point of the war if you change the seat so it's not random you're gonna get the same starting point every time so you say it's like in the example here if you have a seed said eight you get this image from this prompt but if you then you can change the prompt a little bit to adapt this image if you had a randomized seed and change the prompt you get like a fully random image each time so in that sense it can be good to have a static seed yeah sampler you see what they write here that can be pretty interesting the fusion Samplers automatically used to denoise the image during generation and since they differ in the way of calculating the next step in the image production they take different durations and different number of steps to reach a usable image yeah we suggest beginners to use tdim since it's fast and can usually generate good images with only 10 steps yeah right that's cool yeah I mean that's fast sure go for it Euler ancient makes it in about 20 klms takes about 50. I mean I've been using klms for a long time for a long time since we started this and that's not a very long time for most but yeah if you're just starting out I mean sure try ddim at 10 steps and if you have a slow computer that's that's great for you some Samplers are slower than others Hyun for example or super slow but I've used it when I did um or what was that yeah when I did the tutorial on prompt editing and prompt alternating because klms give me lots of artifacts so Hyun was much better for that so they have their uses of all the Samplers important tips let's see when to use different CFG or scale values creative might not follow the prom so yeah so basically you don't I I can't see of any reason to use the scale this low because when would you want the randomized image then you might let me just put no prompt in I guess seven to ten could balance between creativity and guider generation yeah great we ensure that your prompt is good specific enough 10 to 15 yeah fair enough yeah sure I agree just take stick to 7 to 15. when to use different XDA examples yeah we looked at this earlier you just skip this power of seeds yeah here they have an example of using the same seed and changing the prompt so if you'd have this prompt and then just try to replace it with cute cat and have a randomized seed you would not get anything close all these images use the same seed and parameters only changes what's the problem token efficiency yeah your prompt is limited to 75 tokens some um some tools expand that but most you know like automatic 1111 yeah it's going to be capped at 75 and honestly if you're working with the if you're getting anything longer than that you need to cut your prompt the thing with longer and shorter prompts is the shorter ones are going to be more weighted and when I say weighted I mean they're going to have more oomph so to speak like this in the bottom horse Van Gogh the horse is gonna be well it's it's not 33 so it's it's actually higher because this is in the beginning but it has like a high percentage of the prompt a horse here will not be quite as strong because it's in the percentage of the rest of the prompt so in that way longer or shorter prompts can also make vastly different images the order of words can be as important as the words themselves yep absolutely true if you're not getting what you're looking for or just change the wording don't forget about conventional tools you've got a great generation with a messed up facial features use tfp can to fix it yeah so yeah that's face restoration and most of the time at least when you're generating women you need to use face restoration or you're gonna have a bad time face restoration you're gonna have a good time I'd recommend code former Chief began works as well and that's built in in automatic 11 11. image to image in painting out painting I have a full tutorial on that you can find it on my channel and it's basically what they're doing here like the the most common use case is you have a sketch and you want to turn that into a pretty image so most people can draw this and then you can write a proper prompt digital painting of a magical pirate ship floating in a purple Mist Cloud over desert vibrant colors 3D Pixar render delicate details strong sun rays except for the Strong's strong Sunrise but you know you can get from this children's painting probably made by a 35 year old we got this beautiful image the power of AI image to image variation yeah I do this all the time in my tutorials each time you're working with an image you might not get the results you're looking for but you can keep iterating just take the new image put that into image image make new ones put that into image image like each new Step gets you closer and closer to the end result image image strength variations this area there times the image at the start will be correct but not the face you want to have used image image with a low strength you can recreate the image until you get the face you like yeah I have a full tutorial on this as well but the basic concept is you have a strength value between 0 and 1 on if you put that to zero nothing will change if you put that to 1 Everything Will Change so from the second from the left image here to the second I guess they're having a value of what like point three point four maybe 0.5 to change the image without and and still keep most of it like the shapes you have the horns here so that's the low strength variations a couple of examples of impainting a couple of examples of out painting not a lot of detail here but just examples if you want to learn more about in painting I have well it's in my Ultimate Guide I go through it in in detail open art showcase yeah that's pretty nice like a woman as a fox very symmetric face good eyes that's cool steampunk thing eyes are kind of messed up but that's I mean by face restoration uh would fix that for you again you can see the eyes here this needs a face restoration pass code former would probably fix that but here you can see it's an oil painting and you're getting some well some other painting structures but this is cool really nice it's a really nice it's like a porcelain sculpture mixed with a photograph yeah very nice very cool oh it's like a miniature um miniature thingamajig almost like a tilt shift yeah again mini gym it's kind of sweet yeah the god race in the background here yeah you even have it here God's race yeah spotted it boom Oh my man Derek so Rocky Miss misspelled though is d-a-r-e-k Greg's there Greg's there as usual yeah nice I like it this is nice um I would guess that the this would be God race but they're actually a race of light and the Mist here helps it I should use Mist more this is really nice I do like a good landscape that's cool you get really getting the scale of it especially around when you have the small characters here now this is an uh interesting one because this is uh meant to replicate a photograph because you have a camera on the lens and stuff like that lots of um photo stuff in the prompts I think Brit Marling is a photographer as well the lighting is pretty good with the smoke I'm missing some dust in the the lighting here to give it some depth apart from that pretty cool yeah I've seen a lot of these it's actually one of the first prompts I started with when I played around in um stable diffusion when it was released uh it's actually this exact prompt so I have uh lots of generations of this with various creatures I even had my daughter play play with it and make make various animals that's hilarious that's really hilarious it's like you don't you don't know if it's alive or not it's like yeah breaded chicken with a crown of a king I love it it's my new spirit animal thanks for reading the prompt book yeah thank you so yeah that was kind of cool thanks for checking the video out I hope you learned something and if you didn't I go through all of this and More in my Ultimate Guide tutorial thingamajig with everything on it and the Cherry is on top so yeah check that out and this video was not sponsored by openai I just checked this out because I thought it was cool one of my previous videos were however sponsored by open art so yeah full transparency take care bye bye

Channel: Sebastian Kamph

Views: 85,672

Keywords:

Id: NU2TYgfQwcA

Length: 30min 7sec (1807 seconds)

Published: Wed Nov 02 2022