How To Use Prompt Travel With AnimateDiff | Automatic1111 Tutorial

animate diff is the Premier way to create AI generated animations now there are new developments popping up every single day and the latest craze is by combining animate diff and prompt traveling to give you more control of what your animation consists of in one of my previous videos I showcased the method of taking the final frame of your first animation and blending it to the first frame of your second animation but now since we have promt traveling I'm going to show you a way to do that kind of style but a lot easier and more effective in this video we are going to be using animate diff with the automatic 11-11 extension if you do not have either of those I would start here and if you're a seasoned veteran with automatic 1111 the Tim stamp to jump straight to the action is right there now without any further chitchat let's get right to it first things first we need to install the prompt travel extension navigate to the extensions tab go to available click the load from and you'll see all these pop up and then just look up prompt travel and there it is I already have mine installed just install it and then check for updates apply and restart user interface and actually I would just go ahead close this out the command prompt and then just relaunch the web UI just to make sure that it works you'll know that it installed correctly if you go down to the script section here and you'll see prompt travel now we actually don't need to enable this for this to work so for the first method we're just going to use the text image tab so the way you want to structure this so you want to label the frame so we'll start at frame zero then I will just do do a dog running through water and then let's do frame eight let's do a cat running through water then let's do frame 16 so I want this to be a 24 frame animation we'll just do this mouse right through water a 24 frame animation and then we'll do let's do eight frames per second so oops 24 frames and everything is pretty pretty good default settings are just fine and then again we're not going to enable The Prompt travel script we don't need it to work we just need it to be installed for this to be recognized so now that we have that I'm running the dream shaper model as usual so I'm going to enable these and then we're just going to generate and so you'll you'll see that in the command prompt it is recognizing that we have initialized the prompt travel even though it is not enabled here so we don't again we do not need to enable that for this to work and now just like that we have a animation that follows our prompt structure the first eight frames are a dog then it morphs into a cat and then morphs into a mouse and it is running through water it is obviously very goofy it works so you can also set a master prompt for the animation which will be applied to every single instance so so for example let me just do Mountain scene Sunset and now we have the master prompt so this will be applied to every single instance so we'll have a dog running through water with a background of a mountain scene during a Sunset and etc etc cat and a mouse let's generate this didn't turn out the best can't even really tell what animal it is let's play with the weights so fun tip too if you didn't know you can just highlight the word you want to increase the weight of hold control or command then just up and down arrow this is just to emphasize what we want to see because everything else is showing up just fine but you can't really tell what the is running through the water so hopefully this works oh my goodness would you look how beautiful that is this is still the early days of AI animation ladies and gentlemen I'm out of breath let doing some pull-ups while this is rendering boom but you can see in the grand scope of things how powerful this actually is and this is kind of an extreme example I mean it's literally changing forms while still performing in action which is running through water while keeping the consistency of the background that we want mountains you know River Sunset so even though it is very questionable in terms of quality this shit's just amazing and again that's just a very extreme example let's do something a little more practical because I don't want to take 5 to 10 minutes to come up with a complex highquality prompt I'm going to use the Tyrant prompt generator and the universal way to test the quality of a new art style is to create a beautiful woman so let's do portrait of a beautiful woman wearing a dress and we're going to use a semicolon 30 words so then we just copy that and then paste it here so for this technique I'm actually going to use the image to image tab so I need an image so going to disable animate diff and generate all right that is beautiful so we're going to send that to image to image now again we're going to use the same length but in this let's just do serious face then frame eight we want her to start doing a angry face then frame 16 we want her to start smiling let's do eyes closed and then just make sure we do to the animate diff parameters number of frames 24 8 frames per second just like that super easy and then on this since it is image to image we have the option to play with d noising strength which coincidentally 75 is usually perfect you can go a bit lower to like 7 obviously the higher the number we go the more it's going to alter the image we don't want to go too high because we still want to retain the similarities of the image and we don't want to go too low because we still want the image to change if we go too low it's not going to change it's going to cook it's going to get all distorted and look like a static mess so we're going to keep it at 75 for this we're going to generate okay so pretty damn good if I do say so myself she doesn't get as angry as I would have imagined like like really mad but everything else like she's serious gets a little you know pouty and then Smiles with her eyes closed so it's just I mean I mean you can see the resemblance to the image too it's not identical because the problem with getting too identical with the image is it's not going to change so this this is still pretty pretty close and again we only used the reference image we didn't use a Master prompt now for shits and giggles let's add in the master prompt all right I actually have not tried this yet I have not done a master prompt with a reference image with using animate diff and prompt traveling so it's a exclusive look because I love so let's generate okay well wo that is actually really that is pretty damn close the hair color is a little lighter the little what is it garnish no that's for food the little thing the flowers are not flowers but everything else like the earring is pretty close the necklace is pretty everything is like like there's nothing really missing that is fire eyes are a little but again this this is very very basic we only have 20 steps for sampling and then we could even throw in some ad tailor on that and just really clean it up but I like this I'm going to I'm going to work with this yeah definitely not bad there are a few things that we can do to this obviously it is a 512 x 512 so we're going to bump up the resolution and then we're 8 frames a second I mean are you serious so we're going to bump that up to 60 frames a second and I'm going to use topaz video AI because it is one of my favorite AI softwares for this reason so check this out you already have topaz here are my settings to upscale use the enhancement with the progressive video type with the prots AI model and the recover original detail setting set at 20 and with that going to export so not only does this take a few seconds to create but look at this once it's done look look at the difference between these like literally night and day so I this this is a must have if you're serious about generative AI animations and I actually reached out to them to get a referral link because I wanted to share their product because I personally use this with everything I create and I want to help them out and if you want to help me out and you're interested in using this my referral links down below definitely helps me with my channel but it's not required obviously but you can definitely see the difference in quality so it is a 1024x 1024 at a buttery smooth 60 frames per second with that said I hope you now have sufficient information to use prompt travel on your own to create some cool now I encourage you to join the Tyrant Empire for free and show me what you create or if you run into any snags or have any questions want to pick my brain a little bit link is down below and it is my dream to make the Tyrant Empire the largest free self-improvement community in the world focus on self-improvement health skill building generative AI artart so again if you're interested link is down below and I hope you have a great rest of your day till next time keep conquering

Channel: Ty The Tyrant

Views: 14,026

Keywords: tyrant, empire, tyrantempire, rampayj, ai, artificialintelligence, art, midjourney, stablediffusion, automatic1111, leonardoai, dalle, chatgpt, fitness, selfimprovement, selfhelp, learning, gaming, apexlegends, leagueoflegends, callofduty, dating, women, redpill, entreprenuer, freelance, freelancing, money, business, memes, streaming, tyrin, music, musicproduction, dj, howto, makemoney, america, usa, lamborghini, ferrari, bugatti, honda, funny, muscles, abs, sixpack, 6pack, diet, food, polymath, books, reading, god

Id: gLxQEyaDBt8

Length: 10min 10sec (610 seconds)

Published: Thu Oct 19 2023