Stable Diffusion Animation Create In ComfyUI Better Than A1111 AnimateDiff - Tutorial

with stable diffusion and comfy uui at your fingertips the world of Animation opens up to you like never before in today's tutorial we'll take you on a guided tour of the custom note in comfy UI a powerful tool capable of generating stunning animations for your artwork one of the standout features of comfy UI is its remarkable speed unlike some other platforms that might have you waiting for what feels like an eternity comfy UI gets the job done in a Flash we're talking about animations whipped up in just a matter of seconds not the agonizing hourong rendering sessions you might be used to with automatic 1111 speed my friends is the name of the game so stick around as we delve into the world of comfy ui's custom node but before we get started make sure to hit that subscribe button so you never miss out on the latest and greatest in animation Innovation oh by the way do you know why was the AI bad at relationships no well because it always thought it was in control ready let's Dive Right In it's an exciting time for comfy UI as they've been rolling out a bunch of new custom nodes think of them as the secret sauce much like what automatic 1111 does for stable diffusion today we're diving deep into one of these game changers the animate diff evolved custom node some of you might remember our previous tutorial on another another animate diff feature in comi UI this animate diff evolved custom node we're looking at today is quite similar but it comes packed with additional settings for generating animation frames getting started is a breeze head over to the comfy UI manager locate animate diff evolved click install and give your web UI a quick restart you're also going to need to download the animate diff motion models from hugging face I've chosen the latest M SD v15 vers model for this demo but there are other camera panning motion models available if they better suit your needs now let's jump into the KFI web interface oh and one more thing many of you have been curious about my Hardware configuration for running stable diffusion locally don't worry I've got that covered right here perfect it looks like animate diff evolved installed without a hitch now in com UI you'll want to open up the install custom nodes section in the comy UI manager search for animate diff evolved and go ahead and download it I've loaded up a text to animation workflow here you can find a list of these workflows on the animate diff GitHub page when you drag and drop the workflow file into comfy UI keep an eye out for any red mark nodes they indicate missing custom nodes but don't worry it's an easy fix to resolve this simply open up the comfy y manager again and click on install missing custom nodes the system will detect which nodes you need and take care of the installation for you after a quick restart of comy UI you'll be all set and ready to dive into the magic of stable diffusion now that we've cleared away those red flags let's take a closer look at the batch prompt schedule it begins with the checkpoint loader and VA loader then the two yellow nodes enter the scene from animate diff evolved these are at the core of running your images into animation in this workflow utilizing the motion model we downloaded earlier will employ the linear schedule method you can leave the uniform context options at their default settings and a context length of 16 usually works best for this kind of Animation the latent count determines how your image are arranged in the animation output now let's try out a prompt for the batch prompt text format follow this pattern double quote the frame number then use commas to separate each transition of the frame just remember don't add a comma behind the last prompt or you'll get an error message before we hit go know that you can save your animations as gifs or MP4s if you opt for MP4 make sure you have FFM Peg installed in your environment okay brace yourselves for the results as you can see the outcome closely resembles what was showcased on the GitHub page though keep in mind that even when using the same seed number the animation won't be exactly identical there are other workflows available for you to experiment with and one fantastic feature of comfy UI is the ability to save your workflow file share your Json file or image file with others and you can even drag and drop the workflow file to Q prompts for instant generation now let's run this prompt once more with a randomized seed number and see the magic unfold comy is incredibly fast we're talking about generating animations within a minute or less when it comes to generating animations with text or images comfy UI outperforms the competition it's a league of its own and in this video I'll also showcase how this animation custom node pairs with realism Styles checkpoint models stay tuned for the stunning visuals at the beginning and end of this video in a previous tutorial we explored stable diffusion with pabs to create story animations soon I'll be back with a tutorial solely focused on using stable diffusion for crafting captivating story animation videos so stay tuned for more captivating stable diffusion animation tutorials that we'll be sharing on our Channel until next time I'll catch you in the next video have an awesome day [Music] folks [Music] who hurt you I wonder who made you so so mad tell me where did you learn to be so negative you're such a drag what you feel like never having a real life I don't know how you deal I can't imagine your pain I'm just my

Channel: Future Thinker @Benji

Views: 10,994

Keywords: stable diffusion, stable diffusion tutorial, ai art, stable diffusion img2img, stable diffusion prompt guide, Animate Diff Evolved, ComfyUI, animation frames, installation, workflow, Stable Diffusion, motion model, Batch Prompt Schedule, custom nodes, animation output, prompt, export, FFmpeg., ComfyUI Manager, 'Animate Diff Motion' models, Hugging Face, animation creation

Id: dmcu2QbSpfI

Length: 8min 4sec (484 seconds)

Published: Tue Oct 10 2023