How to Use Frame Interpolation in ComfyUI for Fluid Animations

Video Statistics and Information

Video
Captions Word Cloud
Reddit Comments
Captions
Frame interpolation is a video processing  technique that inserts additional frames   into your footage to make it look much smoother.  Here's how you can do it within Comfy UI. First,   you're going to want to go to your manager  and then install custom nodes. Then,   search the term "interpolation".  Next, install this Comfy UI frame   interpolation custom node. Once that's  installed, we can add it to our workflow. Just to give you a brief, high-level  summary: I have two-second video footage   that's a total of 60 frames of myself waving.  This passes through a couple of control nets,   along with textual prompts and "Animate  Dip", to create this short form video. Now,   while this video looks good, frame  interpolation will make it look even better. To do this, it's fairly straightforward. Go  to "Add Node", "Comfy UI Frame Interpolation",   "VFI", and then select "Film VFI".  Next, connect this to the frames and   also bring in the video combine custom node  to stitch all the images together. After that,   connect this here. Since we're going to use  a multiplier of two, which will basically   double the number of frames, go ahead and  increase the frames per second to 60. Also,   create a preview node for review and set this to  H264 for better quality. Then, cue the prompt. After 40 seconds, it created a total of 119  frames. There is some math that drops that   last extra frame, but it's roughly about  60 frames per second. Here's our animation   side by side. As you can see, it's a little  smoother compared to our original 30 frames   per second output. It is a very quick and  easy way to really smooth out animations. Now, I want to touch on the other frame  interpolation methods available within this custom   node, as well as some of the additional options.  As you can see, there are quite a few that you can   test against. I recommend testing this for all  sorts of different animations. However, I found   that the results weren't really all that different  to the original film VFI that I had done earlier. Lastly, I want to mention the GMFSS Fortuna VFI,  which is specifically designed for hand-drawn   cartoons or anime animations. If that's  the type of artwork that you're creating   with a Comfy UI workflow, you might want  to use that interpolation method instead. That's all for adding frame interpolation  to your workflow. If you have any questions,   please leave them in the comment section below.  This entire workflow is available to download,   so you can play with it and incorporate  it into your personal workflow. Thanks so much for watching. Consider hitting the   thumbs up button and subscribing. I'll  see you in the next video. Take care.
Info
Channel: Prompting Pixels
Views: 5,156
Rating: undefined out of 5
Keywords: stable diffusion
Id: alu-lcIfGoY
Channel Id: undefined
Length: 3min 58sec (238 seconds)
Published: Wed Feb 07 2024
Related Videos
Note
Please note that this website is currently a work in progress! Lots of interesting data and statistics to come.