Comfyui AnimateDiffv3 RGB image Sparse Control

yo what's up guys today I found out RGB image sparse control was supported in comfy UI so let me show you some examples I made with this awesome feature it's one of the four files that animate diff V3 released and we already talked about the motion module and domain adapter Laura last time from the web page the RGB image encoder has many cool uses but I'm going to talk about one of them making smooth transitions between video clips using the first and last frames this way you can join different parts of a video and make it look like they belong together sounds great right I bet you can think of some other ways to use it too okay let's check out the workflow the basic idea is to generate two or more images using open pose as the key frames plus IP adapter to make style consistent then interpolate using sparse control so first we need to update comfy U I and advanced control net then the sparse control appears here then just choose some pose reference pictures you might find some online if you don't have generate two pictures here you can duplicate and create more key frame pictures as you wish similarly I changed to realistic model here as Doo is animation next deactivate this group to avoid any unnecessary loading let's bypass LCM here to get higher quality results he would would like to upscale no need to mute the image save the new sparse control nodes are connected here as control net the spread method node corresponds to those different usages on the web page okay let's drag these two pictures to be the starting and ending key frames hit the Run unexpected waves animation extra bonus face looks very stable after face detailer really interesting maybe you can experiment with different options and see what works best for you okay that's all for today thanks for watching and have fun

Channel: JanRT

Views: 6,141

Keywords: comfyui, animatediff, animatediffv3, controlnet, ipadapter, sparsecontrol, sparseCtrl, facedetailer, worlflow, keyframes, interpolation, RGB encoder

Id: VSubI7jENcQ

Length: 2min 27sec (147 seconds)

Published: Tue Dec 26 2023