AnimateDiff ControlNet Animation v2.1 [ComfyUI]

[Music] we have a source video we extract control net passes and use it to make a render [Music] by this technique you can convert any video into any other style using comfy and animated dip download all the workflows from my Google Drive or patreon page documented step-by-step guide tutorial is also present on my patreon for [Music] free download and install comfy manager it becomes easy to install the missing nodes from the workflow get install the manager through CMD in the custom nodes folder if not yet [Music] installed closer I [Music] am install all the missing nodes from all the parts of the workflow one by [Music] one [Music] [Music] make sure to run comfy as admin so it can download the dependencies [Music] if you get the error if evaluate nodes are missing then download the 1.92 version of the efficiency node and install it [Music] manually delete the efficiency nodes folder from the custom nodes and replace it with the 1.92 [Music] version if manual install does not work delete the overlap and a+b node and connect connect the batch range to the image load cap inputs in the raw and control net directory [Music] [Music] nodes all download links will be in description below it's time for exporting control net passes from the source [Music] video load the control net passes exporter and comfy copy the path of the video and paste it in the input video path node make sure to remove the quotes else it will give error now cop copy the address of the folder where you want to save the passes and paste it if you have a high specs PC put batch range value to zero to render all frames in one go suppose we have a video of 800 frames and our PC can handle only 200 frames at a time so we will render the frames in multiple [Music] batches after every batch we will increase the skip frames value to the total of already outputed images [Music] with this multiple batches workflow you can render longer videos of any [Music] length enable the passes you want to extract edit its settings if you [Music] need you can downscale the images or you can use custom resolution [Music] [Music] also check all the images are rendered properly select two control net passes which has the most accurate [Music] details this is the heart of the workflow you can make any style of render from [Music] this load the raw animation file make a new folder to save the renders copy its path and paste it in output path node copy the control Net's folder paths and paste in the control net inputs nodes make sure to choose the appropriate control net model Change Control net settings if needed see red notes for detailed information about what these nodes [Music] do use luras to get a more creative look and [Music] style [Music] [Music] n [Music] when you are happy with the results delete the test renders set batch range and also update skip frames after every batch [Music] Now we move on to the refiner workflow in this the images are refined and upscale duplicate The Comfy tab load the refiner workflow in the new tab copy the prompts from raw and paste it in the refiner [Applause] tab also copy low as stack if you use them make a new folder to save the refined renders copy its path and paste it in the output path node copy the raw images folder path to the raw images in could node also do the same for the control [Music] Nets know there's no [Music] I going [Music] light after the refiner if faces are not looking good you can fix them in the face fix workflow [Music] copy the refined images path and paste it in the input images notes make a new folder and copy its path and paste it in the output path [Music] [Music] node [Music] again you st your own [Music] import all the batches and sequence [Music] them overlap them properly Fade Out the opacity during the overlapping for a smooth transition add audio effects color Corrections and post [Music] effects I post updates tutorials workflows tips tricks on my patreon I thank my patreon family for supporting me and motivating me to make tutorials like this

Channel: Jerry Davos AI

Views: 28,429

Keywords: animatediff, controlnet, comfyui, animation, ai video, stable diffusion, katy perry, controlnet animation, jerry davos, stylizing video, stylize video using ai, convert video using ai, ai video stylization, kd

Id: qczh3caLZ8o

Length: 14min 14sec (854 seconds)

Published: Mon Jan 01 2024