Live Portrait in Comfy UI similar to Hedra AI but its FREE - Talking Avatar in Local PC

on screen we have La portrait this is a custom node that you can install for free in comfy UI it allows you to upload a reference image as you see on screen here on the left is the MP4 and on the right is just a photograph allows you to have real animations as you can see here's another example over here where you can see reference file provided on the left and you can see an image on the right mimicking that behavior I thought this was really impressive now to get this up and running all you guys need to do is you need to head over to this GitHub page over here first thing is you need to download a few models so inside this folder there are a few models here just download them there's six of them once you finished with those downloads you basically go into your comy UI comy UI if you don't have comy UI installed check out this video on screen over here what you're going to do is you're going to go into your comy UI portable folder and you're going to go into your models folder and then you're going to create another folder called live portrait you're going to create this folder and you're going to dump in those six files over here the next step inside come for youi you're going to go into the manager you're going to go into custom nodes manager and you're just going to go type in Live portrait over here and then just install this and restart your comfy UI once you got those up and running then you just need to go into the GitHub repository and you need to download the Jason file so the Json file lives inside the examples folder over here download this Json file and to test it out there is another inside this workflows sorry if you go into the folder asset example driving these are all the p4s you can get to download to download all of these these are just the input video and then in terms of the images you can just grab those yourself once you got that just loaded up into C UI and you can see here on the bottom left you can see the reference video you can specify any one you want so for example if you want to pick this one or whatever and then on the top is the reference image and over here is the frame load cap just in terms of so the video help them know you need this installed obviously the other thing you need installed is you need inside face as well if you're having issues with this I also got a video around installing the whistle or you can see this but basically here are the some of the other reference videos I've created with this and you can see it's really amazing you can see here the eyes and you can see the actions on the r are specified so really amazing and Powerful tool I'll share with you my workflow as well and you guys can jump in and check it out so really fantastic and yeah I hope you guys enjoyed that quick video

Channel: AI Made Simple.

Views: 2,666

Keywords:

Id: aT6VF_YjEUc

Length: 2min 43sec (163 seconds)

Published: Mon Jul 08 2024