Best Faceswap AI? Photomaker and ComfyUI.

hello there in this video we're going to use photomaker and comy UI to create images based on just one single portrait we input but before we start going hands on we need to install some PR requisit some um models and everything as well let's look how it's work what does it make it a little bit different and of course all links to all these resources will be provided Down Below in descriptions be sure to check them right here is a papers and you can see when you import one portrait realistic it will take this portrait and will apply with other images of course let have interesting um examples and overall here's the abstract how it method work you have an image going to encoder we'll process it using diffusion model and after we'll apply it so technically it should post work like a r image face swapping but from my experimenting it's work slightly different it's actually more immersing it's not just take a face and slap over kind of things what I feel in R sometimes happening it's actually like a Laura almost embedded inside the model and one generated and it's plus and minuses the plus it's much more embedded the portrait but minus sometimes have little bit deviation from original Forest but when we look closer you'll see what I mean and right here is a method okay we have it also reconstrution going on and kind of nice examples you can go over look how it's work with specific stylizations and everything and ni things it actually come with different stylizations like Pixar like Disney style or um you can see photo realistic cinematic so it's come with all these different styles you can can apply it which is make much more interesting and more fun to work with this before we install any Laura and models you want to be sure you have it manager install on your compi if you're not familiar with comy UI and you want to know more how to install comy UI and how to install manager please watch my previous videos about this subject and I will again provide link below or I think it will be somewhere in the corner pop up there so you can click and watch if you not yet install it I will highly recommend for you if you're using confy UI to have it manager sty what this allowed us to do it's install missing custom notes and this very important because when we take workflow put it in our screen some menus may come up and not find but if you using install missing nodes this will help you from a lot of time go fine put it in the right right places and do all this stuff so it's much easy and faster to do keep in mind that some of the custom nodes will require to re restart your server over again okay after you install this now we can start working first what we want to do we want to be sure the custom nodes what we have right here the photo makers they actually need to be installed in your uh folder I say you can do with a also manager or or it's going to be and you need go inside your I'm using stable Matrix so you can use it just comy UI by itself install it but you'll notice you have your comy UI folder inside there you need go inside the custom nodes and launch from Custom nodes you need install Repository to install a repository you'll just same can navigate to the place and you can see right here I have a stable Matrix packages confi custom nodes and you can just run this command which says G clone and path for the photo maker plus photom maker plus plus it's a newer because it's official support with a confy UI now after this you should have it this new folder appearing inside your comfy UI which is say photomaker plus and we can go inside and look you may have a different versions and this is kind of different flavors of this I did install it I'll show you in a second if this has happened when you install for example from um manager so for example plus I was installing directly from GitHub with my git Command right here and another one was installed from manager so whatever you prefer which way it will prefer it working it's work just fine next we also need downloaded couple models and just as we in this place the models depend on location usually it will go inside the model path and you can put it some will go inside your stable diffusion folders and some will go inside your luras in my case I have a global installation so it's one be on your local and right here you can see we have some lus install here here and inside the stable diffusion because I'm using stability Matrix this is sharable liaries between all different installations by the way if you're not familiar just very fast mention stability Matrix it just interface that allowed me launch all these different type of the flavors uh stable diffusion like stable diffusion athematic 1111 or Focus or um can and all these different types I can launch just from one interface it's have plus and minuses to use this but it's very easy simple single click literally single click installations and after this it just help you up keep and manage them I do like this interface I will provide also link down below for to check more on this it's have a different versions of the photo makers in implementations we look on one comp VI for America Jo you saw this installation and if you go in this link you can see right here some examples what are you interested in it is in some models we'll look in a second but most importantly you're interested in right here this Json files it's a workflow they allowed you just simple drag and drop on the surface service of the um AR comp UI interface which will open this kind of nodes and it's much easier to work with these workflows as well it's will highlight in red if you don't have it any node available so if you're missing some custom nodes then in this case again you'll go to manage and click install missing nodes and that should install it after this you do need to reinstall restart your server so those nodes will be reread and register properly additional instructions written if you want to follow them I will provide below and right here confy UI photomaker plus if you scroll down right here will help you as well install directly with the G it's what I was showing before and also you can install from managers as well if you going clip it down there you'll notice it's have link to the models and let's overall I found some models was missing from the examples so I'll show you all of those models one you probably want to if you don't have it install real VX Excel version 3 this is we'll use it in our workflow and you notice right there we have the base model right here one model we also have a tensor Arc for the maker another ones and we have a theora XL more Artful so this is kind of one two three different models we using and of course then if we look back this is will be a one model this one will be another models as well you will also need to install photom make version one being inside your stable diffusion model and in case if you're missing this ler this will be another one Excel more Artful so you have plenty stuff you want to download to be sure it's working but all links will provide there and you can just copy and put it in in right place if some of them will be missing then when you start running your application you click Q prompt so r q you will have it error just look on this error and let tell you specifically what missing and where is missing so in this case if for some reason you put it some of the libraries in the wrong areas you can move them and place it where applications ex is expecting them to be located that is about all it's very easy to do after you restart your server reload the UI and you should have it well let's reload it you should have it simple application so let me show you some minuses and withdraw what I found out one of course you need to select your file you want it and limitations even said on a website it's pre-trained to specific uh facial characters so not everything will work but majority should be okay and when you put it in a prompt this trigger word is very important so be sure you have it IMG or image short there like for example an woman image this is trigger word combination that is required for this specific workflow so you want to have it this next I have it RTX 3090 with a 24 GB RAM and if I run on badge size for it's actually break down so it's even I have enough memory something going on there wrong and it says run out of memory um it's kind of very you strange things happen but it's what it is and without me digging down in Python and see actually what is happening out of hand I'm just reducing my batch size so if for some reason you have a this aor come up take your batch size and reduce maybe to even one or two but this is batch size example and down below you can see width in height right now it's 1,24 by 1,24 you can also try to reduce those sizes if you want in a prom sty ier of course we have it our prompt we have it our negative prompt and Below we have it our Styles so if you click down you can see right here have all these different styles and at time of the testing if I select no style it's actually Break um comy UI and I will need restart the server so something still remember it is always living always in developing and uh not always stable and this is price to pay for the latest technology everything also you can try experiment with different models see if they work a little bit better for you okay but you want probably keep it your adapter the same for the maker it's what we wanted and right here is our Bean again that if it's did not find be sure you put it in right location another things also sometimes when you download it like Excel more Artful it's downloading as Dash V1 and if if you don't pay attention or you not select it's give it error and says I cannot find this file you maybe says I just downloaded this file why you cannot be why you cannot find be sure pay attention to specific naming in some cases you maybe want delete this B1 addition to the name so it will comply with example okay we have it verification on um so we need pay attention on sizes because we can run out of memories and names of the models or lurer or other checkpoints that we are currently using so those is important things after you're done with this you can go ahead and experiment most time if you just press q and after a short time it should generated if we look on faces I see the ey similarity in some face expression so it's looks somewhat similar but I said before to me it's still you know what r sometimes stronger representation of exactly same face versus photomaker but you know what how about you try to install this play around and let me know let me know what you think do you prefer rup or you prefer pH maker which one is work work better for you and which one you think give it a little bit more flexibility well thank you for watching this video thank you for supporting subscribing and sharing video have a great day

Channel: Vladimir Chopine [GeekatPlay]

Views: 3,652

Keywords: Geekatplay Studio, Vladimir Chopine, Digital art, How to, Learning Photoshop, 3d tutorials, Digital compositing, How to do in Photoshop, How to do compositing, How to do in 3d, AI art, MidJourney, Stable Diffusion, Dreambooth, Dall-e, Free resources, Free learning, Digital art for begginers, Free tutorials, artificial intelligence, ai face swap, photomaker, ai face render, roop, comfyui

Id: 7Ew2AzAl--M

Length: 13min 28sec (808 seconds)

Published: Wed Feb 07 2024