IPAdapter Update V2 | ComfyUI IPAdapter V2 cover style transfer and all Weight type

[Music] don't forget to subscribe and hit the notification Bell so let's go hello everyone and welcome to MK Channel today we are going to talk about IP adapter because it just pushed a huge update and a lot has changed I use the model year to see if really we have the same results you can find all the links in the description below so let's go I tried to find a close enough image a woman with an armor I don't change anything think in prompt as you can see it work well and we have a pretty image what happens if you want to work on an old workflow with IP adapter is that what we going to see let's move on so we have this old workflow that is giving red error let's see what we have a workflow with two IP adapter here we have two old nodes so I Clos the error window the good news is that the IP adpator Advance is a drop and replacement of the red node let's load it by search so there's really not much that you have to do just move the pipes from the old to the new the most of time we have four pipes model IP adapter image and clip Vision I do the same for the 2 IP adapter and check the pipes connections and delete the old one let's choose a checkpoint and check the IP adapter model we need to load an image for each IP adapter two different images to clearly see what's happened I just drag and drop it so I put dream shaper eight as a checkpoint and now we can PRP oh there's a lore error it sends a wrong path okay now it's all right here is the the result so as you can see it's really not a big issue and the result it's okay I could choose another checkpoint for better results maybe a SD XL1 with a bigger resolution so now let's start from the basic stuff and load an IP adapter double click and search by tipping IP adapter then double click again and search for unified loader after that we join or connect connect the nodes and of course we need an image let's put it here and drag one the beauty women choose the right model I key and checkpoint so we can go it takes a bit while and boom that's work good we can see the IP adapter is a powerful node here the unified loader has an additional input here you never connect the first input of this node it's used to daisy chain multiple IP adapter like this because if later you need a plus space model you can connect one IP to the other so all the models that are loaded here are shared in this second loader this is very important because if you don't do that you have a second unified loader that is going to reload all the models even those that are already loaded from the first one so let's now see the advanced IP adapter node and work on it so load it by searching or as you want and connected like I do I adjust the position there is also an important thing to know is if you use the unified loader you don't need to connect the clip Vision input this input is optional and it is used only if you the IP adapter model loader so let's simulate this we load an IP after model loader not the UniFi but the Legacy one you can connect it directly to the IP adapter Advanced at this point you have to load the clip Vision by yourself and you have to understand that you have to know which model is needed for the which Vision model is needed for the I adapter so now that we have the basic IP adapter Warlow work let's talk about weight type by default is linear and first of all I will generate an image for everyone and put the next to compare then I'm going to explain these features in detail I hope it will be clear because we have cryptic name for each one so all right here I put the weight type with name and generated image I put the weight at one for all of them so let's put the origin image beside here I try to adjust the size so this linear how it worked the image generation is divided as you know in steps let's say three big steps input middle and output so what weight typ does work linear means that your weight is applied linearly to all the blocks during the generation it means that in the beginning it will be one in the second step it will be one and one till the end so EAS in means that the weight is applied more at the beginning and less at the end ease out it is the other way around at the beginning it will be applied more at the end than at the beginning so ease out it will be applied more at the end than at the beginning you can see that on the application of the end of prompt so I hope it's clear ease and ease out it means that we are applying at the beginning and at the end but less in the middle reverse and Out means that we are applying more in the middle that at the end all these kind of this weight tights are very important because IP adapter especially the plus version is very strong so now for style transferred sdxl it can basically take only the basic style of the picture and then the composition will be completely free and will be completely Guided by The Prompt so this is what I have for my first test so as you can see it's exactly what I propped and it really takes the look and feel the colors of the picture but not that the content you can play with other images and prop to see what happened and test also with vertical image size I play with weight tight but since we are applying the IP adapter only to a portion of the unit we can increase the weight and usually we get closer and closer to the reference image the result is better with square image and sdxl mode for so let's put a vertical image here IP adapter detect that the image is not a square image to try to resize the image in the middle I adjust the resolution on 1024 for the output the style is always completely Guided by The Prompt and the composition is completely free so now let's do the same with a square image I choose this colorful background to see it really takes the look and feel the colors of the picture so it's take a Time the IP adapter are very powerful models for imageo image conditioning and in this version you can also use an image for negative input the subject or even just the style of the reference images can be easily transferred to a generation added composition only transfer weight type for sdxl and added style transfer weight type for sdxl so this video cover the most important IP adapter functionalities and important updates you can now play with the parameters and images to a better understanding so have fun with it and see you soon don't forget to subscribe and hit the notification Bell so keep in touch

Channel: MunKaw

Views: 1,051

Keywords: comfyui, ipadapter, ipadapter attention mask, stable diffusion, comfyui tutorial, comfyui workflow, ip-adapter stable diffusion, comfyui nodes, comfyui easy workflow, comfyui ipa, comfyui controlnet ip adapter, comfyui ipadapter, ipadapter comfyui, ip adapter, ipadapter plus, ipadapter tutorial, stable diffusion comfyui ipadapter, comfyui ipadapter install, comfyui sdxl ipadapter, Subject Masking, IPAdapter Masking Animation, free ai, Best ai, IP-Adapter-FaceID, IPAdapter_plus

Id: xmcelHUHGuE

Length: 14min 8sec (848 seconds)

Published: Sun Apr 07 2024