ComfyUI 34 IPAdapter Style Transfer and Composition - Stable Diffusion - (free workflows)

Mato did it again he added yet another function to his IP adapter this time it's a combined style and composition node um the IP adapter version two was launched just over a week ago and here it is in my workflow it is a St and the new thing is that there was now an advanced note which gave us a bit more options to tweak and one of those options to tweak a day later was the style transfer option very nice to work with and just three days later uh this composition option was added to it and not only that there was also added together with that composition option the combined style and composition node and already in the version two we had this unified loader which gave us uh very handy drop down selection uh such that in the background it uh gathers all the needed models and you don't have to worry what is what it is all combined in background the only thing that you need to take care of now if you want to use that uni ified model loader is this text here that you need to use the file names exactly as described below which means uh you have to download these models and do not uh give them different names than stated here otherwise the unified loader cannot find them once we took care of all that we now have an IP adapter with style and composition with just two notes uh what you do is load a image for the composition and connect it to the composition input load another image or the same image uh for style connected to the style input and then give both of them a weight which can be different for each of them and then this is in this example what comes out that's just incredible I like it a lot and this gives so many possibilities yes of course we can also do this with control net and that works fine and we even have a little bit more uh room to play with a depth model or a ky model or any other model U but that that requires a whole new control net set of notes and this is just quite convenient just two notes and you have everything you need uh wait didn't we already have this composition option yeah the whole previous video was about that but one day later Mato came with this uh option inside IP adapter uh it worked quite well with that composition uh model that you need to download separately and then you just use two IP adapters in series and yeah we had that example of a very rudimentary uh composition image and then a style image and then we asked for a gisha in a Japanese garden and this comes out this is great I of course tried the same now not using this special composition model but the new composition option inside the IP adapter itself and that did not work very great it adopted the style at least the colors are uh okay uh and the gisha is in the correct position but there's no Japanese garden to be seen anywhere so I decided to try real images and that Works a little bit better The Prompt over here is gasa in a Japanese garden painted by Willam H in watercolor style then the composition image is yeah the girl the the gasa here in the middle maybe holding her dress a little bit and then a style image with rather green cold colors and look what comes out the composition is okay I put the value on one point .2 you can play with that value if you don't want her to hold her dress but give the IP adapter a bit more freedom than lower that value what comes out is just what we wanted this composition with this style I think it is fantastic okay let's do another try the same composition but now a different style and look what happens we get exactly that composition but now with another set of colors and also this Pagoda over there we we get little pagodas here and there so that style is quite nicely adopted and even a little bit of the contents let's now keep the style image the same but let's change the composition to this little girl and also change the promptu school girl in anime style and look what comes out we get a school girl in anime style in De position I with this color scheme it's just great uh let's now keep the composition the same but change the style and look what happens uh the same uh girl in the same composition the same position but with a completely different color scheme it's just fantastic it it listens to the prompt and the composition and the style all mixed together let's do a completely different example uh a house on a Cliff a photograph then a drawing of a modern Villa uh on a cliff and uh the question in the prompt is an architectural drawing of a beach house uh and this is what comes out it's it's great it it it does exactly what we want it to do let's now change that composition to a completely different one uh still a photograph but we get out an architectural drawing uh in this color scheme but with more or less the composition of that photograph it is just fantastic here is our Chinese girl again and a cyborg and what we asked for in The Prompt is a female Cyborg and uh yeah it is just great what comes out it follows the composition it follows the style it looks great and another example same composition totally crazy style image and look what happens that is yeah it couldn't be better I think and um another style image and yeah we get the correct color scheme you would NE never even imagine that uh of an picture like this and an watercolor image like this you could get a cyborg uh but it is possible all right well this was another one uh another composition and another style image and it adheres to both greatly it is just so much fun to play with so let's go back to our first image that was at the beginning of this video a charcoal colored wet wash couple in love well we we we see what happens we have a composition image and a a charcoal style image and then what comes out is exactly what you expect and we have not even played with all these parameters over here uh there's so much fun to be had with this Mato thank you very much for making this a big thumbs up

Channel: Rudy's Hobby Channel

Views: 5,578

Keywords:

Id: BCeCTKH0wKs

Length: 8min 11sec (491 seconds)

Published: Mon Apr 08 2024