ComfyUI Relighting ic-light workflow #comfyui #iclight #workflow

hi today we will get to know a new and very interesting tool in my opinion which allows us to change the lighting on a certain object while adjusting colors and shadows and also referring to the background the project and all the credit goes to lias and I will of course leave a link to the repo in the description of the video here is a demo where you can experiment and understand a little how this tool works and also a big Thanks goes to Kaji who made this project available on comfy I will also leave a link to that in the description you can download the necessary nodes from the comfu manager and perhaps the simplest way is to load the workflows attached to the examples and simply install the missing nodes the models can also be found in the manager and you can download them manually from this page and simply put them under the unet folder under the models folder so let's take this workflow from the kiji example and see what we have to play with here the red node is probably a node from another package and according to to the title it is responsible for disconnecting an object from the background so instead of installing it I will simply replace it with remove background which I already have on my computer let's start by loading an image and here we need another image probably for the background I want to put the model underwater so we'll load this image for the background I Chang the model to the model that exists on the computer and in the prompt we will write a picture of a woman underwater Q is pressed and as you can see a mask was created for us here which probably has an important role in the process and we got a not so good picture and especially distorted in terms of proportions so first we'll fix that I changed the keep proportion to true and the amount of pixels to 768 lengthwise and widthwise and press Q again you can see that the proportions are now correct but the quality is not so good and from the attempts I made it seems to me that it works better without adding a background image so let's check it out notice that there is a question mark here if we click on it you can see that in order to add a background we need to work with a certain model right now we only want to work on the character so I disconnect the latent of the background and choose the appropriate model and press q and now you can definitely see the effect the mask has on the process and the image feels more harmonious compared to the previous result let's try to move the mask a little and see how it affects the result so that we don't have to wait long in order to see the change in The Mask I'll put the sampler on mute for a moment this process is a bit annoying so we'll soon arrange that it will be more convenient for us to work but let's first see how the change in the mask aects and you can definitely see that the lighting now comes from the right side to optimize the process of creating the mask I want to be able to draw on the image which will allow me a little more freedom and comfort let's change the the workflow a bit instead of the create mask node we will use load image to draw the mask where we want on the image what we now need is just to adjust the mask to the size of the image after the resize then we will look for the resize mask node and the length and width will be Chang to input and we will connect them to the resize image node and we will connect this mask to the grow mask with blur and you can see how the lighting changes depending on the position of the Mask Another Thing Worth playing with that affects the result is the blur radius and as you can see in lias V's demo The Prompt and the description of the lighting also have meaning the problem is that the picture is a bit dark for me and I want to get some of the atmosphere in this picture which we tried to connect to the background before for that I will also connect an IP adapter and we'll see what we get notice that the weights of the IP adapter are not too strong compared to the change and lighting you want to get you can also play a little with the start at and end at to moderate the effect of the IP adapter let's try with another picture let's say we want to put this robot on the street at night and that it will be lit a little on the right side so I drew the mask where I want the light and I'm uploading a reference image of the IP adapter for the background don't forget to change the prompt as well and this is the result we got if you notice the transition between the robot and the background is not smooth and it is probably related to remove background let's try to change the transparency to false and now the transition is much smoother I lower the blur radius a bit and rais the weights of the IP adapter a bit and perhaps one last thing let's see how the robot is received without the IP adapter here we have the IC light conditioning which allows us to play a bit with the multiplier which in terms of the result is more similar to raising the contrast and now we will just add the IP adapter and this is the final result in short a very interesting tool which definitely adds control to the creative process so I hope you learned and that we will meet in the next lessons of course you are welcome to subscribe to the channel ask questions and like if you liked and most importantly have fun bye

Channel: PixelEasel

Views: 6,866

Keywords:

Id: iEpHHnOYn2c

Length: 5min 16sec (316 seconds)

Published: Sun May 12 2024