Merge Checkpoints in Stable Diffusion Automatic1111

hello there and welcome in this video I'm going to walk you through the quick and easy way to merge stable diffusion checkpoints in automatic 1111 there's a huge number of amazing fine-tuned custom checkpoints available these days and each comes with its own particular art style and capabilities but also limitations if you want to create more unique images with combined attributes from several checkpoints then generating images with a merg check checkpoint may be the way to go if you've trained your own checkpoint you may want to merge it with another to Leverage The Influence and strengths of that checkpoint I'll be walking through the steps to merge two checkpoints using my local install of automatic 1111 running on my windows 11 PC so let's crack on if you've already decided that you want to merge checkpoints then you probably already know which ones you want to merge to run through the process steps for you I've selected two checkpoints with contrasting styles to provide a good basis for visual comparison I'm going to merge a z pixel mix with dream shaper I've left the links for both checkpoints in the description below for you if you want to take a closer look at these a z pixel mix is geared towards pixel art and the hugely popular dream shaper has a photo realistic style the contrasting Styles should give give an interesting and unique merge style I've downloaded both models already and I'm ready to get merging before we jump into the actual merging process and the various settings it's worth clarifying some key points if you've trained your own model and you're looking to merge it with another checkpoint if this is not the case with you then you can just skip this part of the video and go straight onto the merging process in the next section take a look at the chapter time stamps in the description below if this is the case with you then your checkpoint will always be the primary checkpoint as the starting base into which you merge in other checkpoints if you're looking to merge multiple checkpoints into yours then I'd suggest you don't just try to merge in two or more others at the same time I'd take a more iterative approach merge in one adjusting the amount of the other checkpoints influence on yours produce multiple variations with different weightings of the other checkpoint until you're happy then take this new merg checkpoint and use it as your new primary base checkpoint to merge another checkpoint into of course that's only my preference so feel free to experiment yourself anyway now that's hopefully clear let's get into the merging open Automatic 1111 click on the checkpoint merger tab the first set of boxes is where you add your different checkpoints to merge you can actually add up to three checkpoints to merge but I'll only be doing the two remember if you've changed your own model then you should select your model as Model A with model B being the one that you want to merge into your model in my case I'm not doing this but I'm using the AZ pixel mix checkpoint as my base and I'm merging dreams into pixels drop down the primary model a box and select the ex pixel mix checkpoint then select the dream shaper checkpoint for the secondary model B the next box is where you add in a custom name I'll skip over this for now and come back to it in a moment so moving on to the multiplier selection the next slider option is where you set the multiplier effect this is the important part it determines how much waiting or influence you're going to give either Model A or B for your resulting checkpoint if you slide it completely To the Left To Zero then you're just going to get the influence of the Z pixel mix checkpoint and none of the dream shaper checkpoints merged in setting the slider all the way to the right to one will give you 100% dream shaper since the multiplier scale ranges from 0 to 1 you can effectively consider these in percentage terms so 0 equal 0% 0.3 = 30% 0.7 70% and 1 = 100% easy the easiest way to visually understand the amount of model B on the right you're putting into your primary Model A on the left is to take the slider all the way to the right to one or 100% at 1 you're putting in 100% dreams into pixels leaving 0% pixels slide it left to 0.7 and you're putting in 70% dreams into pixels leaving 30% pixels slide it further left to 0.5 and you're now putting in 50% dreams into pixels leaving 50% pixels slide it all the way to the left to zero and you're now putting in 0% dreams into pixels leaving 100% pixels anyway now that you hopefully understand that let's continue for our purposes I think the pixelation effect with the Iz pixel mix checkpoint on its own is a bit strong so I'm going to tone that down a bit by setting the slider at 0.3 this gives 30% dreams and 70% pixels okay now let's jump back to the custom name even though adding a custom name is shown as optional I would definitely recommend that you not only add in a custom name for the new merge checkpoint but you also make it meaningful so you can later identify which checkpoint you merged and what multiplier Factor you used I'll name it pixel dream- 0.3 the remaining settings will'll just leave at their default value which you can see on the screen that's it then we just hit the merge button the merge process won't actually take that long depending on your Hardware once the checkpoint merging process is finished a completion message will be shown and the new merged checkpoint will be saved automatically in your model's stable diffusion folder with your other checkpoints if you're finding this video useful then it will would be fantastic if you could show your support by hitting the like button and subscribing to the channel to see more videos like this thank you very much let's do a quick check to make sure everything has worked okay open Automatic 1111 on the text to image tab drop down the checkpoint box at the top of the page you should see your newly merged model in there select it our generate a quick test image with my new pixel dream checkpoint using a simple text prompt in the text prompt box I'll type in young handsome man wearing a purple tuxedo and press generate the generated image looks good it's certainly got the pixel influence but nowhere near as much as the basa Z pixel mix checkpoint was giving the 30% photo realism provided by The Dream shaper checkpoint has nicely diluted the pixel art effect at this point generate a few test images to get a good gauge of whether you have the desired influence of the two models that you're looking for if you're not happy then you can just go back and remerge the original checkpoints and select a different multiplier if you're looking to merge in a second checkpoint then you can run the merge process again you your new merge checkpoint as the base model A okay I've gone away and merged the E pixel mix and dream shaper checkpoints using different multipliers of 0.1 0.3 and 0.5 I've then generated different sets of comparison images using exactly the same text prompt and settings for each set using both the original checkpoints and then each of the three merge check checkpoints that I created sit back and take a look at these side by side comparison results which should help you to visualize the differences better hopefully the side by side comparison results were useful and brought it all together for you now you know how to quickly and easily merge stable diffusion checkpoints in automatic 1111 you're now ready to go get merging anyway hope you found this video helpful and I'll catch you in the next one

Channel: FoxtonAI

Views: 188

Keywords: stable diffusion tutorial, automatic1111 tutorial, how to merge checkpoints in stable diffusion automatic1111, merge checkpoints stable diffusion, merge checkpoints automatic1111, checkpoints merge stable diffusion, checkpoints merge automatic1111

Id: TWGmqRAz4RU

Length: 10min 2sec (602 seconds)

Published: Mon Mar 25 2024