3D POSE & HANDS INSIDE Stable Diffusion! Posex & Depth Map!

hello everybody and here is a little update to my previous perfect hands video where I've shown you how to use blender to generate depth maps for your hands and positions for your characters using a 3D model because today in this little update I will show you how you can do pretty much the exact same thing inside stable diffusion by combining two brand new extensions the first extension is called pose X that allows you to pose a skeleton in 3D and then combine this with the depth map library and poser extension and to install these extensions you're gonna click on extensions click on available then load from then you're gonna look for pose X and then click install then for the depth map Library extension you're gonna click the link in description down below you're gonna copy the URL for this extension then click on install from URL paste it right here and then click install then finally you're gonna click on installed check for updates and finally click on apply and restart UI and then you will see two brand new Option appear the pose X panel and the depth Library Tab and here if you click on pause X you will see now a skeleton that is very similar to what you can find in the open pose editor however this brand new pose X extension allows you to manipulate this skeleton in 3D which is really really cool it's basically like having blender but inside stable fusion and that's really really cool and then just like the open pose editor you can take different parts of the body and place it any way you want here you will see three buttons that allows you to reset either the view the pose or everything so let's say for example that you want to reset the pose if you click here it will be the exact same pose as the beginning and if you click on reset camera it will reset the camera in the view as to what it was in the beginning now when it comes to the control the left click allows you to either rotate the camera around or select body parts that you want to move the middle Mouse button allows you to zoom in and out and the right click allows you to either move the camera up and down left and right or if you select the character it will allow to move the character only so what's really great with this extension compared to the oppose editor is that not only you can have multiple bodies and multiple skeletons then you can move around and position any way you want but if there is a pose that you like you can click on this button right here to save the pose just click on this button input a name and then click OK and as you can see this brand new pose will now be right here and you can reuse it whenever you want so once you have created a pose that you like you can click on this button right here to download the image onto your computer and now we're gonna use this position in combination of this brand new depth Library extension because as you might have guessed this depth Library extension is basically a pretty huge library of hands depth maps that you can use in control net so now for example if I click on add background image and then select the post that we just created we have now the choices of all of these heads to input into this image so for example let's say that I want an open hand right here I'm gonna look for open hand click on it it will here in this box here and then you can click on add to make this hand appear in this area and you can now resize it in any way you want either scale it up or down vertically or horizontally rotate it and you can even do a symmetry flip by for example grabbing this side of the image and then dragging it on the other side and as you can see we went from a left hand to a right hand so now if I scale this hand down and I place it right here on the image so that it corresponds below to the character we have now an open pose skeleton and a depth map of a hand in the perfect position and you can of course add multiple hands to the image and then do the exact same thing just resize it rotate it around and try to position this correctly and then once you're done with the position of the hands you can click on this button right here to save the PNG onto your computer or send the image to control net and as you can see now this depth map will appear right here so now just like in my previous perfect hands video we're gonna combine two different control net models together one depth map for the hands and an open pose skeleton for the pose so don't forget to enable this do not choose anything right here just choose a depth model here for the pose choose the open pose then you're gonna write your prompt and now if I click on generate gives you something like this which is again a character in the exact same position as the open pose model and with the hand in the exact same shape as the depth map and although it's not perfect as you can see right here it did not take into consideration the second hand it's still extremely powerful and very easy to use also if you want to add more depth maps to the depth Library you can and here's how first make sure that you have a depth map of a hand that you either generated yourself or took somewhere else then you're gonna delete the black background using a tool like photop.com so here just click on open from computer choose your image then select the magic wand tool click on the black background and if there is more than one area where there is flag backgrounds you can just hold shift and click and then once the background is selected you can just press on delete need to delete the background then you're gonna select the crop tool select fix ratio one by one then Center your image and then click right here to confirm and now that we have a beautiful hand in a transparent background you can just click right here in files export as PNG and then click save so then you're gonna select your image Ctrl X to connect in your stable diffusion web UI folder you're gonna go into extensions as they wave UI depth lib then Maps you're gonna paste your image right here and then if you launch stable diffusion and go to depth Library you will see now your brand new depth map and then if you click on it and click on ADD you can now use it exactly like the other Dev Maps so again that's really super cool so again if you want more information on how to get the best hands in stable diffusion and highly suggest that you watch your previous videos of the subject so there you go have fun

Channel: Aitrepreneur

Views: 68,436

Keywords: stable diffusion, ai art, stable diffusion ai, stable diffusion tutorial, stable diffusion art, stable diffusion installation, stable diffusion Gui, ai, stable diffusion online free, stable diffusion browser, stable diffusion beta, controlnet stable diffusion, controlnet inpainting, multi-controlnet stable diffusion, multi-controlnet, blender 3d stable diffusion, 3d depth map, 3d extension stable diffusion, depth library extension, 3d pose, stable diffusion ai art, posex a1111

Id: EwWkLMhR23I

Length: 5min 50sec (350 seconds)

Published: Sun Mar 05 2023