BSLIVE Dream Texture ControlNet Scribble and Grease Pencil in Blender

hello we're coming to Wednesday's live in this episode I want to show you a new update of dream texture add-on for blender so what's new uh basically you now have ability to use control net for the stable diffusions and it's gonna work under blender engine so we can actually specify dream textures and then specify the Note 3 so here uh we can see uh we can just pipe in the whatever on the viewport this is my doodle using grease pencil and then some magic is gonna happen I'm using this control net scribble control net and based on that model uh we're gonna see a different result okay so let's just do quick render so I made a couple these are some of the example it's a it's a Mushroom Man scribbles okay the first one looks really weird that's because I was using the prom from original crush on Country example which is this one over here this pencil so before I continue and while still like rendering I can talk a little bit more so earlier today actually just around one hour ago Carson catri uh made this post kind of telling us okay control net is now fully integrated with blender dream texture add-on so we can use uh a character rig that have the pose open pose render ability to create this kind of animations and then we can also use the grease pencil like this drawing of baby Yoda and there's also like control map uh you can use the normal using control net which also I think should work with the dev and this one variations of texture very simple from okay texture projection feature okay this one is I think something to do with the with the dev oh wow this one is I haven't tried all of these so far I just okay this one using second segmentation control net so far I've only tested the grease pencil one um grease pencil doodle right I always love grease pencil feature in blender because because one thing we can make a doodle and this doodle is of course it's a grease pencil object and we can always use build modifier this is my noodles right and I draw it Stroke by stroke and every stroke actually valuable and we have the N crystals like this and we just hit a render okay so that's the process we also have the original one okay listen this one is drawing by Carson I can enable build modifier and then you can see how Carson draw the grease pencil okay if it's stroke with different ways maybe this one using stylus and yeah we'll basically can teach someone to draw using a grease pencil okay that's one thing and with this uh stable diffusion uh this dream texture add-on uh we we are able to use a stable division AI to reimagine and dream our just basic Doodles in this case it's just a the grease pencil Doodles the scribbles as an example but as you can see there are there are other features that each one of them might need its own video but you can try it yourself just download the latest version 0.2 and you need to make sure in order to use the control net model you actually need to download the model for each specific controller for this I need a scribble right so I did download the scribble effusions there's also this version by t-bought I haven't tried this is for control Nets stabilization 2.1 okay that's uh for different model um but anyhow yeah this is the blend files that I downloaded this is the example Ben files I think you can start from there so it what it does from this Scribble if you try this is uh the drawing by Carson let's close this it's the apple and orange painting based on that Chrome if I use my own scribbles we actually have this character that now that now looks like uh kind of like a porcelain like a like a China pot with apple and lemon and you know it's still looking like a painting which is pretty cool now this one suddenly become like a mushroom why is that happening why do they switch body because because the first one this original originally this this prom let me just use text okay view work wrap oil painting impressionist miniature mushroom creature on grass this is my problem okay the one from Carson have a different from with a negative problem as well so if I copy that paste it here impression is fruits in the bowl okay fruits in a bowl okay fruits masterpiece fruits in a bowl so it's a you still need uh it's in in English um for now uh you can specify any scribbles and any prompt positive from negative Chrome and you just uh render and then wait a few seconds and you're gonna get a result and then each surrender is going to be different because we specify random seed here control it okay it's interesting okay from the field part color it's it's using this mask I think it's inverting the color that's interesting and then conditional control net value set to 100 percent and yeah this is using of course using dream texture engine as a result we have this apple fruits there's fruits on the bowl painting and every time I render it's going to be different if I use the animations um you're gonna get different results oh but yeah but anyhow the point is if we create let's try create something shift a create a blank grease pencil object and then draw nothing to erase up because I need to use draw pen I I like to use uh ink okay it's kind of really weird scribbles let's draw what's what should I draw okay Suzanne okay I shouldn't make it mixing I am drawing Susan using my mouse okay this doesn't have interesting shape but maybe this monkey is meditating and there's a flower actually I want to put Suzanne on the on the Rock on the rock for the stone hopefully the AI can interpret this okay this is the positive prom the text problem that we're gonna use monkey okay let's do oil painting impression is Masterpiece okay monkey meditating on Rock with flour on her head we use prompt image there's actually like image image depth to image let's use prompt to image for now render hopefully we're gonna get good result so again it's using control net scribble and the model we are using is the default generic 1.5 I can change the model at any time okay I can see what he's trying to do yeah it's still like a monkey with a flower it's not bad right it's just slightly different I can try with the grease pencil actually we can we can add noise all right strict and then we can actually render out animations oh okay where's the frame control that's we don't have bad size okay let me try a different model maybe I have anime model anything let's see if it's working correctly I think it's trying to draw something yeah still a monkey is a good prompt monkey is normally looking like a monkey sort of but yeah that's using anything dream like diffusion photo dream life is actually can be better and it doesn't need to be like oil painting you can make it more realistic if you want to but oil painting seems quite a nice kind of like a everything will look more artistic and it's more like a concept art it's not like Fitness art you know you can always redraw this okay it is kind of interesting looking uh you can say instead of instead of oil painting impression is monkey we can say photograph hyper realistic monkey let's see what we're gonna get so I think the next thing I want to try maybe I will render like a couple of frames using the same seat maybe don't change the seat maybe I want to see how the scribble works uh yeah you can see the monkey ah yeah it's interesting it's a lot of fun this is the negative problem I'll show you blur hazy I think I have longer an egg I have a lot of different negative from so we can get a different result but that's basically the process and then like I said it's more like with Susan I mean with this is the Chris pencil frame put it on the frame zero just in case I always think Chris pencil is the most powerful thing inside blender because you can make like storyboard Doodles concept art quick animations 2D animations and with AI is also another level remember you can always build every Strokes every Doodles is information is stored inside blender and then you can learn roll this monkey for example and then you can get like different variations of the monkey in reimagined by Ai and yeah you can share this blend to your friend and then they're gonna be able to use it right away render use different prom and try a lot of different things so that's a quick look of the control net with the dream the latest dream texture version 0.2 from Carson country there are a lot more there are a lot of more of this control net I need to try all of them but yeah for now hopefully this is a good introductions don't be afraid to use AI image diffusion or using blender it's gonna be like a like a basic tools that you need to have in every machine and definitely it's really really powerful for you as an artist even though you are like you are 2D artists you never use 3D uh blender is really I think the best app to do that and also for AI blender dream texture give you it's unlocked this feature I mean it's unlocked the uh the ability for you to generate AI art and just inside your machine and I'm currently using Mac Mini M2 that's a good base machine for students maybe if you want to go faster Nvidia whatever but Mac Mini is really really powerful M1 actually works as well so it's just a little bit slower but I recommend you M2 machine uh so there you go thanks again for tuning in and I'll see you next time thank you

Channel: Jimmy Gunawan

Views: 807

Keywords:

Id: wJmNifp8WOc

Length: 16min 0sec (960 seconds)

Published: Fri Apr 21 2023