Experimental, Architectural design with AI: how to use Stable Diffusion and ComfyUI Sketch to design

okay Hello friends uh in yesterday I have finished recording these three videos and if you want to use the stable diffusion in your computer you can use comfy UI and with these three videos you can understand that how to install and run the config UI on your computer today I want to start to make some architectural exterior design or rendering based on some sketch and now I'm going to open my configure this is the sketch that I have selected and I want to redesign this sketch on this building and I want to show you how we can do that okay already I was running the count for UI okay this is the comfy UI I'm going to use the ref animated engine the Rev animated engine we need to separate vae so I'm going to load a vae for example orange mix and connect a VA to the vaed code the scheduler and scheduler name could be you will learn normal no problem and I have to write some description here I prefer go to the C with AI page and open the Rev animated page because they are suggesting us that how we can do prompting for this engine and what should we write okay here you can see that they suggested to write the prompting with this style content type description a style and composition and also they told us this engine like this words so we are going to copy them and paste them here and at the first I am writing a building [Music] and I'm going to open one image here you can see some negative prompts and also I'm copy them and paste them here okay let me move these nodes and from here I can adjust the resolution then I am going to use the control unit and with Ctrl not easily you can use some higher resolution and it's possible uh okay now I want to import this sketch into my design all right let's do that at first I have to use the load image and after that drag the image inside the load image now I have to even load control net which will not apply and control net load in apply control let you can see it the input in it one conditioning and also the output is going to the condition so the conditioning from positive prompt will be connect here and it will be connected to the positive in case sampler and [Music] the load control and model will be connect here and after that we can select the control-ness model already I have many different models and they can do many different things for me in this case I prefer to use the call adapter A Sketch okay and now I have to connect the image to the control net okay for the sketch image the image should be in black background and the lines should be in white color Okay so I'm going to inverse this image okay at first I am adding the invert image node connect the image and after that connect the image to the image it can invert the image to the black background and white it's it's completely like the invert into Photoshop and if from the output I make and preview image after that you can see that okay let's start Q prompt here you can see that the inverse node inverter colors in the image okay it used some information from this sketch but also it had a many different parameters okay in this case I think the AI has some freedom because it doesn't use completely 100 percent from this information and easily it adds some parameter and element to this building so I am going to add increase the strange and again Q prompt okay again let's increase the strange and Q promise do some more stretch okay this time you can see that it is only using the this building form but maybe I can change that a little lower it is not so good again I'm doing the add little more strange okay okay not bad and now I want to use a design reference okay um let's do it add let's let me add the design reference for example uh here let me add load image if you have a node you can press the alt on your keyboard and after that drag a note okay and then you can make a copy I have this image and I want to use this building design Style for my building okay let me do that for using an image as the style you have to do this process at first I have to use a style model apply style and style model loader okay from the style model loader I'm using the co-adopter style connect the style model to the style and connect the conditioning from controller to the conditioning from a style model and connect the conditioning from a style model to the case sampler okay please follow the data process and also it need a key position output the clip Vision will be analyzed the image and give some information to the style model so I have to add a clip Vision in code node and also it need to order input one of them is clip vision loader and it should load the clip vision and the image should be connect here okay let me Cube prompt all of these parts are going to be load okay now we cannot see any designer style from this image in the output I think maybe it is related to the amount of a syringe I am going to reduce that and again start the process this time you can see it added some design elements but still it is very far away from our reference let me change the strange to phone and Q product okay it's at a completely different style and also still it is very very different I'm going to change my control net processor and this time I'm going to use the Ctrl net v11 scribble okay and I'm going to decrease the stretch because selecting the control net can affect lots of different result in your processing okay so this time with the scribble controller you can see that my output is going to be different let me again change the strange I think the form of the sketch is very very modern and for converting this modern building to this Classic Building it's not some freedom and with lowering the estrange you are giving some freedom to the AI it's very high let me cancel that and again coupons [Music] still it is very different [Music] as we increase that with this amount can be something like this um this time let me change my model and test the result with realistic Vision because also changing the model can affect on your risk office okay this is the final result and don't forget that it was our input um okay this time I am going to add one outer model at the middle of this flow and it is the name of that model is C coder I am going to use the coder this is my reference this is my style okay it's need an image input after that I need Concord conditioning it should reconnect to the contact from okay conditioning from and the conditioning from my sketch should be go to the conditioning too and it should connect to the conditioning in my style and process the image and let me change the processor to A Sketch and make another processing let me change the resolution a little low and increase the stretch this time you can see it adds some pillars from this design style but still it is not something that I am looking for so let me change the control node to soft Edge this time make the strange lower the result is completely different let's continue [Music] with the scribble do one more test boom okay uh this time I want to change the sketch style okay and I want to use this sketch because it's really like a very very bad and hand drawing and it is not clear that what is the main concept just we have to we just we can see three different parts here and really it is like a scribble so with this Scribble and this style we can get this result and again if I came back to the go adapter sketch it needs some more strange it is trying to get this form but I don't like the result because it it is added many many different elements that I don't like oh and again let me check the soft Edge this design okay I think the scribble again had the best result for me and see quarter also is active here this time I'm going to connect the coder output of the c order directly to the case sampler and I'm ignoring the style model because also the sea water is very over full no maybe the combination between with the c order and the style model was better and again let me check the result this building is very symmetrical and I think it is trying to make some symmetrical result too I changed the vae because that the coder suggests that this vae and if I had some freedom okay now I have to go and again I will come back and continue to make some more experience for converting hand drawing or a sketch from input and using this style without using prompt and this prompt may be it's making some problem for us because the building is very better I think because it is not a house yes only if I use the building in my prompt I think it will react better and if I don't write anything and just Cube prompt because I have the C quarter and also the style model so they are doing a good job okay I will come back to you in next hours and we'll continue

Channel: Arch_AI_3D

Views: 2,085

Keywords:

Id: YpkMyDKI3mc

Length: 25min 18sec (1518 seconds)

Published: Wed Jun 21 2023