This is Getting GOOD! AI Art to AI 3D Model - Unreal Engine UE5 Game Development

greetings gentlemen and ladies in today's video we are going to be taking this AI generated concept art character and we are going to be transforming it into this 3D AI generated model uh that I have actually rigged up with a procedural walk and imported into Unreal Engine this is live real time gameplay uh I think that looks pretty darn good let's take a look at how this workflow is accomplished so the first part of this pipeline is Leonardo AI for image generation and the reason I like leardo AI is for their realtime generation feature where you can type in a prompt such as for example robotic robotic dog and it'll generate up a robotic dog in a certain art style now you can adjust the sliders a little bit to kind of create a different sort of art style and then what you can do is you can kind of keep that same art style right if you want to do consistent characters throughout your project but you can modify the prompt a little bit so in this case a robotic do dog that's armored a robotic dog that's armored and blue or however the case may be uh if you're doing this you're going to want to keep track of your seed information too your seed information and your slider information so that you can come back and you can kind of find the character style that you're looking for if you scroll down of course on the slider it'll become more realistic if you scroll up it'll become more uh kid-like and Illustrated you can adjust the tune anime slider and a bunch of different things until you find an art style that you like and then you just modify that uh character prompt a little bit to get different characters in the same art style that we're then going to use a different program to convert into a 3D model so here's the source character from the thumbnail of this video which I started out with and we will do a different character for this video but as you can see I was able to generate very cons consistent art styles but with different characters there's some robots and we got like this 3D cat and a 3D leopard and a 3D Panther and whatever the case may be so some pretty cool and consistent looking characters all right the next program we're going to use next website we're going to use is called hyper humans Roden uh and I will link all of these in the description of this video for those of you want to try it out this is one of a few different programs websites that you can use to convert illustrations into 3D models this is my current favorite because it seems to do quite a nice job with the uh way that the model is created so I'm going to grab a different character here cuz we've already seen the poopy in the intro of this video so I'm going to grab this little kitty and I'm going to use this as our reference image now I'm kind of concerned about this one because it's weird got some weird tals and some other stuff like that that I think might confuse Roden so I'm going to grab this one with the consistent single uh character single tail and uh generate that up and see what we get okay so this is what we've got as the preview now this is an ugly preview this is going to get better when we actually confirm it but basically it's checking with us on a few things uh it's got two tails at the moment cuz I guess it can't really tell the dimension but you know what this is a robo Kitty maybe it should have two tails I'm actually going to be okay with that uh there's a couple other things that it's asking about that you could correct for example I might say it has a single tail right I might say single tail and this uh would allow me to redo this prompt and uh maybe generate it with a single tail so you can use the reference image plus the prompt and sort of help it along if you're getting results that you don't like it will also automatically detect a few things such as smooth edges simple geometry sharp edges and so forth but if you disagree with any of its uh autogenerated selections kind of based on what it sees in the model you can tell it some other things like I might say this is a character I'm not sure what that will do I still got two tails well that's okay with a single tail maybe just try this with a single tail and we'll see if we can get a redo out of that with only one tail aha there we go I actually ended end up changing the prompting a little bit with a single tail coming out from behind it and sure enough well now we've only got our single tail from behind it does seem to be a bit weirdly attached to the model but you know what that's probably going to improve itself once I do the final generation I'm going to select the hyper option I think that gives us more detail with 10,000 polygons I think that's a decent amount of polygons for a character of this Simplicity and I'm going to go ahead and generate that this little preview is not really um popping up correctly but uh basically yes it is symmetrical as what you're going to answer this is a beta version so they've got a couple glitches here and there I think at the moment okay and there we actually have our higher resolution model and as you can see if we zoom into that geometry the polygons look quite good to me like they're nicely uh positioned nicely put together uh this is the problem that I've had with some other 3D model generators is the polygon output has looks super super weird but I feel like hyper human does a pretty good job with the polygons we do still have that issue with an attack tail behind so if I were to actually do this for real I would maybe even do a little bit of Photoshop and create a separation to distance that tail from the body so that it didn't didn't think it was actually supposed to be attached like that I'm not going to worry about it for the sake of this tutorial but uh yeah there's a ways to fix these little details certainly now the next thing we're going to do is generate the texture again based on the image uh what we're going to do is crank up the reference strength so that it is most alike the image source and we're going to click on G and now it's going to generate the 3D texture map for this model as well now each of these Generations takes about 30 seconds just so you know I'm going to pause the video but just so you know if in case you're curious how long it takes okay there we go um that's looking pretty good uh okay so let's now take this model and import this into Unreal Engine uh I'm going to need to First confirm that this texture is okay that I'm happy with it that I don't need to regenerate it uh basically the way that hyper human work works is that they charge you when you confirm and when you generate but you can retry the Generations on the preview model a number of times 15 or 50 times uh for free until you're happy or unhappy with the results and decide to uh keep the model or not now I have noticed a very big difference between the 1K and the 4K texture so I'm going to download the 4K texture in fbx format which is good for Unreal Engine go ahead and click on download to that okay back in Unreal Engine I've got my fbx model and textures in this folder here I'm going to go ahead and create a new folder and call it Kitty in my Unreal Engine project and then I'm going to drag the base fbx model over into Unreal Engine I'm going to click on import all now previously this had been importing the textures but it's not doing that today so what we're going to do is quickly fix that up by creating a new material and I'm going to call this the kitty material and then all I'm going to do is I'm going to assign the textures to this Kitty material okay so let's grab those texture maps and put them also into our kitty folder like so and we've got our material open here I'm going to grab the texture diffuse and I'm going to plug that into the base color I'm going to grab the metallic and I'm going to plug that into the metallic I'm going to grab the normal and I'm going to plug that into yeah you guessed it the normal I'm going to grab the roughness and that goes into roughness all right click apply click save and now back into our kitty model we'll open up our static Mash Kitty model over here and from our kitty model we're going to assign our new kitty material oh and we have our kitty cat isn't that nice that looks quite quite good kind of metallic and metal if I didn't want it to look as metallic and metal I could easily disconnect that metal but you know what I think what I'm going to do is apply 75% of the metal onto our Kitty that way we're kind of closer to the source reference I think that looks pretty good okay let's take our kitty and put our kitty now into the game and we'll take a closer look at him with lighting and everything like that all right let's hop right in there we go now we got a puppy and a kitty isn't that nice Hello Kitty don't you look good I think you look pretty pretty pretty not too very bad let's see let's compare so we've got our source Kitty on the left here and we've got our 3D model Kitty I think he's pretty darn I mean this is AI generated in a few minutes like that's cool for a certain style of game like with consistent characters for kind of a kind of a more cartoony Style game I think that this 3D pipeline is really really cool obviously it's got some limitations still but it's going to be pretty amazing to see what happens with this over the next year here's a look at another one of the characters that I imported and rigged up again with some procedural walk by the way if you guys want to see how I did the procedural walk rigging and basically added a bone and skeletal structure to the otherwise static mesh character that was imported let me know here are some of the other characters that I've also imported as 3D models from Leonardo AI to hyper human and then into unreal unreal engine uh you might be wondering what that little ball is on top of this anti boy's head well that's a laser beam ball he shoots laser beam balls obviously like any good robotic ant should and that's a bouncing ball of death I don't know I'm playing around with some fun physic stuff anyway hope you guys have enjoyed this video links in description to all of these softwares and of course patreon if you feel supportive I'll see you on the next one we're in this video we learned how to create an AI model from an AI illustration I'm sorry that everyone who studied to be an AI artist trust me I feel your pain the same thing is happening with music and lots of other things to behave maybe it'll actually just help to unlock creativity by reducing the barrier entry

Channel: DevDude

Views: 414

Keywords:

Id: DRp1E7An-EM

Length: 10min 9sec (609 seconds)

Published: Tue Jul 09 2024