3D AI Model Generation is Getting GOOD - UE5.4 Unreal Engine

greetings gentlemen ladies in today's video AI 3D model generation is getting pretty cool I'm going to show you a workflow uh that took this concept art illustration which I also generated with AI and then very quickly and easily converted that illustration into a 3D model which I have now rigged up with some procedural walk I think it looks actually very good let me show you the workflow I have figured out a pipeline that uh I rather like and works really quite well for exactly this sort of thing now it won't work with all sorts of characters like high resolution say Daz 3D real human character models is not going to do maybe such a good job but for certain types of games and art styles I think it's going to do a really nice job okay now there are all sorts of AI art generators but the one that I find really useful for character creation is actually going to be Leonardo Ai and that is specifically for its realtime generation feature what I've got in here is a robat where robotic antt and what you can also do with Leonardo's uh realtime generator is you can actually kind of tweak the sliders around until you find a certain art style that you like and then what you can you do is you can actually create sort of consistent characters within a similar art style robotic ant ant what's a robotic ant ant well that's twice as good right or twice as many uh and you know change the color around change the seat around regenerate but you kind of get a consistent art style and of course course there's a bit more kids illustration if dial it back a bit it'll get to be more of a serious looking illustration you can amp up the anime you can uh increase the folk art and that kind of makes it more like a Brothers Grim type of of sketch you know as it were or something like that were would be have would have been drawn uh in fairy tales of old but you can kind of tweak the sliders around and come up with different art styles for your game and then when you're happy with that you kind of want to remember your SE remember your sliders remember all those little numbers in particulars because then what you're going to be able to do is do you know little variations of character that are going to still hold that same art style right so this is a pipeline that I've kind of figure it out because you want to have kind of consistent characters in your game and as with all AI art generation you get some variation you just have to tweak around a little bit but these are some of the characters that I was able to kind of quickly and easily come up with using basically the same art styles but then as you can see we've got quite different looking characters that one's absolutely adorable some of these characters are so banging they they just scream video game I don't know anyway let's jump next into the conversion process how do we take one of these characters and transform it into a 3D model now I've tried a few of these different websites that convert images into models and they all kind of work although the one I feel like is currently working the best and that may change as time goes on but I'm really liking Roden by hyper human so let's go ahead and actually you can generate a model just by typing in a text input if you want to but let's go ahead and take our concept art cuz that way we can get some nice consistent characters right let's take our concept art and upload it into Roden here so I have opted on this nice little white ant right here he's got relatively simple geometry antenna that are not too complicated legs that are relatively uh big not too fine I mean like little tiny hairs and things like that are going to be kind of problematic to generate but if you got some solid structure to your model I find that Roden does quite a good job so I'm going to go ahead and click on generate here okay and when you generate this is the first thing you're going to get this is a preview it's not going to look that good this isn't going to be your final model this is just a preview of what it thinks to it it's supposed to generate uh the actual generation will come out a little bit different typically quite a bit better it's going to also pre-select a few things that you may decide that uh may or may not be a good idea for example it thinks it has sharp edges it thinks it has symmetric geometry if you disagree with that you can tell it that it might maybe should have like simple geometry or smooth edges right so in this case actually does have quite a few smooth edges I might want to help prompt it along if I don't get a good result by toggling on smooth edges but I'm actually just going to let it do its thing with its Auto detect first I'm actually going to also toggle on the hyper which I think well as it says takes a little bit longer but has a has a better time processing fine thin surfaces so something like antenna perhaps might uh come out better by toggling on hyper uh right under there on the number of polygons you can set how fine or gross you want your model to generate with 10,000 is a default so I that's what I've been using I'm going to go ahead and click on confirm and let that generate up only takes a minute pretty quick okay now that is generated and we can actually see the polygon sides the polygon faces and they look really quite clean to me if I take a look at the legs those look right they kind of got maybe a little bit attached but actually if I look at the image that seems like it's probably correc is uh and that also uh you know can be improved by choosing models that don't have sort of art styles that kind of seem to combine one thing with the other but I'm actually going to back the up and regenerate here let's go and say with four mechanical legs and let's see if it does a better job of detecting that that's like an interesting little leg attachment aha there we go now we have that attached a part of the leg which is distinctly an attachment to the primary fourth leg instead of its own sixth leg so prompting with four mechanical legs did help uh hyper humans Rod into to know what to do now the next step is to generate the texture and the texture is going to be generated based off of the image that is input so what I have typically been doing is well just kind of leaving it uh mostly to default sometimes I've been trying to dial this up or not basically complexity and Detail in PBR uh reference strike Bas based on the image that you provided and what I've actually typically been doing is just cranking that up uh I don't know what's best I haven't seen a massive amount of difference between the various sliders and I've run it through a tester quite a few times but since it is AI you get slightly different variations each time to get so to get consistent test results where you get inconsistency in AI each time is kind of diff difficult to evaluate but for the most part and that was a mouthful for the most part it does a pretty good job of generating a nice looking texture so let's do that okay there we go that I mean shoot that looks good right like there's our SCE reference image there's our 3D model now in order to export these to Unreal Engine I'm going to want to choose the fbx option I'm going to want to be on PBR shaded uh oh before you can actually do all that you have to confirm that you're happy with the texture if you want to regenerate it with some of the different settings you can do so and see how all those different settings look but I think that's pretty good so I'm going to go ahead and click on confirm and it'll do a final generation of that preview texture and there we go that was actually pretty quick from from here I will select the fbx option if you're trying this for free you won't have the 4K textures but you can unlock the 4K textures is a pretty reasonable pricing strategy on hyper human uh I they charge one credit or something per various things and yeah it's not really too expensive when you consider uh how many models 3D character models you can get for a very very inexpensive modeling free it's uh pretty pretty reasonable what but what I have noticed and you can try 1K yourself for free but what I have noticed is those 4K textures are noticeably better they look a lot a lot better so you need to unlock the 4K textures oh by the way I will put the links to this hyper human and also to Leonardo art AI in the description of the uh of this video if you guys want to support this channel whenever I'm featuring a different product or service like that sometimes there may be some affiliate links in there which will help to support this poor demonetized channel uh kind of keep me going there so I appreciate the support anyway PBR 4K fbx download let's bring her on over into Unreal Engine okay over an Unreal Engine I'm going to drag and drop the base fbx into Unreal Engine and I'm just going to select to create materials now normally this creates materials though today it seems to be having a weird little issue where it's only bringing in the Bas fbx model without the textures and stuff I'm not sure I've been troubleshooting this for a while uh the other day this was working perfectly but you know what that's okay because we can EAS easily fix this ourselves just by grabbing the textures and dragging them also into the same folder here and then we can just go quickly and create a new material and we will call this our ant material and in our ant material we will grab our texture diffuse and connect that over to the base color we will grab our matallic and connect that over to the metallic that makes sense grab our normal connect that to the normal and we shall grab our roughness and we shall connect that to the roughness and apply there we go and then we will simply assign the material to our little ant creature like so there we go we've got our ant isn't that nice I think he looks marvelous doesn't he look Marvel I think he looks absolutely fantastic um let's take a look at him under some lighting conditions in the game cuz I found that you add a little bit of lighting conditions to these models and they really start wait you know what before we can look at him in our game I got too excited we're going to have to actually put him in the game that that that's just an important part of game development very important uh okay there we go here's our new guy he's bigger actually than I thought he would be but uh I mean shoot from concept art guys from concept art to 3D model let's take a look at that concept art again okay so so there's our initial concept art that we generated with Leonardo Ai and then we've got our actual character in the game I mean that's good like that's good I'm impressed you know this is rad uh for you guys anything like me uh one of the main struggles with game development is finding a way to create consistent characters while this pipeline maybe not suitable for like realistic humans yet although give it a year it's probably going to be phenomenal um but for sort of stylized games with uh you know different sort of stylized characters I think this is absolutely phenomenal and you could do some really really cool stuff and just let your imagination run wild with all the different sort of Arts Styles and characters and creatures you could generate anyway that is it gentlemen ladies hope you've enjoyed this video from Leonardo AI to hyper humans Roden and again if you feel free to uh click that link in the description supports this channel much appreciated and I'll see you in the next one oh and by the way if you guys are curious how to turn this into an anime since a star out as a skeletal mesh if you're curious how to turn this into a skeletal mesh sorry static mesh to skeletal mesh and then you can rig it up using Unreal engines built-in native skeletal rigging uh rigging rigger there we go so you can rig up your characters from static mesh in unreal engine you can animate them using procedural walk or uh probably by using Unreal engines base model if you got a human character that you're bringing in you could absolutely do that uh if you guys want to see a video on how to rig up your characters how to animate them let me know in the comments and if I get enough requests I'll make a video on that next okay see you in the next one appreciate all your support by the way there's a patreon link if you guys feel so inclined all appreciate thank you very much

Channel: Werewolven

Views: 150,215

Keywords: game development, game dev diary, indie game, developer diary, indie game development, game dev log, unreal engine, ue5, ue5.1, ue4, daz3d

Id: RWl_FNP6mq8

Length: 12min 25sec (745 seconds)

Published: Sun Jun 23 2024