VRoid to VRChat [Advanced Tutorial] All Blender Fixes & More!

if you want a fully working viewraid model that's compatible with full body tracking and three-point tracking getting rid of the pee-pee dance fixing up the full body issues moving here facial expressions and more then you have come to the right place this is my complete guide to the perfect vr chat v-ray model we're gonna use some simple blender beginner skills to jump right into it today and by the end you're gonna have the v-ray of your dreams all right so i'm going to speed through everything we need as you should mostly have all of it installed so you'll need your blender i use 2.92 unity 2019.4.29 you're going to make sure that you have the vrm importer add-on for blender have the cats plug-in for blender and then the sdk3 make sure you're using a recent version um because there are some bug fixes so if you haven't downloaded it literally like this week you probably should get a new version or it might mess you up then of course you will be adding in hair physics for your viewpoint so make sure you cop dynamic bone uh definitely the best 20 you'll spend in your life now let's start by proportioning your model to fit your actual um irl sizes so what i did is i actually have this model that i already imported into vr chat and i noticed that the proportions were pretty uh unaccurate to what i actually am so um as you can see in this photo this is how when i'm calibrating um the balls or where my trackers are and they come up right into my shins this one's about the waist and the hands um are slightly long so what i'm going to do is i'm going to reproportion my vibroid in the v-ray program to just fit these proportions so what i've been doing is i'm going to full body i'm just going to make myself slightly shorter because i just want the avatar to be a bit shorter overall so i'm actually going to do this to about 0.5 now as much as i love you having long legs we're gonna bring this a lot shorter to match my more um irl leg length then i'm just going to shrink down those arms by a bit here and now the avatar should match my irl proportions and not be so anime exaggerated like they've been all right and now as always i'm going to click delete transparent meshes and with that out of the way everything should be pretty good to export if there's any other optimization you want to do straight in the v-ray program go for it otherwise the model should be good to go i also recommend having a specific folder for each of your vrm models so even if i did like another vrm um i would put the folder in here instead of having all the files together because in blender it's gonna jump all your textures out and if you have all the textures for different models in the same folder things are gonna get pretty jumbled up and messy so we don't want that so just keep everything organized great and now we can open up blender and start a new project file i'm gonna go ahead and press a to select everything in the scene and then delete and now hopefully you already have the plugins installed uh but if you don't then i'll just quickly go over that again you go to preferences install find the zip folders and then make sure they are check marked in your preferences here um from there we can do file we're gonna do import and then come down to vrm and then locate the model that we just exported great so now our model is imported and looks all gray so of course what we can come do to fix up the model is open this little arrow go to the cats plug-in and fix model while it's selected great so now it went ahead and applied all our textures fixed up the model for us so the basic things we want to do is go to the eye tracking should automatically fill everything in for us so just hit create eye tracking and then the visemes for vr chat we're just going to hit create via seams it should fill in the auni for you automatically perfect so now we have the eye tracking for vr chat and the lip tracking for vr chat all finished up so now we can go on to the actual um full body fixes so i'm gonna take this part a little slower seeing as you probably have never done anything like this before um so what we're gonna be doing is two things so the first thing we're going to do is fix the saggy shoulders that b words will have um in full body tracking that we do not want we don't want those shoulders to just weigh down completely and the other thing we're going to do is for half body how a lot of times the models will have the peepee dance we want to fix the peepee dance and make those legs straight because naturally viewered legs are kind of angled inwards especially the male models that's very prominent on the male models but we're obviously doing this on my female one um so we'll be just fixing that up so let's start with the shoulder fix because this is incredibly simple um all we're going to do is make sure that we have the armature selected so select on there make sure it's all kind of orangey yellow color and then you can either press tab or change to edit mode here and from here we're going to be able to edit the size of the shoulder bone so i'm going to click on this little circle here make sure i'm on the move tool come up here where this little butterfly is and you can see there's an x so we want to mirror on the x-axis so now when we move this bone it'll move this bone as well and now we're literally just going to slide this back and make it nice and tiny this is going to make it when the shoulder bends it's only bending out of this tiny little area instead of dragging the entire thing down just make sure you do not move this little area at all because if you do for some reason it actually causes an issue with the hip where the hip ends up swinging to the side and looking like this so make sure that when you're doing this little arm fix that um you literally just touch this part and nothing more alright so now we're going to straighten out these legs the first thing we'll want to do is come down to this little foot bone right here so let's just click on that and change over to pose mode because we're going to be repositioning the legs yes you get it um so we'll come here and then click on this little green bone icon which are the bone properties so that we can uh fix this little guy what we're going to do is we're going to come to relations and then uncheck inherit rotation and i'll show you in a minute but basically what that means is that the foot no matter where we rotate the rest of the leg is going to be planted on the ground because if we move the leg around and the bone doesn't have inherent rotation it's going to kind of rotate itself upwards and kind of be flicked up so we're going to make sure we have that turned on and i'll show you how it looks without it in a minute okay so now we're going to grab the thigh bone and we're going to start straightening this out now we're going to do a top-down view of the model so you can either press 7 on your numpad or you can press this little circle over here which is gonna just kind of change your view position um so let's press that and we're gonna get this nice top down view and you're gonna see that because we selected that bone there's going to be two circles here so if we come back down here um you're gonna see there's the top circle and the bottom circle and all we want to do is just align that straight so i'm gonna press seven again and now you're just going to align these bones baby so to do this we're gonna come over to the rotate tool and then with the rotate tool i'm just gonna ever so slightly start to even this out and it's gonna take some finagling it's quite sensitive to your mouse but it doesn't have to be absolutely perfect but let's just get these bones kind of similar maybe about there and rotate this direction come on there um it doesn't have to be perfect but it looks pretty even right there so if we come back down um you can see that it's a lot more straight now which is exactly what we want so now we're going to do the same for the shin bone here i'm going to click on that and then press seven on my num and then you'll see that we have the um circle here so let's go ahead and bring this about there and then bring it down there and then awesome if we come down you'll see that the leg on this side um is a lot more straight now and it's been straightened out so you can see this one has a slight tilt in this one tilts down which is exactly what we want now what we can do is i'm going to hold shift and click on the bottom and the top and then what we're going to do is we're going to apply these changes over to this leg as well so i'm going to do control c and then to mirror the option we're going to do control shift v and then as you can see it automatically applies at steelers side as well which is perfect now i wanted to show you on here we can see that this foot has the inherent rotation turned off but this one does not so it inherited the rotation of the other bone so as you can see it actually kind of flicks upwards it's rotating upwards um like i mentioned before so you can see why that's a problem so we want to ground it so let's come back over to the bone option while it's selected and hit inherit rotation off and that's just going to gently bring it down which is perfect and now that we've made all these changes to the positioning of the model we want to do apply as a rest pose and that's gonna set all the changes that we made into the model um and kind of fix up those like tilts to being more straight so you shouldn't have um the pp problem as much anymore also in pose mode we're gonna hit number three on the numpad or press this little x here um to get a side view now we're going to click on this shin bone with the rotation tool and ever so slightly just bring that back a little bit to add some bend in the legs and then of course we're going to do control copy and then ctrl shift b for the other side and apply as rest pose also another fix that you might want to know is um for some models for some reason um depending on just like the proportions of it you'll see that the feet actually when you go into your chat are dipping into the ground so to fix that if you come into blender you'll see that our um armature here for where the feet are is actually hovering above the feet which is um incorrect we do not want it to be like that so what we're going to do is select the armature um change over to edit mode and then we're basically going to just re-angle all of this to fit inside of the foot itself so i'm going to start by taking this with the move tool and you're stretching it down i'm going to do the same for this big one line it up with the foot here then i'm just going to select this whole bone drag it straight down and then that should take care of that problem now the last thing about v-reed models that i like to fix up is if it has like um skin tight clothing or their collar bones um shown they definitely protrude by quite a lot and i like to bring those down a little bit and it's actually quite simple how to fix that as well so i'm going to click an object mode on the body and then i'm going to come over to sculpt mode and literally what we're going to do is we're just going to push the collarbone down so i'm going to come over there's a whole bunch of different tools here we're gonna find these yellow ones and i'm gonna click grab which is basically the most basic ones um i'm gonna make sure that my uh mirroring is on on the x-axis again and just kind of come over here zoom in real quick and just drag this down in different points wherever i want the collarbone to be less noticeable and there you have it now it's less protruding and looks a lot cleaner you can do that for any part of your model as well so if you did want to make your model let's say a little thicker you could always grab different parts of the model um like that basically except for you'd want to make it um you know have a bigger radius uh and just kind of drag out like that so that is how you can make your model larger um if you want to do a different body proportion great so now i'm just going to return back to object mode um and the model should be ready to export so everything is looking pretty good here we fixed the shoulders we straightened out the legs if you did want to fix like the hip rotation at all um you could always come down to this bone go to edit mode like we did before click on this and you can um just kind of move that the way that you want uh but typically i'm fine with kind of this natural curve of the spine that the model has uh translates pretty well into full body tracking great so now in object mode i'll select the model and then i'm going to come up here to export model now that i've located where i want to put my model i'm just going to name it and then i'm going to come over here to path mode and select copy and i'm also going to make sure that this little box is checked and this is going to embed our textures into the model so that we don't have to import them individually so all we have to do in unity is just extract them and it'll work all right and now we're going to make a new ud project with the 2019.4.29 f1 project um i'm just going to label that whatever you want it to be and finally you're going to want your shader of choice i'm going to be using puyo mutant shader seeing as it is the most popular great so now let's add everything into our project that we're going to need um that's going to be the vrchat sdk3 you're going to want to put in your shader you're going to want to put in dynamic bones and of course your model all right now that we have everything imported i'm going to do the same as the last tutorial which hopefully you're familiar with already if not i'm just going to skim over it super quickly so just follow along best you can we're going to click on the model in the assets folder come to materials and then extract textures into its own folder and then same with the materials also i'm going to drag the model into here and you can see that the textures and materials applied perfectly i'm going to click back on here and a quick tip i'm going to make that everybody everybody everybody should pay attention to this is very important is if you decide to bring in a fixed up model so like let's say i tried this one out in vr chat and the shoulders are still too saggy for me and i need to go back and fix it instead of having to redo all your effort on your model literally all you have to do is drag and drop the model into the assets folder and then come up here where it says on demand remap then you can change the naming to models name and model's material and then search project wide and then search and remap and all of the effort you did on your first model will be applied to your next model so that way you don't have to repeat constantly the exact same steps to make everything again so please remember that now swing over to rig make sure that we're selected on humanoid click apply now hit configure save then all the buttons should be lined up correctly other than this one head bone in the jaw where there's a hair joint so just select that and delete and then come down hit apply and done now come to textures make sure you're using the appropriate textures for each of your things like here i have the white eyeline and the white scalp so i'm going to replace those by just deleting and dragging in the new files then for the updated textures do alpha as transparency for all the ones that have alpha then go to your materials we're going to fix our old textures like the scalp here by clicking on textures there and dragging it into the new albedo which will replace it now select our shaders by going from here going to puyome go to tune and then click the appropriate one for all the facial features which need to have opacity on the sides we're just going to do transparent and then for all the things that don't need transparency such as the face we're going to select opaque also this weird extra eye thing that they always add in let's just go to main and i am literally going to turn this alpha all the way down so that it doesn't even show anymore now i do recommend that you test out your model as working in vr chat before you add your hair dynamic bones or the facial expressions that way you don't have to redo your work in case something was off so let's start by adding dynamic bones to the hair so we're going to go to our sample scene select on our body and then drop down all of this until we find our head from there you're going to see all of these lovely hair joints so what we can do is we can go through these one by one and add hair joints to every single piece of this so what we can do is go through each of these one by one it will take just a little while and add dynamic bones to each of these so you can click on it and then add your components we're going to add our dynamic bone component from here you can change a lot of the movement settings um personally i think that the default ones work great as is so what i'm going to do is just copy this hair joint bring it up to the root and that's just going to apply it to the hair now what you can do is if you did make any of these settings changes um we can come to this little drop down menu here and then do copy component and we are just going to go right up to the next hair joint come up to this little button and then do paste component as new and that's just going to add all of the same settings to the new hair strand all you have to do is replace the root with the new hair and then we can go through all of these one by one and add in the correct hair joints so then just repeat that for all of the hairs great so i finally finished all of the hair joints um so what we can do to test this is go back click on the model and press this play button where we can test the actual movements now click on scene make sure we have the model selected here and then we can drag the model around with the move tool just to see the hair actually moving which is uh fantastic it looks pretty good obviously it might clip and stuff a little bit actually in game which is why you kind of have to play around with the settings a few times to figure out what works for you but like i said honestly just the default um settings work perfectly well for me so that's what i keep it to now if you do want the chest to move you can also do the exact same thing with the dynamic bones you can do breast l and breast right don't do the second bones just do these main ones and add dynamic bone to that as well and now you can see the jiggle physics are working great so now i'm just going to close this up and we can move on to the facial expressions so how we're going to do facial expressions is we're going to make animations for the different expressions that we want and then assign them to hand gestures so let's start by creating the facial animation so click on your model and then you're going to do ctrl d to duplicate it because we never want to do any animations on your main model in case something does get stuck or screwed up it won't affect your main model so go to your main one and then you can just click this little check mark to hide it and then only your duplicated one will show now come up to window and you're going to add our animation window so go ahead and click on that and then personally i'm going to drag the little menu down here so it adds on to stay more organized now what we need to do is open up the model here and locate body because body includes um you know the face and the body and all the meshes and our blend shapes which actually are the different facial expressions so if you click on blend shapes you're going to see every single different facial expression that we can possibly make here so for example all the ones we added with cats with a different mouse movements and then of course all the different things like if we want the joint mouse we can do that or we can come down to all which is what i'm personally going to be working with um where we can do things like happy now all you have to do is create an animation clip and we're going to make a new folder for animations and i'm just literally going to call it animations click into there and then name this one whatever you want it to be so i'm going to do via smile now we can just hit the record button and our model is going to jump down to this little animation pose and then any animation we want to make we can literally do by just clicking um dragging this facial expression so for fun i'm just gonna drag this up all the way and now we have a smiley animation and to end the animation all we're going to do is we're going to select both of those press copy and then jump to the next second over and then press paste and that'll make it so the animation is one frame long which is all that we need for a simple facial expression so we'll click off the record button and it should be set now we're going to repeat this for all the facial expressions that you want to use on your model so i'm going to go ahead and create a new clip this one i'm going to do via joy and then i will hit record again and i'm going to do joy bring it all the way back there copy one frame over paste stop recording and repeat great so now we have all the facial expressions created so we can come back to project what we're going to do is locate our gesture controller which is going to be hidden in the vr chat sdk so come here we're going to go to examples 3 animation controllers and then you can shift through these by looking up at the names and we're gonna find the ones with the hands so if you double click on it it's gonna open up this little menu and you can click on the left hand in the right hand to see the different animations it can make so what we're going to do is you're actually going to duplicate this so ctrl d and then i'm going to rename this to fia gestures i'm going to click and drag this into my assets folder where i can easily access it now from here we're going to be able to easily change what gesture makes the different facial expressions so for me i like to do thumbs up as smiles so i'm gonna go into my animations make sure i'm clicked on a thumbs up and then up here where we have the motion we are going to select the motion that we want the v-ray to make so i am going to do fia smile and drag that up here and we're just going to repeat that for all the different facial expressions that we want on each of these all right i put these all on the left hand personally you can put them on the right hand as well but i like to just control it with one hand at any given time also make sure that when you're adding in your motions that you have right defaults checked on otherwise your animations will just get stuck and they won't turn off so then as you make different facial expressions they'll all just kind of blend together and you won't be able to undo them now let's go back to scene and we're going to hide this duplicated model and go back to our original now all that is left to do is do our avatar descriptor and make sure that everything else is ready to go so go to add component avatar descriptor and then the same as you've probably done before we're gonna press edit move our little ball down to right between the eyes for the viewpoint we're going to do auto detect for the lip sync which should fill in everything for you i look we're going to auto detect that and then for the bones remember we're not going to use the v-roid bone which is the i underscore l i underscore right it is the left eye right eye now because we duplicated the model we're going to have two sets of these and typically it should be the original model on the top and then the secondary model on the bottom so click on that and then same thing for this one right eye and then for rotation states i'm going to do negative 15 personally you can do whatever number it feels right to you and then do the same for these side looks now for the eye blinking we're going to go back to blend shapes and we are going to locate the body mesh so click on this uh drop down here and then select body since that's where all our blend shapes are located and then we want the blend shape that does the eye close movement so just like that for these we can just set it to none and then the fun thing that we're going to add on here this time is the playable layers so press customize and then come down to your fx layer and all we have to do is click on this and then drag in our gestures that we created with the hand motions and that should automatically um set all that for us and great our model should be good to go now so i'm going to come to vrchat sdk show control panel while the model is selected and then i'm going to come here and try and fix all my errors so auto fix for all of these ones and then quick note if your model does say polygons and it's like in the billions that's because you're not using the more recent version of the yarcha sdk and the way that you can fix that is by clicking on your model um coming over to the model tab and then making sure read write enable is on but pressing the auto fix fixed that for us automatically so you'll notice that the optimization on this model is very poor and that is because of all the dynamic bones we added anytime you add dynamic bones the model's not going to be as optimized if you want to get your model down to like medium performance then the most you can use is actually 16. so what you can do is remove a whole bunch of dynamic bones if you're trying to be a little bit more optimized like get it down to poor um you can do 32. so an easy way to do that is just make it so that all the secondary bones here don't have it and you can just kind of do all the main ones or go through and figure out which bones don't really need movement at all or that you're okay with getting rid of and just change everything like that so i recommend using as little dynamic bones as humanly possible or none at all and then atlessing your textures in blender using cats another tip is to make a casual version of your model and an optimized version of your model we can duplicate our model like we did before and then detach the model id that vr chat assigns to your model when it's uploaded so you can have a second version and then remove all your dynamic bones so you have one that shows up as better performance in the game but with all of that out of the way um you can go ahead and upload your model for offline testing to make sure that everything looks okay um and then when the model is ready you can do build and publish for windows all right so this is an older model of mine um here in three point body tracking so as you can see if i've been down um the legs crossed and the peepee dance so we're gonna switch that over to the new revised model and as you can see when i bend down there is no more pptan so it looks a lot more normal and now that we see how it looks in three point tracking let's change back into full body as you can see when i calibrate um my placement of my controllers in trackers is a lot closer to how my body actually is my shoulders do not sag whatsoever you can take a look and see that they look um perfectly straight so that's all fixed up um the feet and toes are perfectly level on the ground um collarbones all fixed up and of course we have the hair movement so if i move up and down or side to side you can see that that's going finally we have the facial expression so i got my smile like this my shocked face and then my kind of annoyed one so everything is super expressive now um it turned out fantastic um so this is a complete v-ray model with all the fixes yeah i really hope that you enjoyed this tutorial video and that it was helpful for you if it was then please give it a like and subscribe to the channel for more v-ray content comment down below what kind of video you would like to see me make next and if you do have any more issues or questions you can always join my discord link in the description to ask for help people that are always willing to help each other out anyways that wraps up this video thanks so much for watching and i'll see you in the next video bye special thanks to this month's patreon members in virtual vips do tech clue clay mr cheerio scoremaller [Music] [Music]

Channel: The Virtual Reality Show

Views: 123,683

Keywords: vroid to vrchat, how to use vroid in vrchat, how to import vroid to vrchat, vroid to blender, vroid unity 2019, vrchat avatar tutorial, vrchat vroid avatar, vrchat tutorial, vroid tutorial, vroid advanced tutorial, vrchat advanced tutorial, how to add hair movement to vroid, vroid facial expressions, saggy shoulders, vroid shoulders, vroid fbt, vroid full body tracking, vroid crossing legs, vroid crossed legs, shoes in ground, dynamic bones, vrchat, vtuber, vroid, vrc, phiabunny

Id: Qbwl9XIONuQ

Length: 27min 17sec (1637 seconds)

Published: Thu Aug 26 2021