How To Remix Tiktok Dancer x Influencer into VROID Character Using Blender

welcome back to benediction live today i want to show you this little remix project that i was doing the other day so basically uh you can see here this is like an anime character doing a skating in 3d and the whole thing believe it or not the whole thing is already available for you i'm using blender 2.92 and the character if you if you know this is from freud from freud's studio the scalar shoes the one with wing is actually from sketchfab so i just grabbed this from sketchfab from this user dpid and let me close this and we have this freud we have the english version of freud freud studio this is actually like kind of like character generators that you can use uh you can generate your own character you can use it in many different apps i think the one being used is the one inside unity if you have quest vr but i'm using it with tdpdf in basically on my iphone and you can see here we can supply a video we can capture like a real-time video and apply it into the character so what i did here so you can see the character this character have animations and i already retargeted into this freud character and i'm using this video from tiktok this by studio anisa she's an influencer i think she's also really active on twitter it's doing this skating dance and it's good animation reference because you can you can see the whole body her performance skating and here i'm actually converting it into animations that i can use inside blender right if you use the tdpt app on the iphone you can convert this motion the full body motions into something that you can use inside blender all right so that's basically the whole idea and in in blender i have this new character and i'm using the shoes sorry about the shoes it's not perfectly rigged into the bone but yeah i'm gonna show you okay again i'm using blender 2.92 for all the compatibility with rococo with all the all the add-on so i already have the cats add-on installed so cat's blender plug-in is something that you can download this is to import a void freud model and there's a whole community actually working with this it's pretty impressive but anyway uh so i'm using this freud studio right i'm using the basic preset character i just make the head a little bit larger you can use any of the character or make your own character and you just simply export it out so you can use it inside blender file import vrm this is using the cats cats add-on plugin i simply bring in model when you bring in bring it into blender it might not look correct so you need to fix it first using the cat add-on so we need to fix the model it's gonna do all kind of magic now we have this character um now let's see we have can we post this character so by default if you try to pause it it's gonna look really weird you actually need to uh you need to activate this just click on this button once you do that the character actually can be posed properly okay so let's save this very quickly so this is vrm dance so the next thing i will do is to bring in the animations that i converted from the studio anissa skate animations so it's gonna come in as bvh so this is really just like a remixing whatever that's already available online so we have this animation this is the anissa doing the skate dance it's actually in 3d which is really interesting it's a it's taking the information from from the tik tok video and then converting it into 3d space based on the video camera right so we have this and the next thing we can do using the rococo rococo studiolive we can do the retargeting so source is this this motions and this is the animation target armature and then build build the bone list it's gonna try to do it automatically if there is no matching [Music] bones you might need to do it manually but you have you just need to do it once and then you just retarget the animations uh just wait a few seconds yeah now the character is animated of course character is animating uh it's kind of like skating so let's save this the next the next thing we want to do is to bring in the skate shoes it comes in as fbx yeah this a lot of different parts to um a better idea is to to do it this way okay file import fbx sometimes dealing with assets can be tricky so it comes as a lot of objects select all by type mesh simply join this this is like a really beautiful design of skating issues right click set origin to geometry now geometry is set to the center copy this back to our vr endings so we're gonna give this boy a skate shoes so it's remixing the shoes 3d assets and the boy character if we go to edit modes it's gonna look like that all right we're gonna try to parent it so we can actually uh put this in the red the rest position now we're gonna i'm gonna make the shoes for this boy character could be slightly tricky he already have shoes we can delete the original shoes keep the socks maybe this may be correct let's create duplicates go to edit mode and then flip flip the mesh mesh mirror in the x global if you do that the normal will be flip as well be careful okay so you need to flip the normal so now it's correct really it's supposedly just a matter of parenting this to this guy there are many ways you can skin it i think you're supposed to be skinning it but i'm just gonna use parenting i guess for now select these shoes select this guy control panel parent to bone relative so select the post bone once again select this object let's choose and select this and then command p bone relative so hopefully our character have the shoes on so we have scatterboy interesting right so so remixing just a few different assets from what's already available online of course it's not not uncommon it's actually really quite common to do uh you are referencing a dance or some kind of performance and you're using it uh in your animations if you do this by hand and manually it takes a long time but i just did it in a few seconds which is really really quite interesting so in tik tok there are lots of performance dance and then um mostly like full body like dance like this in this case studio anissa is doing this uh of course skate animations maybe i should compare it right i think this should be set to 30 frames per seconds okay nice should be let's correct again it's probably mirror yeah but you can do this um you can try on performance i mean if you if you know how to skate but most of the time you need to source a talent that you can do like a dance or a scaling performance but i think it's going to be quite interesting for the future of animation project alright so hopefully you find this useful and interesting thanks again for tuning in and i'll see you next time thank you bye

Channel: Jimmy Gunawan

Views: 17,862

Keywords:

Id: gGdSRfNpYYw

Length: 12min 2sec (722 seconds)

Published: Sun Sep 05 2021