Daz Studio Audio ~ Using Audio with Facemotion for Character Facial Animation

hi friends welcome back this is solomon jaguar i hope you guys are all doing well uh if you're new to my channel i think i kindly ask that you spare a minute to subscribe and hit that notification bell so you are like it when i post a new video and to everybody else that has subscribed as always i thank you i appreciate all your support so today i'm gonna be talking about uh audio in dart studio together with a face motion and i posted a video sometime back this clip right here [Music] and i'll share the video in the bring me the ore i shared the video in the link below so you can check it out but i wanted to show the how audio works in that studio someone had asked me you know how do we add audio in the studio it's not kind it's not straightforward because you don't even see it on the timeline so i wanted to share some insight and thoughts about that so we're going to be using this video as a reference as a case study and this the idea is based on this uh tom cruise movie the mummy with that crazy looking character that had like two eyeballs seemed like a small one and a big one and so today we're gonna be using that as our case study and this model is available on the das 3d marketplace and it's going to be our case study today so the idea again too is to show how audio works together with our face motion and so the first step is uh when you record your mockup you know in using the facecap ios app you're gonna receive three files one is gonna be the video of yourself you know for this case this is my wife who voice acted this character and you're also gonna get the fbx file right so that fbx file has the data that has the facial animation and the third file is going to be the wav file you know so i did three takes of this character one we the idea was to have a servant but uh due to time we weren't able to include that so i took i'm gonna use this one uh it's tucomona i had to come up with a cool name that sounds great when you're doing the voice acting so my wife played that part she played it really really well and i'm i appreciate the awesome support that she gave me so we're gonna import the mock-up file first the official animation and then we'll talk about the audio so go to file import and then let me go back up here it's going to be to communal number two open that okay and so it's gonna come in as a group scale file this is the file that you actually need okay select your character and then i'm gonna use face motion and it's gonna be under my script and i'm gonna double click on face motion and i want to have some shoulder movement so i'll and i've made this pose i've not disabled head influence so these are the initial settings that i'm going to work with then click transfer facial data and rotation make sure you're on the first frame on the first keyframe and click transfer facial data and rotation and depending again on how fast your computer is you're gonna see the difference so that was pretty quick okay and so if i zoom out and bring up a timeline and we play back bring me there let's do the abandoned and you will be rewarded with the riches and told so this is my voice me speaking but what if you wanted to hear the voice inside of that studio you know so that you get a chance to review before you actually render because ultimately you want to be able to render a sequence of images and then send them to your editing program but sometimes you may want to preview you know just in real time so that if there's anything that you need to adjust you know emotion wise the smile or the anger then you can do it here with the audio in the scene so that you can hear it and also sit at the same time and make that those adjustments now the timeline by default and i think this is going to change in the future but right now on the timeline there's no track for audio yet you know so i know that studio is going to change this but for now for those of you if you're really trying to add audio to your animation there's no straightforward way yet i'm saying yet because i know something it's going to be updated at some point so what i do is i go to edit up at the top and then click on audio now remember i mentioned that when you do your when you do your facial animation with the ios and the face cap ios app you're going to be given three files so one of them is going to be an audio file so click on audio here it's going to be under edit audio click on that and then go browse to the folder where that file is and it's uh make sure you you just select the same number it's important to name these files you know specifically it must it's going to be much easier for you to find them and utilize them so we have to communicate number two open that one and by nature when you first do the facial mock-up with the if the that ios app if you need to offset it by about five frames so for some reason it doesn't line up properly if you don't do that but if you want it to be synced properly and these are adjustments you can make afterwards but by default i'm going to put a 5 because it's going to ask you where do you want the audio to start what frame would you like to start and i'm going to do a start on audio on number five frame five and you can also play it so you can hear it and you can do you hear that guys okay so let me go ahead and press accept first of all bring me the orb of zephyr okay so i know and you will be rewarded with riches untold but there's no stop button let me first clear it sorry about that so i think this yeah this interface still needs some help that probably if you want to play there should be like a stop button you know replay or something like that but right now it's just play so i'm going to reload this uh file to communicate number two i'm not gonna play play at least i just give you a an idea of what it sounds like that you can hear it all right and offset it by five frames and click accept and make sure you select automatically adjust animation range because you want all those uh that data to be on on the entire timeline so click accept all right so let me actually put on my hits here real quick all right so we're going to go ahead and play back so the audio has actually been added so if you press play and you can hear the clapper bring me the orb of zepha to kamuna and you will be rewarded with riches untold so there you have it guys audio in the studio on your special animation so you can actually hear it and play it back and review so that you can make changes so let me go back again and that clapper that clubber you had is to give you an idea of when it starts when you press record so bring me the orb of zephyr to kamuna and you will be rewarded with riches untold so there it is we have audio in dar studio so for everybody else that has been asking about you know how do you add audio is it possible to even have audio in that studio yes the answer is a definite yes you can have audio in the studio and you can use it to review your animation and make changes so you could use like the face controls for example to make adjustments to the mouth the eyes and whatever and then come back here and just uh play back play it back so you can see the character in real time hear it bring me the orb of zepha tukamuna and you will be rewarded with riches untold there we go so but you notice that when it's playing back it knocks the character down to a lower subdivision so eventually i mean when you're rendering it won't look like the way it's playing back it will look like this so that was a quick tutorial and also a quick insight uh to share with you guys how to add audio in da studio and at some point i'm hoping that they add it here on the timeline so you can actually see the wav form and also be able to move it around but for now i i'm if you guys know where this actually track is because right now it's hidden or maybe there is a way to expose that you know information that we can edit because it'll be nice to actually slide it back and forth but ultimately so now when you're ready to render you simply go to your render settings so if you want to hear the audio so maybe you want to do like a preview now the cool thing is that with the the filament render engine you can get at least two two seconds per frame so you could do like a quick preview of how this animation looks together with the audio but in order to do that you have to select instead of png over here it if you select that it's not going to work so you have to go up at the top over here instead of image series make sure you select movie in your and then in your render settings and then select the range and you can do an avi that's right now that's the only format that is available i was hoping it would have like mp4 but i think i think the idea again is to have an uncompressed version that you can then take to your editing program and then compress afterwards you know when you maybe you're uploading for youtube so that is the way you can do a preview listen to it i just make any changes that you want but the cool thing is that with the new um das studio 4.14 pro you have filament render engine that you can that helps you to preview this animation so you could do like multiple texts for example different cameras so i have this camera here you could have another camera that's at a different you know shot for example so render it out with a filament and then get a preview uh this is great for previous you know if you're working on a short film or you're trying to give your art director an idea of what you the idea you have in mind so guys if you're like an indie filmmaker and a storyteller and you want to share you know a quick idea a quick story sci-fi story this is a cool way to do it with audio in the studio so thank you so much guys for joining me today please don't forget to subscribe and hit that notification bell so you are alerted when i post a new video end up dare to dream big don't ever give up on your dream guys and let's take advantage of these tools to tell our stories stay safe bye for now you

Channel: Solomon Jagwe

Views: 11,169

Keywords: audio in Daz, daz studio audio, Daz, DAZ3d, DAZ studio, dazstudio, daz animation, daz facial animation, performance capture, mocap, motion capture, acting, acting for animation, solomon jagwe, african artists, african art, napoleon, imagemetrics, faceware, live face, facial animation, short film, realtime rendering, daz iray, iclone, iphone X, iphone facial mocap, facecap, facecap mocap, Perception neuron, mocap suit, real time mocap, Facemotion, face motion, facemojo, face mojo

Id: LxQU0YQc5LA

Length: 12min 12sec (732 seconds)

Published: Tue Jan 05 2021