Blender Character Pipeline #4 - Creating Facial and Lip Sync Animation in iClone for Blender

they all took the hats off and waited just waited we were more than kings we were the mob greetings my name is peter alexander in this video i'm going to run you through the process of using aculips in iclone's lip sync technology to animate a laughing buddha type character i created i recorded my voice using audacity an audio manipulation application and altered the audio's pitch my name is hote but you probably know me as the laughing buddha i'll save it as an mp3 which is supported by iclone i've already done most of the characters movements using elements from our previous project as i wanted to focus on accu lips and lip syncing features in this video in iclone i'm going to go to animation and create script choose acculips and import the saved audio once aculibs finishes analyzing the audio you'll see any words it doesn't quite understand in red which can be manually corrected you can then realign the text to the audio to generate the appropriate vizims aculips will analyze the audio and attempt to approximate the words into text i find it's about 80 to 90 effective and requires only minimal adjustments i'm adjusting the text now so that it will produce better vizims when applied to the character when you apply the acculip's data to the animation it will produce various physims to accompany the audio selecting the audio portion and its accompanying text will allow you to better align them for animation after applied to the character i then go through the timeline and if i want a sound to be emphasized or replaced with the lip sync i click on the visume indicator to adjust it you can keep the lip editor open as you go through the timeline to make things easier to adjust i'm going to time lapse this portion because i'm repeating the same process over and over again the key point is that you want to emphasize the zines at certain points during the animation if the dialog emphasis emphasizes a sound the animation should as well if you choose to render in blender you want to do two things first export the audio from the range of the video then select the character and export the fbx from the same range this will ensure that the audio and animation are in sync in blender use the blender auto setup add-on located in the cc3 tab to import the fbx as a character clothing has a slight issue the normals are not calculated correctly in edit mode i'm selecting the various meshes and choosing the average face area option to set them normals as they should be to avoid any visual issues in the cc3 tab click the range from character option to set the proper animation range for the timeline to import the audio i'm temporarily splitting my window and opening up the video sequencer right click and select sound to import the audio file you don't hear any audio go to the preferences go to system and then check your sound settings if you select the playback panel on the timeline you can enable scrubbing so you can hear audio as you go through your animation timeline oh there i was just practicing my life the cc3 panel has scene options for setting up lights which you can further refine with that camera in the scene you can select camera to view to align your viewport to your camera select the camera icon to toggle preview and camera view while looking through your camera you can add keyframes to your camera if you have auto keyframe enabled you can import and export camera animation through the fbx file format although sometimes i find the occasional glitch when doing this so i usually just create the camera sequence in the program i'm using to save the animation as a video go to the scene tab go to output and choose to save it in a video format rather than as an image also remember to choose an audio and quitting option if you plan to do some compositing you can set up a green screen or save this video with a transparent background i realized a little late that i had the wrong rendering dimensions so i'm adjusting them and re-keying my camera i also noticed that the micro normals were stretched out due to the elongated ear lobes on this character so i adjusted them in the skin parameters area of the cc3 tab now with everything set up i'm going to choose viewport render animation rather than the full render this will render everything as they appear in the ev preview viewport i'm going to skip recording the rendering process and show the final video [Laughter] oh hello there i was just practicing my laugh my name is hote but you probably know me as the laughing buddha or the fat buddha though i'm not actually a buddha at all i'm more like a symbol of good luck and fortune i'm so famous there are statues of me all across the world and with that i'm going to end this video i hope it was beneficial in some way i'm peter alexander thanks for watching

Channel: Reallusion

Views: 18,555

Keywords: 3D character creator, create your own character, 3D hair, physically based rendering, game character, royalty free 3D characters, Character Base, rigged 3D character, character generator, AR, VR, game, video game development, Make 3D characters, Generate 3D characters, Make easy 3D characters, video, reallusion, blender, auto setup, character animation, blender character, blender animation, 3d character, mythcons, stylized character, 3d cloth, 3d hair, blender eevee, Lip sync

Id: RJ1kvNdd52A

Length: 13min 54sec (834 seconds)

Published: Thu Aug 19 2021