This AI Animation Software is Insane | DeepMotion 3DSMax Walkthrough

in today's video we're gonna see how you can create animations from a video using deepmotion anime 3D deep motion is an AI tool that converts real video motion into a computer generated animation without any strings attached while the technology isn't as refined yet the results are extremely promising and we're gonna explore that today along the way we'll see how to generate our motion from a video export it and then import it into Macs through the bipad model by the way this video is brought to you by deepmotion they are service anime 3D allows you to create animation from video files you captured or those you might stumble to Pawn on the internet using their markerless motion capture AI power technology so if you are in need of a cost effective motion capture solution today's tool might be for you this option is practically interesting because it can also do face and hand tracking whereas other options out there will only have body tracking their multiple person tracking will also be releasing in the next month or two artificial intelligence and deep learning algorithms were always a Hot Topic especially recently it feels like another AI power tool is created every other week which shows how AI is moving and how things are rapidly evolving however we think that today's tools will help enhance the lives of artists developers and even content creators inter deep motion a revolutionary solution for capturing and reconstructing full body motion the motion II powered engine allows you to turn any video into a 3D animation for use in game development in addition to augment a reality and any other forms of entertainment not only this because this approach is gonna help you save a lot of time and money with their new features such as footlocking modes face and hand tracking and their patent pending rotoscope post editor with this you can create extremely believable animations so the Deep motion AI tool works by analyzing the movement data from an actor's performance and then generating the corresponding animation data from the character model on screen using machine learning and various other methods once the animation is generated you can export your motion capture rig as an mbx bvh GBL or even rendered as an mp4 the website also offers powerful custom avatar generator tools like Ready Player me and the new hyper realistic Creator Avatar or you can upload your own custom characters the Deep motion system will automatically retarget animations into your custom characters with a real-time preview you can then edit your animation results with the new rotoscope post editor all through your browser to start using anime3d you first need to create an account the website has premium plans to unlock more features including a new unlimited animation plan but the free version is more than enough to try the motion capture features when you first sign into your deepmotion account you won't be able to upload a custom character due to it being blocked by the first time workflow now you can hit skip to skip the step-by-step tutorial but it will keep asking you to do it every time so let's go through it quickly first you can take a look at some recommended guidelines on how to upload the best video to get the best result there are a couple here so hit next and now pick any video and keep everything as default so you can see that the custom character is locked here just hit next and start processing foreign you can go to your 3D model tabs choose upload and locate the custom 3ds Max character which you can find it in the video description and this character will be added in the future to the characters library but for now you can grab it from the link down below after that download the fbx file and upload it to your character list by navigating to where you can download it and double click on it or you can just drag and drop the model directly into the upload field of course you can use the Deep motion default character or you can use any of the custom characters but in order for our animation to work with Max we will have to use the custom character this character will have the correct naming conventions for the joints needed for Max once you upload the character you can go ahead and click create again and on the 3D model field hit the edit icon on the top right corner and and pick the 3ds Max character now after you have your custom character selected you can upload your video clip by dragging and dropping your video into the add video clip section this platform can handle a lot of difficult Motions like air motions flips and hand-to-ground contact and they do have capture guidelines they recommend to follow to generate the best possible animation things like lighting subjects loading and stable camera movement have a big impact on your results so be sure to check those so once your video is uploaded you can adjust more settings some of them might be worth checking depending on the animation you are trying to capture some of them are locked depending on your plan Force foot locking will prevent or help reduce foot Glide in in the animation has 4 modes Auto never always and grounding the face tracking option will allow you to capture some basic facial expressions but it's better to use it with half body tracking only the upper body is captured a video or with simply a full face capturer for a better result for face tracking you can either use a default or custom character through the built-in character editor you can also use a custom character as long as it is set up with the standard arcade Clan shapes you can also learn about their face tracking and the link down below talking about face tracking deepmotion also introduced the new hand tracking which allows you to motion track even individual fingers the video here needs to be high quality specifically high resolution and higher FPS helps and the Hand tracking would work a lot better if the tracking is done only on a video from the waste app the full body option will still work but for Optimum results the high resolution the better it is also important to know that the hand tracking is still in beta so it's not perfect by any stretch but it is getting better by day the upper body only option is self-explanatory you can use this when capturing upper body video animation it will lock the feet to the ground for a more natural animation you can also change the default position to sitting so you can easily create an animated sitting character you also have sliders for Speed multiplier to better animate slow motion videos and motion smoothie which Smooths the animation and tries to eliminate jittering speed multiplier and motion smoothing and foot locking are all paid features but you may not need them depending on your results you will also have the rotoscope post Editor to manually further refine your results later on as well other controls include fbx output the default file type or joint at origin which is meant for unreal users and full back pose which provides a position for your character to be where there are no tracking results for the body another powerful new feature is Naruto scopos editor which enables you to further tweak and easily refine your animation results by tracing the character's motion over the input video footage this is every really powerful tool as it lets you move the joints and adjust their position by tracing over the video similar to how traditional animators would rotoscope the movement of a character over reference footage also hand and foot rotation cannot be edited and figure joins as of the making of this video are not yet editable but this is something they are working on adding once in the editor you can easily adjust the joint position by manipulating the character rig that is overlaid on top of your original video you can switch between 2D and 3D views by using the corresponding button at the bottom of the screen you can easily edit large sections of frames by using the new interpolation feature and your edits will be Auto saved in order to see your edited animation you will need to click the see and animation button which will reprocess your animation and you can use this tool as many times as you need to download your animation hit the download button under the preview player you can pick between the two default file options of fbx and bvh with a subscription you will get access to their motion analyst file type dpme we're gonna pick PVH because this is what we need to import our biped model in Max now in Max go to create system iPad and create and drop your preview to create your pipette model now jump to the motion Tab and click load motion capture file under motion capture rollout Now navigate to where you will download your motion capture bvh file you may need to change the file type from bip to bvh for the file to show up but all you need to do is to select it and hit open in my case I'm gonna warning prompting me that some of the joint namings are exactly compatible with the bipod model naming convention and I think it has something to do with joint names not matching the bypass structure and when you get the motion capture conversion parameters window just keep everything at default and hit ok now you can see that your animation is applied to your bypass skeleton so now you can go ahead and save your animation as a bib or targeted or export it to any other software like Unreal Engine blender and so on so if you like what you see and you want to try deep motion for free you will find the necessary links in the description I hope you found this video useful if you did please give this video a like you can also check some of our previous videos thank you guys very much watching and I will see you in the next one foreign [Music]

Channel: InspirationTuts

Views: 31,459

Keywords: From Video to 3D Animation | DeepMotion 3DSMax Walkthrough, From Video to 3D Animation, 3d animation software, how to animate, learn how to animate, AI animation tool, character animation, character animation software, blender 3d, motion software, motion ai, deep motion, 3DSMax, maya, blender

Id: xOWRO4iSACc

Length: 10min 30sec (630 seconds)

Published: Mon May 29 2023