How to Blend Generative AI and 3D Scanning for Stunning Visuals | Luma AI + Warpfusion

perfect in today's video we're going to look at how you can use generative Ai and 3D scanning to create some really cool videos with Dynamic camera movements let's dive right into the filming process you can use an app called Luma AI this is a groundbreaking tool that lets you create a 3D scan of your subject and its surroundings it's a simple as recording video from various angles you can use anything from a DSLR to your smartphone or even a drone there are some guidelines to follow to get the best quality output which I've covered in a separate detailed tutorial it's worth checking if you're Keen to unlock the full potential of luma AI once you've captured your footage all you need to do is upload it to Luma labs and let the magic happen once the 3D scan is ready you have a couple of options you can use preset trajectories for simple camera movement and preview them directly on your browser or use key frames to create your own custom animations and it's like getting a second chance at your shoot at this stage you're only seeing a lowquality preview but trust me the details and quality will improve once you render you can set the aspect ratio FPS and even choose a background color to fill in any missing pixels when you're happy with everything choose a resolution for your video I usually opt for the highest possible and hit render this part takes a few minutes but at the end you will have a stunning rendered video ready for download download which you can now use as an input and transform it into a stylized AI animation for this particular video I've used an AI called warp fusion it's a fantastic tool that can turn your regular videos into something truly imaginative the only issue is it does take a bit of time and effort to set up and use but don't worry I've got a step-by-step tutorial on how to install and use warp fusion including some key settings and tips to help you get some pretty impressive results I'll drop a link to the video below and if you're feeling adventurous and want to dive deeper into the world of transformative AI there are other methods out there that can give you similar or even better results AI extensions like anime diff which runs on comi can deliver more consistency and higher quality results if you're a bit unsure about which one to choose I would recommend anime diff it's newer and generally simpler to use all you have to do is load your video set your output resolution tweak some settings use prompts to describe the output you want and let it run I won't go into too much details on how to use it in this video because I've already uploaded a dedicated tutorial on how to install and use anime diff so you can follow that to stylize your video all right once you've got your Luma render and AI animation it's time to bring them into your editing software I'd personally suggest using Adobe After Effects because it gives you a whole lot more creative control and freedom than other software if you're new to After Effects and it seems overwhelming I recommend watching this learning path on skillshare it's designed to familiarize you with essential features and after fact it will guide you on how to add movement to your illustrations along with other skills taking you from beginner to Pro in no time skillshare is actually the world's largest online learning community and it provides learning paths for different experience levels if you're already proficient in After Effects and want to explore other powerful tools like expressions and joysticks skillshare has a learning path for that you will also find a range of top-notch classes created by industry leaders across various categories such as graphic design generative AI content creation and more skillshare is sponsoring today's video and if you're one of the first 500 people to sign up through the link below you will get free access to the entire class library for a full month now let's jump back into After Effects create a new composition and add add your Luma video if it's not looking quite right you can adjust it with lumetri color I also recommend adding an effect called real smart motion blur for a more natural feel to your camera motion next up let's layer the AI animation on top and don't forget to grade it separately using lumetri Color you've probably noticed some smooth transitions in my final video between the Luma render and the AI animation here's how I did it I split the AI animation layer into short shorter segments where I wanted it to appear I then used this ink spread video for the transition setting it as the track matat for your animation video makes it work like a mask which makes your animation appear or disappear smoothly you can also play around with other effects like gradient wipe for different type of transitions the full After Effects project file along with the original footage are available for my patreon subscribers and it's a great way to learn more about the process and hey if you create a video based on this breakdown don't forget to tag me on socials I can't wait to see what you come up with stay creative and I'll catch you in the next video [Music] peace

Channel: MDMZ

Views: 10,439

Keywords: stable diffusion, 3d scan tutorial, stable warpfusion, nerf scan, luma ai, ai animation, stable diffusion animation, ai video, ai video tutorial, warp fusion tutorial, nvidia nerf, ai video effect, ai video transition, ai animation stable diffusion, luma ai nerf, ai video effects, video to video ai animation, video to video ai generator, animatediff comfyui, animatediff tutorial, warpfusion colab, stylize video with ai, stylize video after effects, ai gta 5

Id: 3dy85KXPeXQ

Length: 5min 14sec (314 seconds)

Published: Fri Apr 05 2024