How to Control Camera Motions in Luma Ai Video Generator!

in this video we'll learn how to control camera motions in the Luma AI video generator and also show you how to use your prompts to guide what happens in the AI videos to get the best results I've gotten a lot of comments about how the Luma video generator is hard to use because it creates random camera motions so let's say we've uploaded this photo of a boy and prompt for a boy in an anime the generated video panss up very quickly and the boy doesn't stay inside the frame this kind of sporadic motion is really annoying to deal with if you want to create films let's fix that I've uploaded this image of a boy again and this time I'm going to uncheck this enhanced prompt box all the way on the right this is the source of all our problems and seems to be what adds in the extra camera motions now I'll prompt for a boy in an anime static camera shot this time the resulting video doesn't have that crazy panning anymore and we get a perfectly usable scene now that we fixed that erratic camera motion let's take a look at how we can start adding our own camera movements I'll start with this image of an astronaut once again make sure the enhanced prompt box is unchecked then I'll enter a prompt like an astronaut walking camera pans left in the generated video the camera pans to the left just like we'd expect here's a comparison between panning left and panning right a human face does appear inside the helmet in the video that pan is right I wouldn't actually want that to happen there but the camera motions look good they won't always understand the details of the prompts exactly in these videos generated of this woman the panning motions go in the wrong directions pan left goes right and pan right goes left I did also try tilting the cameras up and down this didn't seem as effective as panning though we can also make the video zoom in or zoom out in our prompts I found that zooming works really well although zoom out doesn't really seem to add as much motion instead if you use a words camera pullback that tends to work better and produces that same zoom out effect it's not always going to work but it does give you a bit more control by the way you can now extend videos all the way up to 15 seconds I've got this 5-second video zooming on the woman and let's say I want to Extended another 5 seconds for a combined 10 seconds using this extend button underneath it'll give me a chance to enter a new prompt so I'll use camera pullback to move the camera in the opp opposite direction the extended video is able to keep the character consistency perfectly without any warping or Distortion that I've seen in other AI video generators we also have the option to rotate the camera here's an arrow shot of a volcano with a camera rotating in both clockwise and counterclockwise directions I don't think the AI actually understands the direction the camera should rotate based on our prompts because here's another example where the camera rotates in the same direction for both clockwise and counter clockwise keywords in the prompts the good news though is that it does seem to understand you want some rotation I did also try combining multiple motions in the same prompt that doesn't really work for this video I asked for camera zooming and Camera tail toop it doesn't do either of them instead it just rotates in an arc around the subject in this Scenic Lake at prompt 4 the camera Zooms in and rotates clockwise Again the video didn't match my prompt these camera motions won't work all the time it does depend on the image but it's nice to know that we have a bit more control here's a few bonus tips for controlling the movement in your videos the keyword follow Works super well when you have an image taken from behind the camera tracks a subject walking forwards there is this weird dot in this video on the back of the guy's head but that's just the artifact from the image the motion looks great frontal shots of a subject walking also seem to work pretty well by the way thanks to anyone who left comments in my last video with tips on how to control the camera motions better that helped me a lot you can animate time lapses I did one of a city panoramic camera shots also work great for widescreen images the buffalo head deforms a bit but otherwise the landscape looks great we do actually have a decent amount of control over the subjects inside our videos I tried different facial expressions smiling and laughter worked really well unhappy Expressions were not as expressive though but if you look closely in the video with a woman frowning she does look kind of upset different head motions can also be controlled reasonably well for all these different prompts of turning to face the camera looking up and looking down Luma actually follows through and generates these motions accurately for us there are limits to what they I can do more complex Motions like this deer sitting down don't work although it's able to animate the animal walking forwards I try to make this guy stand up but he just Bobs his head and does some hand gestures so far I've had a lot of fun playing around with Luma I think there's still a lot more tips and strategies that can be discovered for how to make the best videos with Luma and they also have some updates planned coming up soon if you want to learn more about the visual animation styles that you can use in Luma ai go and take a look at this video guide I made over here [Music] [Music]

Channel: Tao Prompts

Views: 14,833

Keywords:

Id: i4it_Nb-3PM

Length: 5min 40sec (340 seconds)

Published: Fri Jun 21 2024