Pika Labs Tutorial: The Secret to Cinematic AI Videos

[Music] Contin your prog this is the Cinematic quality you can extract out of peaps if you know how to use this parameters like motion guidance scale and camera movements correctly but the real secret to success lies in knowing how to make cinematic proms that result in uniform scenes color arrangements and lighting so in this video you will learn everything you need to know about pabs and I will show you how to create cinematic proms to use this in any text to image app of your choice so you can create cinematic shots with a universal look bring characters to life and add Dynamic movements to your scenes and vehicles hello I'm Lenny from digital magic and I am really excited about the incredible progress PBS is making right now so let's start by joining the Pika Discord group you can find the link in the description below then I'm going to open up the members list and right click on the Pika bot and choose message now I will get my own private room and then here I can create videos using two methods text to video and image to video while text to video is great to really extract the best cinematic quality out of pabs you need to use the image to video option in combination with cinematic images created in an external text to image app but before we dive into that I want to show you how to prompt for text video and I want to show you all the parameters and camera movements available in pabs to begin put a forward slash in the message box and select create now you can add your prompt and create whatever you want this is the prompt I'm using for now and the only thing to do now is H the enter button later in the prompting chapter of this video I will show you step by step how you can create a structure so you can create these promps yourself so let's have a look at the video and then we're going to compare it with the video that I made used with the image to video option you can clearly see that the shot created with the image to video option has way more cinematic feeling to it it feels more real and that's why it's essential to know how to produce cinematic Steel images using a a text to image app and later in the prompting chapter of this video I will introduce you to various PID and free text to image apps plus I'll show you where to find an amazing PDF that in my opinion provides the best foundation for text to image prompting in any program and this also works for text to video prompting here in pabs so now I'm going to explain you how to add parameters and camera movements to your promps to help you follow along easily without needing to write everything down I've created a free PDF file for you here you can discover all the parameters such as frames per second and negative promps you also find a list of camera movements which is very handy and I create a cheat sheet for creating a basic prompt structure and I also added all my proms that I created in the text to image app to get this file simply Cate the link to my co-i page in the description down below and add any amount you would like to pay for it or just add zero and get it for free as adding parameters and camera movements works the same in the text to video option as in the image to video option I'm going to show this in the image to video option so to do this type a forward L and then select animate and then also click on the plus one more button and select prompt and then I'm going to drag my image in here for this I will use an image what I created earlier in mid Journey where you can see a spaceship in a desert landscape on the planet Mars so now I go to the prompt box and click in here and then I can add the action I want to see and I want that the spaceship flies to the right so I'm going to type spaceship flies to the right I can also prompt in some extra elements like motion or camera movements but before that I want to show you another crucial exper so I'll hit enter and then it takes about 30 seconds to render which I think is pretty fast once it's done you can click the refresh button here this will create another version of the same prompt and I've experienced that it makes sense to try this cuz sometimes the result can vary a lot so instead of creating many different prompts hoping to find the perfect one it's sometimes better to hit the refresh button a few times it's also helpful to to click the Thumbs Up Button if the result is what you want or the thumbs down button if it's not this helps train the peeka bot if you want to change the proms or add a camera movement you can click the shuffle button and then a popup window will open up you can include a camera movement for example and then press the submit button and it will rerun the process if you're happy with the result hover over the top right of the image so you can download it so if you look at the video then you can see that the spaceship is making a nice flying movement but it's not not flying to the right so that's why we will need to add extra parameters to achieve this result to add a parameter I'm going to open up the shuffle box and then after the prompt I'm going to type minus and then for example frames per second 24 and that's Pika defaults at 24 I don't need to change this because the film standard is already 24 frames per second okay let's go to my PDF file and check out all the other parameters moving on from frames per second we have the motion parameter and you can set this from 1 to 4 paika defaults at one as you can see in the speed of the moving clouds this represents the intensity of the movement the higher the value the more intense the motion will become in the video the next one is guiding scale and you can set this between 8 and 24 paika defaults to 12 as you can see at the wobbling of the boats in the water the higher you set the guidance scale the more related it is to the text prompt if you add the negative prompt parameter you're telling the peabot what content you don't want to appear in the video to make your video even more exciting you can add camera movements just add minus camera followed by the type of movement that you want you can choose to zoom pan or rotate zooming in and out is self-explanatory with pan you can reveal more of the background while keeping the main subject in place and with rotate you can move the camera around objects or tilt the frame to create a Dutch angle you can only use one of these camera movements so you can't say camera zoom in and Camera rotate clockwise in the same prompt but in the pan option you can make a combination so you could for example only use camera pan up but you could also use camera pan up right and this is exactly what we need for a spaceship to fly to the right so I'll add camera pan up right and I also add some additional parameters like motion 4 and guidance scale 15 to get the desired result so now I click the submit button now you can see that everything comes alive and it really looks like the spaceship is flying to the right but this only works if you added keywords like Dynamic movements when creating your prompts in a text to image app in this example you can see that if your image isn't prompted correctly peaps won't give you as good results before we dive into creating these proms I want to quickly show you how I created the other movements in my videos for this shot I only added the astronaut walking forward I tried adding motion guidance scale and camera movements but in the end I found that I got the best result without using them at the moment PFS Works differently for each sh so you have to experiment which works best sometimes more parameters make your shot look outstanding and sometimes it's just better to use fewer ones and for this shot I used girl is blinking with her eyes and I added motion two and guidance scale 15 as the parameters and to make this shot look even better I upscaled it using topas video Ai and I will explain this software later in the video now we finally arrived at the prompting chapter where you can discover the real secret to success in extracting the best cinematic quality out of pabs in case you're not familiar with text to image apps here's a list of both free and paid options for prompting in text to image or text to video here in pabs it's crucial to have a good structure with cinematography terms such as style Action Shot type scene description lighting and aspect ratio this helps you break down the prompt into easy bits which you can fill in step by step and for this the PDF file from cyber Jungle which I mentioned earlier is perfect because it contains all the cinematography terms you need to create cinematic promps I believe you can enter any amount you'd like but I chose to to pay $5 because I find it totally worth it so now let's see what we can create with my basic prompting structure usually I use stable diffusion for most of my prompting but in this case I used mid journey and in mid Journey I'm going to type a dash and I'm going to select imag in then I'm going to click in here and I'm going to add my prompt and this prompt is the same prompt which you can see here only thing to do now is hit the enter button next I choose U1 to upscale the version that I like then I'm going to click on it and now the best thing is to open it in the browser so you can save it with the highest quality right click save image as the great thing about this basic prom structure is that when you're happy and satisfied with the scenery the lighting the color schemes of your image then you keep the basic structure as it is and use it to reproduce different images in the Cinematic style of the first image so let's use this to create a walking female astronaut in the desert of Mars for this I'm going to leave my style to cinematic change my action to walking female astronaut with a helmet change my shot type to EST stabling shot and keep my scene description as Mars desert with sand and Stor I also keep the lighting as speach light and the aspect ratio to 16x9 and the style to raw and that's why this cinematography PDF is so amazing because it gives you many shot types color Arrangements lighting setups and many more cinematography tips to choose from so let's look at the result from the Walking astronaut I'm pretty satisfied with this and in my opinion it matches very well with the shots that I produced earlier I promised to show you how to add movement to your images by using Dynamic prompts but before you do that I would like to quickly show you how you can upscale the resolution of your video using topas video AI I highly recommend doing this because pabs videos look good on small devices like smartphones but if you enlarge them they really lose their quality don't have topash ai video yet you can get it by clicking the link below this video so inside topas video I click on browse and then I'm going to select this video click on open and now we can see that the standard resolution of the paa video 1024 by 576 is not so big so let's do some upscaling and here I'm going to choose 4K then make sure to set the frame rate to 24 frames per second because this is the default from pabs then in the AI model choose prus fine tune enhance this is for now the best model and I would recommend to use this then we go down to the encoder and I'm going to select progress for high quality and in the codec let's set it to standard and this combination I think is very good and you get very very good quality so let's click on export before we check out the final result of the flying spaceship I want to show you how I created the dynamic movements in the image so that PB was able to create this amazing video so I start again with my basic prom structure then I changed the action into a highly detailed spaceship flying through the desert on Mars and then I added image capturing the dynamic and implied movement which is an essential prompt if you want to create Dynamic movements in your images and in this way I'm changing my basic promt structure into a more complex one so I also included micro photography movie still and phantom highspeed camera and I adjusted the shot type to an estaing shot now that you know all the tricks to create your own cinematic AI videos let's have a look at the super sharp version that top was AI video created I am really satisfied with this and another cool way how to use PFS is to create your own Dynamic backgrounds for hybrid video which you can create in programs like stable diusion and if you want to know how I created myself into this cool na'vi character then make sure to watch this video

Channel: Digital Magic

Views: 295,203

Keywords: digital magic, pika labs, pika labs tutorial, text to image

Id: _kZYlJpM0_g

Length: 11min 49sec (709 seconds)

Published: Fri Oct 06 2023