Mind-Blowing New AI Video Generator: Text to Video AND Image to Video with Pika Labs

AI text to video has taken a massive Leap Forward not only in terms of quality but also it's completely free for now at least and it's easy to use this is the most excited I've been about a new AI tool in a long time by a long time I mean a couple months but that's years in AI time so I'm talking about Pica Labs it's only been a couple weeks since they launched and there have already been some incredible results and it's not just text to video they also released image to video which has been a complete Game Changer whether that's just a quickly animate a mid-journey image or to guide and create an entire film so I want to show you how it works generate in a few different styles and show what I've learned so far and also showcase the best creations I've seen now there's some other good text to video that's come out before this the biggest player has been Runway ml you can definitely get some good stuff here's one of the best creations I've seen by Nick St Pierre this my friend is life in its purest form a dance of eons untamed and free yet perfectly choreographed one of the main issues with Runway is cost you get a set amount of credits each month that you can burn through extremely quick it gets very expensive very fast to get something like this you'd need to spend a good chunk of change but it's not just that Pika also has the best movement out of any model yet with Runway you typically get simple camera movement and not that much movement from your subject but Pika has realistic movement for a wide variety of scenes and subjects or multiple characters or multiple types of movement like camera movement while your subject is moving and keeping it all relatively coherent like this looks like just a real natural walking stride and same with running this looks great of course it's not perfect but it's a big step forward there and also the ability to prompt with images is huge the other best text to video that came out recently was xeroscope which is amazing but the biggest difference again is that Pika has image prompting xeroscope is nice that it's completely open source we don't know what Pico Labs was trained on or how it works and you can use xeroscope for free as well but if it's busy it takes a long time or it sometimes doesn't work at all if you have the right Hardware you can duplicate the space and run it yourself for a few dollars an hour then it takes about a minute to generate each video that's the average generation time with Pica for free I don't know how long it will be free I'm sure they'll move to some sort of paid model eventually but for now I'm loving it and there's other awesome tools like kyber neural frames warp fusion deform and a bunch of others but those all have a very particular look with that kind of flickery decoherence which I like in a lot of cases and will still be using those tools but Pika is able to get a lot smoother I want to showcase some of my favorites here the door Brothers have been consistently creating just incredible stuff we'll start with this one because you may remember a bunch of AI generated food commercials people were posting from other types of video tools a little while back people were posting them because of how weird they turned out so when you compare this quality with those from a couple months ago it's pretty mind-blowing [Music] here's another one from the door brothers that's in a van Gogh style that looks really cool it's a long ones I just spliced out a few parts [Music] can you see everything I recommend you go watch the full thing honestly I could just show everything they've been posting it was really hard to narrow it down they've been killing it I'll let you go follow them to check it all out now let's go to the opposite end with this more horror themed one by Winter Garden AI it's reimagining HR Geiger works [Music] [Music] [Music] I'm assuming he used some of Geiger's art as image prompts or maybe he just asked it to generate in the style of HR Geiger for some but with the music and editing this one is awesome this is just a short clip the full thing is two minutes long then here's a documentary on ants by imposter chicks there are very few creatures problems or obstacles the ants look amazing and they end up building more and more complex technology throughout the video this one's great on YouTube the channel is creativity risk she has another one on sea turtles in this New York flood by Dave raynan is really well done with the story and the music leaning into the rain was a really good idea so the inconsistencies you get are a lot less noticeable that's a good move with all AI video right now leaning into scenes that naturally have a little more Distortion or a more surreal or abstract those end up just feeling better because your brain kind of expects them to be a little bit off anyways here's a short run by Mr Allen T that I assume a lot of time was put into he says the process was mid-journey generative fields and Pica and then some compiling and editing edit on top my guess is he started with a close-up of the face then used zoom out in mid-journey to zoom out to different scenes and then animated it with Pika but just goes to show what you can do if you get creative with all the new tools available I could just keep going and going I had a lot of fun going through all these so I'll finish up the Showcase with just a bunch of Clips I put together from a lot of different people just to show off the range of what it can do so these first ones are all by Scotty Wick his Twitter is full of awesome examples like animating memes all the Star Wars characters as babies and he did a full cyberpunk Futurama trailer that's amazing again I cut a bunch of those clips short his and everyone's sweaters that I show will be linked down in the description more from the door Brothers seriously so much good stuff on their Twitter I'll let more of these play to some music you can skip to the next section if you want to jump into the platform but personally I love watching these [Music] thank you and of course someone had to make a video of Elon and duck here's them dancing this is one of the hardest things for AI to get right but this is significant progress mid Journey had their one year anniversary recently and a lot of people were posting the progress over that year the amount it's improved from looking like this to now being able to generate images that are indistinguishable from real photos I mean all in just one year imagine where this will be in a year of course video has its own unique challenges but there's a ton of research to build off now [Music] so let's jump into it just like mid Journey this is all operated within Discord right now it's a closed beta but you can go to pica.art and fill out a type form to get access they've been letting people in pretty quickly within a couple days they'll send you a link to join the Discord then once you're in it's set up similar to Mid Journey you can generate in these rooms they have daily contests with different themes helpful chats for discussions and support really everyone is still just experimenting and figuring things out right now and sharing with each other what works they have a getting started Channel with the basic instructions which are all pretty simple so I'll just jump in and show you how it works use the create command just forward slash create then enter your prompt and the main parameter to use is aspect ratio you only use one dash instead of two like mid Journey so Dash ar169 then let it generate the other parameters are guidance scale for how related the image will be to the text nag for negative prompting seed for more consistent generations and motion for How likely you are to get motion they're all in this getting started channel for reference and just like that our video is done and you can just click this button to rerun the generation to get some different results I'll usually test out prompts one at a time to make sure the prompt is good then I'll have it generate a few more and pick the best one but just from a super simple prompt and some music from Google LM we get this foreign prompt gets a little chaotic in here and hard to keep track of so what I've been doing is come up to the top right and then click create thread then click these three dots up here and select open in full view then you'll essentially have your own little room to generate in let's make a quick Wildlife documentary so I asked chatgpt to write me a script about the diversity of Wildlife and ecosystems around the world to be narrated by David Attenborough add a little bit of back and forth to get it short and concise then generated the voiceover in 11 labs and created some scenes to go along with it I used simple prompts for the whole thing sometimes as simple as just jellyfish swimming or tiger stocking in a jungle for the landscape shots I used aerial shot and time lapse nothing complicated at all but I did generate each of them quite a few times then picked the best ones then added some music and synced it up a little bit I went through it pretty quickly but here's the result our planet a kaleidoscope of ecosystems demonstrates life's incredible adaptability the Arctic is a vast canvas of serene white a testament to Life's resilience amidst extremes the African savannas with their endless golden tapestry reflect the grand scale of existence amidst the emerald chaos of rainforests life thrives in every inch of this vibrant Labyrinth the oceans those endless blues house an intricate aquatic Metropolis pulsating with life from The Polar Ice to the tropics from the ocean depths to the highest peaks our world embodies the profound diversity of life in its endless forms [Music] I think text prompts are really fun because you never know what's going to happen but if you have a vision you want to stick to and something specific in mind image prompts are the way to go so with image prompting your first frame will look very similar to your reference image making Generations in mid-journey and using those as your prompt is a great way to get consistent Aesthetics or just to get your scene closer to the way you want it since you have so much control in mid-journey so you just type your prompt what I've found gets the best results is to prompt with what you want to be moving in your scene then click the plus one to add your image or you can hit tab three times then upload the image and submit and this looks awesome so with image prompting you get all the Limitless Styles and scenes you have available in mid-journey and then some control over the animation within your scene it usually takes a few generations to get it to do what you want but I've been getting some great results and all this has been way easier to pick up than any other texted video I've tried the generations are only three seconds right now they announced that they'll be moving that up to five seconds soon and the quality isn't too high yet a lot of people have been using xeroscope to upscale their videos or you could use something like topaz AI to upscale there's some cheaper alternatives out there too like hitpaw or I know there's free ones I haven't tested very many out but xeroscope is a great way to go I've just started my experimenting I'll be doing much deeper dives into different techniques and ways to control the results I'll be posting some of that on Twitter I may make another video with a more in-depth tutorial if it seems like people want it really I'm just excited to keep exploring and creating with this

Channel: Futurepedia

Views: 310,934

Keywords: ai video, text to video, ai video generator, ai art, generative art, midjourney, stable diffusion, ai video maker

Id: nr1uVYzI6eg

Length: 11min 56sec (716 seconds)

Published: Wed Jul 19 2023