Look At What We Can Do With AI Video Now!

I recently posted this video on my Twitter account and a ton of people asked me how I did it and this video was Ultra simple to make now I went to my daughter's school father daughter dance and they had this cool 360 camera where you stand on a platform and the camera sort of rotated around you and they shot this video of us and the video they gave us back I just plugged through a tool called kyber and it gave me this cool like animated effect here that makes my daughter look like an anime character and me look like a scary monster but seeing all the comments about people wondering how I made this video made me want to do another video where I talk about all of the current video tools that are available with AI not too long ago I did this Twitter Thread about nine AI tools that are currently available to generate videos and it's one of my most popular tweets Ever Getting Over 876 000 views and 619 retweets and it just went crazy so I know people get excited about AI video tools and in this one you can see all my tabs up here along the top of my screen you can see that I'm going to talk about quite a few options for getting cool effects out of videos so let's start with did this is a tool where you can upload an image that looks like a person that has a mouth on it and make that person animated so let me jump into it they do have a free trial you do get a certain amount of free credits on it once you use up those free credits then it is a paid plan beyond that but it's a really simple tool to use so let's go ahead and create a video real quick so you can see down here you can create an AI presenter or you can choose a presenter that they've already got in here or you can add your own image and use that as the presenter so that's what I'm going to do I'm going to grab an image off my desktop here and you can see this is an image that I made in mid Journey here I can either upload a voice audio over here or I can type a script and this character will speak it out so let's go ahead and change the voice to Brandon I don't know what this is going to sound like but I'm going to type some text hello my name is Brandon and there are a lot of papers spinning around my head right now this is really crazy sure then I can come up here and click on generate video click generate again it's going to use one credit I have 40 credits left now it says my video is done I can play it back hello my name is Brandon and there are a lot of papers spinning around my head right now this is really crazy you can see that it's actually animating his lips as he's talking it's animating his head he's kind of doing some subtle motions he even blinks throughout it so it's a really cool really simple way to animate faces and this one's called Dash ID the next one I want to show you is called Leia pics I've shown this in a few other videos in the past really really simple concept you just upload an image here's an image that I made of The Godfather you can see how it sort of animates it and gives it like a 3D look here you can change the animation length to be a lot faster you can change the animation style to kind of go back and forth or in wide circles or vertical or this perspective you could change the amount of motion you can change the focus point to far away or close up or Center and there's all sorts of different settings that you can mess with to kind of get this 3D perspective animation so if you have a still image this is a good way to add some motion to it a lot of times when I'm making videos instead of just having a single static image for b-roll over the video it's kind of cool to add an effect like this to just give that video a little bit extra motion this one's called Leia picks you can find it over at l-e-i-a-p-i-x.com it's called the leopix converter and this one is currently completely free to use next up we've got animated drawings this one comes from meta it's actually designed to upload your children's drawings and animate those drawings but it will actually work with AI generated images sort of I made this a mid-journey it's a quick superhero image I'm going to upload this and see if I can animate it using animated drawings here so let's go ahead and click next it's going to scan the image agree to the terms that you're basically helping them do research and this is just for demo purposes only right now we're gonna go ahead and tell it where the image is confined to here click next it's going to scan it you can see it put a white outline around the character so it found the character just fine if it doesn't find the character you could sort of draw the mask around it and now it's asking us to sort of pick various points so where's the right ankle we'll put it right up about here left ankle right about here might come out a little funky but let's see what we get we'll click next and now it's going to create an animation out of that character and that's what we get a little rubbery looking but let's go ahead and make her jump up and down and wave and that's another way to make a real simple animation out of a image that you made in something like mid Journey or Leonardo or something like that or even a hand draw an image let's make her boxing here I mean you can see it's a little rubbery just because it's meant for kids drawings not really designed to use with like mid-journey images so you get this sort of like rubber woman effect here but I don't know it's kind of funny yep yep look at that just kind of something silly you can do to make static images a little more animated and fun here now I'm gonna get into some of the like really serious really cool AI tools that are available for video right now starting with a Runway so over at runwayml.com they have an entire Suite of AI video editing tools you can do motion tracking you can add a green screen background you can blur the background replace the background automatically generate subtitles you can blur faces and videos you could turn any video into a slow motion video you can do in painting where you actually remove people or objects from videos that you don't want you can completely remove the backgrounds from videos but what runway's been most known for these days has been their gen 1 and their Gen 2 products so gen 1 is where you can upload a video let's say for example here's this video of this animated girl dancing here and you can apply a image to it as well for example let's go ahead and apply this vibrant pattern to it and now we can go ahead and generate a video and it should take a combination of the existing video and apply this sort of pattern with it as well to create something completely unique and here's what it came up with you can see it's that same dancing girl but now it applied this sort of pattern style over the top of it and you get this completely unique stylized effect now this is what they call gen 1 and you can get access to gen 1 with your Runway account and Runway is also a freemium model which means you can do a certain amount of things for free before having to upgrade and actually pay but they also have something called Gen 2 which is actually still in closed beta access so not everybody has access to it yet but that's a complete text video you just enter a text prompt and it it will generate a video from it so to use Gen 2 you come to runway's Discord and if you have access to it you'll see it over on the left sidebar you'll see this Gen 2 Section you simply type at gen Dash 2 and then you just give it a text prompt of what you want to see a video of a wolf walking through a forest you'll see this little timer here to let you know that it's generating it it creates a brand new thread over here on the left so you can actually see some details about what it's generating and when it's ready it'll just pop up right here in this new thread so I can press play and we can see our wolf running through the forest here let's go ahead and look at it again in full screen I'd say it looks more like a coyote maybe a chupacabra I don't know you can kind of see it the thing that I've noticed about Gen 2 is sometimes you gotta run the same prompt five or six times before you actually get the video that you really want to see out of it I'm going to go ahead and say I don't like my results I didn't really feel like that looked like a wolf that feedback is good for Gen 2 because it's reinforcement learning you're letting it know that there the video didn't match the prompt as well as it should have if I run the prompt again I get a completely different result I guess it looks a little more like a wolf at least some sort of animal walking through a forest and that's Gen 2 which again is in private beta but I believe it'll be rolling into the runway dashboard fairly soon now Gen 2 is in private beta but this one called Model scope is actually available for free on a hugging face and I'll link up the hugging face URL down below the video but it essentially does the same thing now the major downside of this one is it only generates two second videos and it puts a giant Shutterstock Watermark across the videos but I just went ahead and entered this prompt a monkey on roller skates and you can see I've got a monkey sitting on the ground I guess playing with its roller skates here's another example with Spider-Man surfing a panda eating bamboo on a rock and an astronaut riding a horse and again pretty much all these you see this giant Shutterstock watermark on them which I think proves to us that it was trained on a lot of shutter stock footage now the next tool I want to talk talk about is called genmo now there's the original genmo and then they have a new gen Mo that they've been working on that is still in beta access right now the original genmo is a text to video or you can upload an image as a starter image and it will sort of animate that image so for example if I upload this same image of the guy with the paper swirling around his head I can describe some edits and it will tweak the video a bit for example I can say turn the man into a cyborg let's set it to six seconds down here leave everything else the same and click make video and here's the video we got out of it where you can see that it's kind of cycling through our original image and kind of putting a cyborg behind him changing the guy's skin color a little bit putting some glasses on him but it gives us some Unique Images that could be an interesting stylistic choice if you watch my video about how I made a short film I use genmo to make a time lapse sequence of a city that was in ruined time lapsing to become a city that was essentially beautified over time they also have a text to video where you can just type a text prompt a cyborg dancing in a field of flowers let's see what we get let's generate the image and basically what this is going to do is it's essentially going to generate that starting image and then it's going to run the same process we just saw but based on the starting image that we generate here you can see there's our cyborg dancing in a field of flowers so if I check this box it just moves to this next phase here where I can describe some edits and it will do the same thing we just saw from that last video but from this image as the starting image now genmo has a new feature called genmo chat which is in beta it's not available to everybody yet I'm not totally sure when this is going to be rolling out to everybody but I did get early access to play with it and this also has text to video in it so I can use natural language and say something like generate a video of a cyborg dancing among flowers submit it sure I can generate a video of a cyborg dancing among flowers what kind of flowers would you like daisies and then it says starting video generation and here's the video we got out of it uh cyborg with apparently long curly hair dancing among the flowers but you can have this generate anything you can imagine as well you just ask the chat you can start with an image you can start with a text prompt there's all sorts of stuff that you can do with this genmo chat as well so this is just scratching the surface but since I still have a bunch more tools I want to show you I'm going to move on so when I showed you this video earlier of me with my daughter at the father daughter dance here this was actually made with this tool kyber if you look in my videos you can see I've made a handful of different ones in here including this one that I just showed you on my Twitter The Prompt that I used I basically uploaded this video and used The Prompt a happy father and daughter in the style of still from a retrofuturistic film I don't remember exactly why I picked this from Lo-Fi steampunk cinematic Focus realistic highly detailed Masterpiece by Albert robita so a lot of this stuff was extra prompt magic that kyber sort of added to the mix when I uploaded my video this is one where I started from an image and had it sort of morphed my face into like an older man this one I started with a Nerf generation and then had kyber run through it which I'll talk about nurse in a minute here and kyber just has all sorts of cool stuff so if I come to create a video up here you can begin with an image you can transform an existing video which is what I did with the one with my daughter and you can add a song to your video as well and I believe it sort of syncs up the animation to the song if you use that feature but if I begin with an image here let's go ahead and start with the same image that I used earlier continue to prompt I want to create a video of a man with papers swirling around his head click continue and then the style it gives you some ideas for a style or you can type your own so let's select oil painting here and you can see it adds all this extra prompting magic to it here now I can click continue to settings I can have the camera move in or out rotate do all sorts of stuff let's have the camera zoom out and see what happens show initial image to start let's leave that and let's go ahead and generate and see what it does you can see here's the video that it generated from that where it almost kind of turns it into like an old fashioned looking painting I don't know how else to describe it I guess uh I guess it's more of an oil painting style like uh how he described it but very very artistic effect and then if we come to create video and we transform an existing video it works completely differently so for example if I upload this video of the girl dancing here and we use that as our starting video and then we continue to a prompt this actually works kind of similar to what you would expect out of something like gen 1 which I showed you earlier which combines the video plus whatever prompt you plug into it so I want to create a video of a woman dancing we'll click continue and then for the style let's do Vector art and see what we get out of it it should completely change the style of that video that we started with I'm going to go ahead and leave this on the default and click create so now it gives us some preview frames so we can kind of pick this style that we want to see from it based on these frames of these I think this first one looks the most interesting to me so we'll click finalize video and it's going to go ahead and run its processing and here's what we got out of that one and to me it looks just awesome it's like a cool cartoon I personally really love how this one came out honestly it looks really cool I actually think this came out better than the original that I made in stable diffusion it really sort of improved upon it it got rid of some of the flickering and gave kind of more of a cartoony effect so that's really cool I can then upscale this video which I think I will do and man am I happy with the way that one actually turned out the next one I want to show you is called plasma Punk and plasma Punk actually makes a video that's synced up to music so it kind of puts the music for first with this one so when you start it asks you to choose music or you can upload your own music but let's go ahead and select playful and let's listen to some of these and pick one is it tronic okay I like that one so let's go ahead and use this one there are other styles that you can play with here click around see if there's any music you like I'm just going to keep this moving and I'm going to pick this is it tronic one here and I'm going to move on to the next step now it asks you to pick a chunk of the music it'll actually give you a recommended section so if I reset it to recommend it it recommends this section [Music] I'm good with that it'll be about 20 seconds so I'm gonna go ahead and click next you can choose a starting image if you want I'm going to go ahead and use the default camera settings some of these other camera settings are new since the last time I was in here but I'm going to use the default because I really like the way the default came out in the past and I'm going to click next I'm not even going to pick a starting image you have some various Styles here color photo realistic I'm going to use colorful because I've used colorful in the past and it's always looked awesome to me and then we can enter a prompt a colorful Minecraft village trees and animals wandering around and then for Content description let's do a Minecraft villager I don't know let's see what happens and let's click generate video now I'm in queue at number 378 and here's the video that it generated [Music] thank you foreign got those Minecraft Vibes to it I just think this generates some really cool really vibrant videos so I love the way these always come out all right so the next tool I want to tell you about is called D coherence and this is basically using D Forum which I did a whole several hour long training on with some guest experts on this YouTube channel in the past and this really simplifies it it gives a simple user interface to deforum and this one they have a free trial you get a certain amount of free credits and then it's paid after that forgot to tell you plasma Punk is free right now D coherence has a free trial but then you have to pay for credits this one's actually an app that you download onto your computer so you would download it click on new project I'm just going to call it sample project we'll create the project here it asks for a style you've got a bunch of style options here let's go ahead and select synthwave Punk under starting frame your essentially going to generate a starting image so whatever prompt you can imagine from like a stable diffusion prompt let's just do a beautiful cyber Punk woman with a futuristic cyberpunk cityscape in the background and then we'll just add some extra keywords HD 4K Ultra realistic Unreal Engine detailed and then it'll generate some images that we can use as our starting prompt image all right so we have some options here we've got this image this image this image and this one I think this one's probably the most coherent so we'll go ahead and start with this image and then under General I'm just going to leave the frames per second at 12. pretty much going to leave all of this the same but let's set the zoom so it's zooming in a little bit let's set it to 0.25 here and we'll leave all the other settings the same and what makes D coherence really cool is you can actually sync it to audio and it will actually move the frames based on the Beats of the audio so if I import audio here I've got this song here that I made in mubert and I can open this and I will sync it to this so if I just listen to the song back it sounds like this but I can tell it to separate the audio channels and now it's separated out drums this is what it thinks the drum sounds like we've got Bass let's see if it thinks it found any vocals yeah not really and then other it captured this so synth sound so let's listen to the drums again all right so now we've got our audio imported now if I go to audio reactive effects I can add a new effect and I'll select the channel as the drums Channel select effect and let's just do uh X rotation so every drum beat it'll rotate a little we'll name this cyber Punk rotate and then down here it wants us to enter a prompt so let's go ahead and enter a prompt of cyber Punk woman dancing in a futuristic city and you can add more prompts along the rest of the song but I'm just going to have it cut off right here just for the demonstration purposes so I'll bring this all the way in here like this so it's just the exact length of this song and we'll go ahead and generate our video and here's what we got out of this one [Music] it's a cyberpunk woman dancing in the street with a kind of cool artsy de Forum style to it so the next thing I want to talk about is Nerfs and I've talked about Nerfs a little bit before but basically what a Nerf is it's when you take a whole bunch of images or a video around an object and then it sort of turns that object into a 3D object because it captured images at every possible angle and these can actually be turned into some really cool videos now this is a Nerf that I did of my disc golf cage that's out in my yard but what's cool about Nerfs and using a tool like Luma Labs which you can find at lumalabs.ai is that you can actually look at your 3D object here see I can move it around however I want but I can create an animation out of this if I come up here and click on this little camera button up here I can actually create keyframes so right now you can can see that the camera is just going to circle around it but if I come over here to the left and edit keyframes I can actually move this around here I can make the camera Spin and look at different angles I can make the camera move up and down so let's say I want to get a low angle when it circles around to this side you can see I'm setting a camera path for it to circle around this object here maybe when it gets to this side I want it to be up a little bit higher here and maybe a little bit closer in and now you can see I've got this camera path that it's going to follow I can click render video and now I've got this animation here where it's going to follow that exact camera path that I just created for it you can see how it pivots up and it pivots down and at some point it changes angles a little bit you can see the camera kind of twists a little bit on it here and you can just make these really cool animations with it and then download the video here's a Nerf I try to do with my tent when I went camping it's not a very good one because I didn't know what I was doing yet I think I moved a little bit too fast that's why everything looks a little bit blurry and fuzz Z but you can see this animation of the camera spinning around the tent from when I went camping I could also do stuff like this where I zoom way out from my tent and then come in through the trees at it you know you can make really cool cinematic effects that could move the camera around this way move it around this way and by going in and just setting keyframes I can create this animation however I want of this Nerf that I created now if you're following bill of all on Twitter this is like his specialty you can see he makes videos like this where he got this Nerf of the Lodi Garden in India and then he turned it into like a Minecraft video and if you go through his feed here he does a lot of cool nurse where he runs them through Gen 2 or he runs them through kyber or some sort of tool like that to get these really awesome effects see here's another one that he did right here bill of all is the absolute King at doing Nerfs plus cool video effects over the top and if I jump back to kyber over here and click on my videos Remember remember that video I just showed you of my disc golf cage here you can see I took that Nerf and I ran it through kyber and basically got a disc golf cage in Hell here where you can see as it spins around it's kind of changing angles on the cage there's supposed to be fire and Flame in the backgrounds that was me experimenting with the combination of taking a Nerf video that I made with Luma labs and combining it with kyber so really really cool creative stuff that you can do by taking one tool and smashing it together with another tool and blending these kind of Concepts together to get really really awesome videos here now the last tool I want to show you is another one that's still not in Open Access yet but if you get on the wait list they are slowly opening people up to it and that is Wonder Dynamics this is a tool where you can take any video with a person in it and replace that person with a 3D character you may have even seen my past video where I took this video of myself walking around in this office that I'm in here and you know pointing at the camera and moving round and then I replaced it with this Boombox head radio robot dude and it came out really really cool I also tried to make a clip from this iconic scene from Anchorman but it didn't fully work out you'll see Cannonball oh and then he turned into a human right before he splashes but the technology is coming a long way Wonder Dynamics is one that's really really fun to play with I couldn't make a video about generative Ai and video tools without mentioning Wonder Dynamics and that's all I got for you I know it's a lot there's a lot of cool AI video tools that are out there a lot to play with it's really blowing my mind all of the stuff that we can do and it especially gets cool when you start combining some of these you take this tool you make a video you put it into this video to AI tool and you add some extra flavor to it you can make a 3D image in Leia pics and then pull it into kyber to get another effect on top of it or make an animation with this meta animated drawings tool and pull it into Gen 2 and see what comes out of it that way there's just so many ways to mix and match and create really cool creative AI videos and I'm really excited to see what you do with some of these tools a lot of them are completely free to use right now too some of them are on free trials and freemium where you got to pay in the future some of them are still in early beta testing where you can just use them for free right now and some of them are still just purely in beta where you got to get on a wait list and they're not open to everybody yet but there's just so much cool stuff you can do so many cool tools and I'm excited to play around with them more and I'm even more excited to see where all these tools go and what's next for AI video and if you want to stay in the loop with all the latest and greatest tools that are coming out make sure you check out featuretools.io this is where I curate all the newest Cool Tools that I come across I add new tools every single day I keep you in the loop with the AI news and the AI news section and if all of this AI stuff is overwhelming and you just want a tldr for the week join the free newsletter every Friday I will just send you an overview of what you need to know in the AI World I'll send you the five coolest tools from the week handful of news articles handful of videos and one cool way to make money with AI it's totally free you can join it at futuretools.io and you'll only receive one email a week from me every Friday and yeah that's it Future tools Dot also go check it out and if you like videos like this make sure you give this one a thumbs up and subscribe to this channel I'll make sure you see more videos like this one in your news feed I'm doing AI News videos every Friday where I'm going to bring you up to date with all the cool news in the AI space every Friday so if you want to stay in that Loop make sure you subscribe to this Channel and I'll keep these videos flowing to you thanks again for tuning in really really appreciate you see you guys in the next video bye [Music] thank you

Channel: Matt Wolfe

Views: 196,071

Keywords: AI, Artificial Intelligence, FutureTools, Futurism, Machine Learning, Deep Learning, Future Tools, Matt Wolfe, ai video, kaiber, genmo, wonder dynamics, ai movies, ai video generator, ai video editor, ai video editing, kaiber ai, ai video maker, ai, genmo ai, ai art, text to video, ai video generator free, best ai video creator, ai video creator, ai tools, matt wolfe, runway, text to video ai, ai animation, vfx, meta, ai generated video, wonder studio, ai video editing tools

Id: 7BbibthxCp8

Length: 27min 9sec (1629 seconds)

Published: Wed May 10 2023