This Free AI Video Generator is Wild!

a brand new tool was just made available for text to video generation and the results have been absolutely wild so far I think we have a brand new standard in what text of video can actually do in this video I'm going to break down some of the coolest Generations that I've come across and show you how you can use a tool like this yourself totally for free this video is going to be quicker than most of my videos but I do want to show you a couple other things before I get into this new text-to-video model so let's dig in so here's some new research called Pano head which essentially allows you to make a 3D head based on just a single image you can see these are 3D generated heads right here where it's rotating around the head but if we scroll down you can see in this example there's a picture of The Rock and what it turns it into is this sort of 3D you know rotatable version of The Rock now his head shape is kind of not perfect because it's sort of guessing and what we're seeing here with this little animation is essentially again you might have heard the term Gan before it stands for gender active adversarial Network and basically what it's doing is it's looking at this initial picture it's making a picture and saying does this picture look like this one no okay how about this one no how about this one and then it keeps going back and forth until it gets as close as it possibly can to the original picture now that's a total oversimplification but once it figures out a close enough image then it tries to guess essentially all angles of that image here's an example that I came across on Twitter from at hackmans where they're trying to generate the image on the left once the image on the left is finally generated and looks close enough then it generates the 3D version of it here's another one it's generating that image on the left and you end up with this 3D image here and here's another one I think this one's interesting because you could tell that her hair is sort of supposed to be in a bun but then when it guesses what the hair is supposed to look like behind it doesn't quite look like that bun and then again here's another example now this Pano head is open source research that is available on GitHub you can actually find it here at this this URL I'll make sure it's linked Below in the description of course however if you do want to use it it does say here under the requirements one to eight high-end Nvidia gpus so if you have an RTX 3090 or something similar at home you probably could use this on your home computer but I have a feeling it might take a while I did a search on both hugging face and replicate.com and have not found a publicly available Cloud version of this yet but I imagine it's only a matter of time before we'll be able to use it in one of those Cloud environments now this other research that I recently came across that I wanted to show off real quick was called motion GPT human motion as foreign language you can see it essentially generates text emotion can you show me a person who is practicing Karate kicks and it generates this text emotion of somebody generating Karate kicks it's also capable of motion to text explain the Motion demonstrated on and then in the little video that we're seeing over on the right here in English so you see the character walking around and then their response from the computer a person walks in a semi-circular pattern tiptoeing could also predict the next movements from what it sees and you can see it's trying to predict the next movement down in the bottom left here we can see some more examples here a person is walking forwards but stumbles and steps back then carries on forward you can see they're walking forward they kind of stumble a little bit then continue a person moves their hands back and forth as if using a broom so this is pretty interesting research that's coming out unfortunately it doesn't seem like we have access to it yet if we look at their GitHub repository it explains what it does and you can read a little bit more about how it works but there's not much information about it just yet so we don't actually know when we'll be able to use it ourselves now let's talk about text to video previously if you want to do text to video you'd have to use something like runwayml personally I am a huge fan of runwayml it does generate some pretty good Generations although my fish seems to have tails on both sides of it and generating videos does cost credits of which if you're generating a decent amount of videos you will eat through credits very quickly the costs do add up fairly quick your other option other than Gen 2 has been something like model scope which you can use for free on hugging face and you can see here's one that I just quickly generated that says a monkey riding roller skates and we get something that looks like this but if you remember from past videos where we've talked about model scope they all seem to have this Shutterstock Watermark across pretty much every video because clearly it was trained on Shutterstock data but now recently we've been given access to xeroscope and this one is actually available for free over on hugging face you can find it at this URL here I'll make sure it's linked below now it still makes fairly short Generations but as you can see from this one it doesn't have the watermark and it actually feels slightly more coherent than what we were seeing from model scope I will warn you however though if you do want to generate something with the free version of xeroscope over on hugging face the generation time can usually be fairly long and if you're using it at peak hours it may just not work at all and tell you that it's too busy a monkey on roller skates submit something went wrong the application is too busy keep trying so apparently there's too many people using it right now and I can't generate another video however you can duplicate the space if you'd like to and the recommended Hardware is using an Nvidia A10 G which will cost you about three dollars and fifteen cents per hour however using this method it only takes about one minute to generate a video less than a minute maybe 55 seconds or so to generate a video for three dollars and fifteen cents per hour you could theoretically generate anywhere from 50 to 60 videos if you are really fast at prompting I duplicated the space here myself so we'll play with this in a second but before we do I want to show you some of the cooler Generations that I've come across so far just to show you what this is capable of so this video is from Pharma psychotic here and it's this really cool generation of this like robot cat that has lasers or guns or something and I just love how this one came out it's so cool I mean you're not getting something like this out of Model scope here's another one I came across from Spencer Sterling this like this weird underwater creature sort of scenario but the colors and the sort of definition the quality to it just seems to be so much better than what we were getting out of Model scope and quite honestly although I do love Runway and I love all their Suite of tools and I love what you can get out of gen 2. I think what we're getting out of zero scope right now is actually a little bit better oh this is probably not the best example because this is a bunch of creepy looking sea monsters or something here's another one that I really enjoyed that I came across from Vania but this is like this celebration with fireworks and everybody cheering and then we've got this sort of psychedelic visuals that they just blow me away I love the colors and I love the definition of these videos here's one I came across from Lyle I can actually play the music in this one because the music was generated with music gen but this one has that sort of painterly style they almost look like they can be like Vincent van Gogh paintings that came to life and this was generated with xeroscope here's one that I came across from rupe renisto I'm sorry if I mispronounced your name and I think it's supposed to be Jerry Seinfeld it's so is it a good thought isn't it strange how socks go into the washing machine as a pair and come out single men and women often seem like they're from different planets I just think it's hilarious obviously these aren't fooling anybody into thinking this is an actual real video of people and the images sort of blur together inside of the video but there's something just fun and interesting about watching these videos knowing that AI generated these videos and then getting this you know weird kind of borderline creepy result as you watch it here's another one that I came across from three deal over on Reddit instead of the AI video subreddit you can see we've got different characters walking you've got the Knight you've got the soldiers you've got a robot got a different style robot it's just really cool if you're wondering how they got these videos that are longer than three seconds they're just generating a bunch of different videos and pushing them together this one they may have even just generated one video of you know a monkey walking or a person walking and then run it through something like gen 1 to change what the image looks like I'm not totally sure how they achieved this effect and here's zeroscope here's what it looks like when you use it inside of hugging face I did duplicate the space so that I could generate whatever I want and do it fairly quickly so I generated a monkey on roller skates here's this one's version of a monkey on roller skates a little bit more cartoony it didn't try to go for that super realism let's try to recreate some of the other ones we saw earlier colorful underwater sea life you can see it's estimating about 53 seconds to generate this video and here's what we got out of that if you remember my earlier Gen 2 generation that one looked a little bit less like a fish than this one if I'm being honest let's do a swimming octopus in a vibrant blue ocean this one's gonna take about 51 seconds and here's what we get out of that one not bad I mean you definitely know what it is Elon Musk wrestling with Mark Zuckerberg and here's what that looks like I don't know what's going on now I actually took a whole bunch of generations of Elon Musk and Mark Zuckerberg fighting and this was the result [Music] and that's exactly how I imagine it going down too so that's called zeroscope again you can use it 100 for free on hugging face if you are patient I haven't personally found a way to install it on your own computer and run it locally although that's not to say there isn't a way I just personally haven't found it yet so right now your best option is either using it for free unhugging face but waiting or duplicating the space and you can generate about a video a minute and there you have it there's a new text to video AI tool zero scope that's available for anybody to use right now you can create some fun videos I just showed you a teeny tiny handful of what I've found on Twitter but a lot of these videos are kind of going viral right now so if you look you'll probably find a lot more they're real fun to create they're real easy to create whatever you can imagine you can generate a funky looking video of so hopefully you enjoyed this video if you like they're not about this stuff check out futuretools.io where I curate all the latest tools and news that I come across and also if you haven't already join the free newsletter I send it out every Friday it's the tldr of everything you missed both tools and news of AI for the week you can find it all over at futuretools.io and if you haven't already maybe consider giving this video a thumbs up and to subscribe and a bell and all of the stuff because that will help me with the algorithm and also it'll make sure you see more videos like this in your news feed thank you so much for tuning in I really really appreciate you I'll see you guys the next video bye [Music]

Channel: Matt Wolfe

Views: 240,275

Keywords: AI, Artificial Intelligence, FutureTools, Futurism, Machine Learning, Deep Learning, Future Tools, Matt Wolfe, text to video, text-to-video, zeroscope, ai video, generative video, ai video generator, text to video ai, ai video maker, text to video ai free, ai video creator, text to video ai generator, best ai video creator, ai video editor, text to video converter, ai text to video, text to video generator, ai tools, ai art, ai generated video, generative ai, ai animation

Id: azMvnZfE5Mg

Length: 11min 28sec (688 seconds)

Published: Wed Jun 28 2023