Viral AI Video Tools for Beginners

2023 is coming to a close and we might have just witnessed what people call the chat GPT moment of AI video and that's because in November we experienced major major advances when it comes to Consumer accessible AI video tools so this the perfect time to cover it all but hold up with comparing this to chat GPT because while it might or might not have the cultural significance that chat GPT had for society video is a whole different Beast compared to written text so when we talk about AI generated videos you have to realize that we're talking about a density of information that is UN precedented when it comes to AI tools and that's why this is really really significant because as you know a picture says more than a th000 words well video is 24 pictures every second plus audio so this stuff really matters and if you think about it every social platform except maybe Twitter ended up as a video first platform there's a reason for that and trust me there's a lot to talk about here we now have a open source video model stable video diffusion gentu the leader of the fact lets you now selectively edit parts of an image that it turns into video and pabs literally just kicked in the door with a trailer that is out of this world it's actually a bit too good we'll talk about that and that's why today I'll be giving you a comprehensive overview of the AI video space including some insights that you might have never heard before and by the way yes there's more video related AI tools than we discussed in today's video but these are the major ones these are the foundational models outside of that you have many apps doing interesting things like voice synthesis very slight animation of faces and humans where it looks like they're alive although they're just being moved a little and then you have some AI video editing tools like the script but today we're talking about the major models that are going to be driving this whole Space forward all right so one of those would be runways Gen 2 so let's start our little journey through the AI video landscape right here inside of Runway MLS web app and if you follow AI at all you will have heard of this they were the first ones making major waves with AI video that was not terrible I'm not saying it was great all of this has massive limitations but so did AI imag just a year ago am I right and as you'll see later in the video we're really getting there but it all started with Runway earlier this year they released their first foundational model gen one and when I say foundational model you can think of these as GPT 4 GPT 3.5 claws 2 llama those are foundational large language models gen one and then later on Gen 2 are foundational video models and they offer a lot of features but let me just tell you all of these are not created equal for example I still find that the text to video I don't really know of a situation where I would go towards that it's just not that great in practice whereas the image to video where you give it a lot of information to work with actually works surprisingly well matter of fact if you've been following this channel closely you might have caught on to all the b-roll that we put into our videos to freshen things up a little bit and all of those have been created with Gen 2's image to video all right so before moving on to some of the newest models out here I just want to highlight two more features in here that are absolutely excellent and you can't really get these with the competitors as of now one of them is the remove background feature which is works surprisingly well you can paint over a subject and remove the background and it's actually better than for example the rotor brush tool inside of adobe's very own After Effects and the one standout feature that was added recently here is this motion brush right here where you can paint in certain areas of the image and it only animates those now this is extremely powerful because you can finally Control the Chaos that AI video can be a lot of the times and it works especially well on bodies of water or Skies it's absolutely terrible at animating humans though just like AI images were bad with humans a year ago I expect this to evolve over time but as of now don't even try to animate humans if their features like hands or faces are visible like in this example the astronaut might work because his suit is more of an object and the last thing that I want to point out is that you're often going to be limited in terms of export duration so your Clips are not going to be a minute long Gen 2 still leads the pack here with 4 to 18 seconds of duration that's really good but just like many large language models this is a closed model so all you can do is use this web interface you can generate free clips for free and then you have to pay for it but it's a closed proprietary model okay and before we look at the next AI video tool let me tell you about today's sponsor which is wirestock they make monetizing your photos videos and AI art really easy by uploading it to their platform and they do all the distribution for you which is usually a lot of work and with the Premium plan you won't have to do that anymore and once you have the Premium plan amongst many other features you get access to their brand new Styles feature the most inovative feature probably is creating your own Styles so let me create my own style by uploading 10 images of various cats with Hats in a cyberpunk style that is all right then after a bit of waiting the style appears on the my styles by the way here you have many preset ones but here you can create your own and then when I upload this image of a baby robot I can remix it with my cyberpunk style and it makes it more into a cyberpunk robot like so and look after running it a few times I actually really like this result now just be aware that this works differently based on the subject matter so you might have to play a bit but the cool part is they're going to introduce a Marketplace for these Styles so you'll have a way to monetize your very own style or a super simple user interface to reapply your brand style to whatever you're creating and as you can see you could also face swap upscale and then upload it to the various stock sites all in one place so thank you to wirestock for sponsoring this video now let's get back to talking about viral AI video tools now this is where we start talking about stable diffusion video might have heard of stable diffusion the open source image generator by stability Ai and now at the end of November they introduced a stable diffusion video model that is and this is the Highlight completely open source which means you can run this on your local computer completely offline for free and with all the coming updates that they're already talking about this is the worst version of this we'll ever have so let's have a brief look at this plus I'll show you all the different ways how you can use this today so what's important here is that they came out with two foundational models okay one is for 14 FPS video and the second one is for 25 frames if you didn't know if you go below the threshold of around 24 frames per second it stops looking like video to the human eye somewhere around 24 a series of images looks just like fluent videos so you get two models here one of them being actual video but there's a lot of limitations here and these are best talked about while showing you the different sites where you can actually use this one fairly obvious one would be a hugging face space this one is usually the slowest you can just drag and drop images into here or upload them user webcam what whatever and if you've been on Twitter throughout the last weeks you might have seen all these video memes where they take popular memes just like this and they use stable diffusion video to animate it and look this is anything but perfect but just like I pointed out with Gen 2 you will want to avoid humans in this it's just not that good at animating them it's a whole different story if the entire scene is in a cartoonish style that works really well but look at that this is something right and it's fully open source so this site might be your slowest options so I have two more here for you one of them would be the decoherence app and the good thing about this interface is they allow both s the video and text the video with text the video they probably just hooked up stable diffusion Excel to stable diffusion video so it first generates an image and then turns it into a video example coming in a second well that's something but before you click off this video just wait until the end because the third model that I'll be showing here is truly Next Level and that's where the space is heading here but here is actually my favorite one as I've been playing with all of these this one works most reliably plus it gives you a level of control that the others don't so here in replicate tocom you get a full form where you get to customize several attributes and if you don't want to do it the default settings work just fine but if you want you can you can switch it to the 25 frames model you can tell it to maintain the aspect ratio or crop it to 16 by9 just like the format of the video you're watching right now now I played with some of these but honestly I got some really wonky results when playing with the motion bucket and bumping up the noise just made it chaotic and there you go so as you can see when I bumped up the frame rate the video got shorter so this generated in under 2 minutes but yeah the limitation of the length here is one of the biggest caveats and about this problem with the length of the clip there's actually a fix this tool has been built by one person person and what it essentially does is it takes the last frame of the short video clip right so it will take this last frame right here and then it regenerates a new video and stitches two together effectively creating a longer duration even though you're just limited to a few seconds here as you can see this rocket launch is a great example of an inanimate object that it animates really well the background is pretty Sil it just has to figure out the movement of the rocket and how the smoke underneath behaves so again avoid complexity in the images you put in you will get rewarded with better results all right so this web interface is free and absolutely fantastic but if you want to go to extra step I won't go into that now I'll just point you into the right direction so one thing you could look into is this Pinocchio one-click installer that allows you to install various AI models and concretely the one you would want here is comfy UI which gives you a note-based interface just like the one I introduced you to in the video where we built a no code chatbot and that really allows us to dial in all the details if you're interested in me covering how to set that up step by step so you can have that on your very own machine locally and offline just leave a comment below but if you want to learn more about that I would point you towards Olivio Saras he has a boatload of comi tutorials so feel free to check that out okay so far so good we talked about two major players in this game but both of them have limitations right one limitation is the length Gen 2 is doing way better on that and another limitation is the resolution some of these are just not that sharp but no worries I got you because there's tools for both of these if you're not aware already topas video AI it's costly but it's currently the best software to upscale videos with AI and this is what really allows for Rich detail in some of these videos because by default they're all just a little soft and topas really lifted to the next level this is not sponsored whatsoever it's just the best tool available right now so as you can see this just brings the footage to the next level now most of the times it's not night and day but it's a difference between huh this is okay and wo that's actually good and that's the thing with a lot of video tools and equipment it even works that way in the real world if you want to go from an average smartphone video to actually polished clip for social media it takes a lot of effort you might need a DSLR or mirrorless camera a proper lens you start lighting but then every time you try to make the resulting video just five or maybe 10% better it's twice or three times the work that's why TV commercials have Crews of 20 30 50 people and the result is not 30 or 50 times better than your typical Instagram commercial right and that's because upping the quality once you're at a certain level becomes really challenging I think the same thing will apply in here and that's why we've seen so many improvements over the last year because again going from a very primitive level of quality to Clips like this is actually a big jump but now we're at the level where it starts getting tricky and this is where PAB shows up with their 1.0 model like unannounced and boy oh boy did it blow people away they're probably the reason people are calling this the chat GPT moment of AI video because this little trailer that I strongly recommend you watch is impressive there's just no other way to put it but what I would say is after you watch it for the first time and some of the hype wears off turn the sound off and watch it like this and this way you'll actually get a feeling for how good this actually is because when you consume the final product they put together oh so well the music and the sign design in this are so well done that it makes it look way better than it actually is and don't get me wrong this is absolutely incredible we've never seen quality like this out of AI video if you look at it closely it's not perfect but it's just so much better than anything we've seen up onto now look at these monkey getting sunglasses and them actually tracking nicely plus the reflections work too look on these last ones it actually adjusted his head so they fit behind his ears this is really impressive stuff and it getting something like this robot right not bad and I'm sure all of these clips are cherry-picked right but the fact is no matter how often you run a similar clip through Runway Gen 2 well at least from what I've seen you're never going to get a robot walking just like this especially from text to video but again just as we mentioned before you can see that no photo realistic humans are featured in here just because they don't work yet and I don't see them working over at least the coming months these features here in the end are all about editing existing video and at this point I should also point out yes Adobe had some similar announcements with Premier Pro but we're still waiting for that they just announced them but during their Keynotes they showed off exactly this feature where you could change parts of the video with AI and it would actually track to the subject just like this top quite perfectly tracks I mean honestly no matter how closely I evaluate this black top it just tracks perfectly so yes it's a perfectly produced trailer with Incredible sound design and all the clips are surely cherry-picked but the fact remains you two will be able to create something like this with a freely available model because what p did here is they raised that a $200 million valuation and from what they've communicated so far they don't plan to make this paid for now that is just like open I did with chat GPT on release now one thing that should be noted is that currently p is available only for Discord and this will be through the website and Discord at the same time oh one more really cool thing about them when you read up on the founders and the interviews they clearly state that the mission of p laabs is to create consumer friendly tools they're not making this app for Hollywood they're making it for creators just like me and that makes me super excited about the future because everything you can dream up you will be able to turn into a video and then if you combine things like gp4 or GPT 5 for script writing you use AI images to storyboard and then use AI video to bring the storyboards to life we're quickly accelerating towards a future where even teenagers are going to become storytellers at a level that we've never experienced throughout human history and I'm not making this stuff up literally the youngest member of the team at the AI Advantage Philip a 15-year-old from warau sent me this clip today showing off what he created in Just 2 hours [Music] and that's with today's tools this is not even using the new paa 1.0 so now you could start speculating what happens if people actually hone their skills and spend more than 2 hours on a project well it's just a new era and we'll have to adapt to the fact that people will be telling compelling stories with visuals that go beyond what your iPhone can record like today an individual wouldn't really be able to create animated anime series right like you'll have people bringing entire fantasy Realms to life with this stuff think about that so many people will want to recreate Lord of the Rings and that is just an a narrative side what will happen to the videography industry all the people that shoot videos for social media well I would say if that's you the only Lifeboat I see here is actually learning these tools and becoming fluent at them ahead of some of your peers that due to inertia will just keep doing what they have been doing because let's just say one videographer is hired to shoot a short Instagram real promotional video for a beverage and then another videographer that actually uses AI gets hired for the same job now what are the outcomes going to be by the time this guy sent out his first idea for the clip the AI powered guy will already have delivered three different story boards as proposals and if he gets a green light all he needs is some product photos and then he'll be able to animate them and very quickly he'll be able to achieve quality like this which currently is just Unthinkable for a solo creator with a little bit of AI magic and a few more months maybe a year of development you won't be able to tell the difference between real video and AI video just like we reach the phase where we photos you're not able to tell the difference anymore right I don't know if you've seen but this AI generated influencer that sells a only fans account has been going viral all over social media and if you're not looking out for the fact that she's AI generated the quality here is so good that most people wouldn't be able to tell expect the same to happen for video just that I feel like this will have a way larger impact on society just because video is the most dense media format we have and all the biggest social media platforms rely upon video as the main medium again there's a reason for that and this is about to change it all so I can't be more excited for the future of this space I'll be covering it closely I hope you guys enjoyed this overview in future videos I'll go more into depth I wanted to create this first video to give you a broad overview if you have specific requests leave them in the comments below and if you want to continue your AI video Learning Journey check out this video right here because as you can tell there's a lot to explore here

Channel: The AI Advantage

Views: 6,442

Keywords: theaiadvantage, aiadvantage, chatgpt, ai, chatbot, advantage, artificial intelligence, gpt-4, openai, ai advantage, igor

Id: 5seXZZgD4UE

Length: 15min 18sec (918 seconds)

Published: Sun Dec 03 2023