Make Any Image Move & Dance with this FREE AI

Video Statistics and Information

Video
Captions Word Cloud
Reddit Comments
Captions
today I'm going to show you a cool AI tool that'll allow you to take an image and turn that into an animated video with dancing or movement so let's get into it now the tool we're going to be using today is called Magic animate however this is one of three very similar tools currently in development now magic animate is the only one open for demo so that's why we're using this one today however there are two more that will be released you know sometime soon hopefully and we can play around with those in the future and those two are called Magic Dance and animate anyone now Magic Dance seems to be about as good maybe a little worse than magic animate but we've really got to keep an eye out for this animate anyone because if you take a look at these demo videos here they look almost perfect like look at this Iron Man one it captures the depth and the character so well with so little imperfections that this tool is going to be the future of AI animated videos but like I said this tool is not currently out for testing so we cannot play around with it yet but when it is available I'll let you know and make a video on it so back to Magic anime now the way this works is you upload a reference image and then you upload a motion file and then after a little bit of time it'll generate this animation and here's an example of like the Mona Lisa running and it does a pretty good job sure it's not perfect but this this is a very early stage of this kind of thing so we have to expect some imperfections but seeing how this is as good as it is today we can expect in a year that the results will be mindblowing and then here's a few more results that also look pretty good and then you can see it also has multi-person support so this is really cool now as far as the demo goes that is hosted on hugging face and it's a very similar like interface to a lot of other AI tools so it's pretty easy to understand so head down to these examples and pick whatever motion you would like I'm just going to go with this dancing one for now and when you click on it it's going to autop populate these things up here now because all we really want is the motion sequence we could just hit this X on the reference image and drag in our new reference image so I'm just going to do this guy standing in the sand and then you come over here if you want a specific seed you can do a seed or you know changing the sampling steps or the guidance scale But ultimately you don't really need to do that it it works just fine without and like any edits um so you just click this animate button now as you can see here I'm getting a few errors so just refresh the page and try again so for some reason I cannot get this to work it's probably because I have other tabs with this open um because I pre-generated this cuz it does take you know about 5 minutes per generation so that's probably why it's not working for me but you shouldn't have any issues so this is another generation that I did I had this guy reading a book up against this brick wall here and then I used this running animation and then this is what it gave me as an output so as you could see there are a few background things that are going on and the book it didn't really know what to do with the book and so it just sort of made it a part of his shirt which I think is funny but it does a pretty good job like tracking it onto the shirt so um overall I think that was a pretty good success for this now I think the biggest downside that this has is the face and the head overall like it doesn't keep a consistent hairstyle and the face is sort of all over the place um but does a decent job at capturing the motion and especially with the shirt like it seems to hold the v-neck pretty you know clear throughout this animation it doesn't seem to like change the shirt at all too much so overall you know it's showing great progress for the future of this tool you may be wondering how it handles drawing slanime because we saw the Mona Lisa and that seemed to work but that was more of like a realistic you know drawing SL painting so how does it work on anime where it's not you know exactly like a human at least as much as like a painting would be so I just did this dancing uh image here so let's see how that turned out so it definitely struggled a little bit more with the anime one the face is completely distorted and some weird things happened with her dress down here um and overall you know whatever this is back here and then it tried to form a tree where the original image there wasn't a tree and it sort of was in and out so it definitely struggled a little bit more with the drawing but it wasn't terrible so it does work just not super well so I wasn't expecting it to work at all because it requires you know a pretty humanoid you know form but it's doable now you may be wondering how do I use other motion sequences aside from the five that are listed here because you can upload your own now the first thing that you can do is come back over to this GitHub site and sort of just screen record these crop them and then upload them to the site because they've already like pre-made these because it does have to be um like this sectioned out so they do have a few extra examples on this uh site that they didn't have on the demo so you could you know take these over and use them but as we can see down here this uses the dense pose sequence so in theory you could go download dense pose and you know figure out how to use it and here's the GitHub site but as you can see it's no longer supported like nobody like this is outdated it's now uh a part of this this new research so you know theoretically you could still install it but you know you'll have to go read it here but because magic animat's using this outdated you know resource it's a little hard to create or own so hopefully animate anyone uh will you know come out with an easier way to do this as of right now uh we have to you know figure out how to use dense pose and install it and run it on your computer and not only that you have to do it a ton of times to you know make it generate the sequin so overall it'll be a lot of work to generate your own so just try to use the ones that they already have listed there so yeah that was magic animate and how to generate these funny little like Tik Tock dances or running animations with the Mona Lisa I think out of all of them the Mona Lisa is my favorite just because it's so funny to see the Mona Lisa running in the original environment it just did a really good job with this one so it makes you wonder you know how far this is going to advance even in just a few months uh because you know a year ago this was completely unimaginable so we'll just have to wait and see you know what happens in the future but thank you so much for watching this video leaving a like and subscribing really helps the channel out and to discover more cool AI tools like this one check out our website at ai- search.
Info
Channel: AI Search
Views: 47,705
Rating: undefined out of 5
Keywords: ai, ai art, stable diffusion, AUTOMATIC1111, Stable Diffusion Tutorial, AI Yearbook, Yearbook AI, AI Yearbook Trend, Roop, Stable diffusion Roop Tutorial, Roop Tutorial, Roop Stable Diffusion, artificial intelligence, text to video, text to video ai, text to video generator, text to video ai free, MagicAnimate, animate Anyone, MagicDance, Animate anyone AI, MagicAnimate AI, Magic Animate AI
Id: 1pATjLFvNtY
Channel Id: undefined
Length: 7min 26sec (446 seconds)
Published: Tue Dec 12 2023
Related Videos
Note
Please note that this website is currently a work in progress! Lots of interesting data and statistics to come.