This NEW AI Will Revolutionise Animation! - Exploring The Amazing ToonCrafter Tool

hello everyone and in this video I'm going to show you this incredible gamechanging tool which allows you to create some insane animation I'll run you through what the tool does and then how it's going to change the animation industry and I'll show you some of my own examples along with some tips and tricks okay let's get into it so the tool in question is called tun crafter and the time of filming it is in the early stages but it's proving to be very impressive and I can see this tool laying the groundwork for Future tools like this in its simplest form you give it two frames and it creates an animation between the both of them so let's check out some examples so for this one we can see a passport being stamped and it does an incredible job at keeping the text visible throughout the animation and it even has the shadow moving from the stamp moving upwards this would be really difficult to do with other tools as they normally warp the text and for these they've used screen grabs for the film Spirited Away as you can see they've only got two frames but the animation created has all of the fabric and the hair on the girl moving and it even has the seagulls moving in the background and this one's impressive as the train in the water the frames look nearly identical but because one of the frames is a tiny bit different the tool can notice that it's moving through water so it animates the splashes and the train moving forward and again this one each frame is very similar but as you can see the second frame has the man moving closer towards The Shining object again in this one there's not much difference between the two frames but the tool has recognized that it's a horse and it creates some really realistic horse movements and for this one we've got a zoom in kind of video and to get that all they did was crop in slightly to frame one and the tool must have noticed that one of them was a bit zoomed in so it created a kind of zoom in camera effect through the corridor and here in between frames her head is slightly looking towards the left so it's animated her head perfectly and even added in a blank I would not be able to tell that this wasn't from the film itself and here we have a girl with her hair kind of blown by air and then the second frame it's kind of calmed down a bit and the animation does just that it creates the sense that she's been blown by some wind and the animation on the hair and the clothing looks very professional and here are some comparisons with other similar tools and as you can see the toun crafter version is just way better than the others the other ones have a lot of morphing and disfigurement to them they can't keep the composition of the animation and tomb crafter just holds it perfectly and here's another example whereas you can see all the other ones where it starts moving it just becomes a blurry mess but toun crafter is sharp and it holds that composition again another one with a car and the other ones just are a complete mess and it also works for sketches as well so here you can see two frames of a donkey or a horse walking and it puts them together and creates this really nice looking sketch and then if you have a sketch animation you can Al feed it a colorized version of one of the frames and then it colors in that whole drawn animation which is pretty insane and it's nice that they do say there are limitations with this tool there are two frames of this man in a what seems to be some kind of fighter jet and in the final video it's got part of the ship but it's moving about everywhere I guess the tool didn't recognize that this black strip is part of the ship and shouldn't be moving about like that and as you can see here the two frames shows a man walking away and the second frame is a man walking into the shot but the tool thinks that it's the same man and it merges them together but we are still in the early days for this tool so I'm guessing they will work out these tweaks there are loads of really impressive examples showcasing this tool so I'll make sure to leave a link to it in the description box below so now let's have a look at creating some of our own animations so from this website all you have to do is click on the hugging face demo and all the links you will find down below so how it works is you upload one frame here and then the second frame here and it should animate in between both now I would leave these settings the same to start with and you can feel free to change them as you experiment a bit more and down below here it shows the settings that were used for these specific videos so that passport stamp one used these settings so you can use them as reference so what I'm actually going to do is I downlo downloaded some of the images from the demo videos that they had on their website and I want to see if I get the same result so I've got the frame one and two of this character moving their head I might just write in an anime scene just to see if that works I'll go generate it may take a little bit of time to generate but it's not too long so let's have a look at the finished video and it looks really good now the downside is the generations are very short they're only a couple of seconds long but the results are generally pretty good and from here you can choose to download it I'll be showing you my method of upscaling videos later in this video so stay tuned for that now I'm going to try that passport animation that we saw earlier and they actually have the example down here so I'm going to copy the settings now the only thing that's different is the seed number so I'll change that to 789 and let's see how that looks I think it looks really good but the funny thing is it doesn't look exactly the same as what they showed on their website so I'll try a different seed and see how that comes up and here's the result with a different seed number and again it looks really good and here's the video I got of the person holding the gem and the face gets a bit weird but it does create a really cool effect on The Shining gem that she's holding now I'm going to show you another website which uses this model to create animations so this website uses other people's computers to generate the animations for you and you get a free amount of time to use and then if you run out you can choose to pay a very small amount to generate more animations but I think it's worth it as the results generally are better so when you jump onto this website you'll notice they've already got an example running on the page it's a really nice looking video of a character looking from left to right now the difference with this site is you can add up to 10 images not just two so here you can see they've got the character looking to the upper left and then slowly moving over to the right on the last frame and you can change the width and the height of the video from a minimum of 256 pixels to a maximum of 768 pixels you also get to add your prompt and negative prompt so let's try a few examples all you have to do is click on clear file to get rid of those images and then click on this little cloud icon and then you can drag or click and upload your images I'll try this dual image again but with this new site to see if it's any difference and I'll bump up the maximum resolution and you can also choose to interpolate the footage as well so it adds more frames into it click on run and just give it a short well to process the result came out pretty good it looks very similar to the other one but with a bit more resolution okay so now I'm going to try with my own images that I created in mid Journey so I've got this image of a samurai and the second frame I've just zoomed in slightly I've also added in to the prompt a samurai in a field and in the negative prompt bad quality so hopefully that should help and I'll click run and we'll see what that looks like and it's created this awesome shot it looks so cool it's done a really cool action like zoom and it's even put some kind of leaves blowing in the background that's a really nice touch so yeah very very impressed with this shot and from here you can download it so here are a few more examples you can get quite creative with using the software as for this one I used this blue flame and as this website allows you to use up to 10 frames I did that and it created a longer video and it came out looking really nice it's got this kind of Animation stop frame style to it and you can use this as an element in any of your videos and in these videos the software actually saw that there was snow in the shot so it added moving snowfall in the video which was really impressive and in this other similar shot it did the same thing but with Falling Leaves instead for these videos all I did was have one image and then I cropped in slightly for each different frame and the video just kind of added a zoom effect so now I'll show you how to create your custom frames in mid Journey you can use other software as well but I'm using mid Journey for this example so I've got this image of this boy in the rain and what I want for the final animation is it to zoom in and to have the character blink but this image is a bit closeup so what you can do is use the zoom feature so either click on Zoom 1.5 or two times and it will add a bit more room around the image so this is the zoomed out image and I'm really happy with it and I also created one a little bit more cropped in so for this one I want him to Blink his eyes in the animation so I'll go to vary region and I'll select around his eyes and I'll write in eyes closed you can also do this in Adobe Photoshop with generative fill or you can use photop which is a free website it's pretty much a Photoshop alternative so you can use this magic replace tool you can select around the eyes and write in closed eyes and click replace and you just have to make sure you watch a short add but it only lasts a few seconds and there you go it's created some closed eyes just remember to change the model here as it may have a realistic model on and you don't want real eyelids on your character and then I just added these frames into the model and it created this video it's added in the rain effect in the background and it's animated the eyes perfectly you can use this tool in mid Journey or other software to add in different things to your frame so in this one I have a cup of coffee and I wanted a hand to grab the mug so I drew an area around here and then I added in a hand reaching to grab the cup of coffee hand anime hand and it created this which is just what I was looking for then I added these frames into that website and it created this animation they're not perfect but I think it did a really good job I did a similar shot but with another character and I added frames with a different mouth I also added some sunrays in some other frames and it added it into the animation as it zooms in the sunlight's in the corner and he begins to talk some of the mouth animations aren't perfect but I could easily improve that if I wanted to and then combining some of the scenes that I've created I added some voice over and a bit of music and you can create some really cool shots oh hey what a cool animation don't forget to subscribe and you can create some really cool short videos now this one's just a demo but it's just a glimpse to see what's possible here's an experiment that I tried I drew two faces in Photoshop one with a normal blank face and then the other one I changed the expression so I added in some angry features and the video that it generated was really impressive as you can see the animation for changing her facial features look really professional I am really impressed with what it's done with just two very simple images okay and now I'm going to show you how you can upscale your videos for the first method I'll show you the free way to do it capcut have a video upscaler so you just upload your video here and it says it's going to upscale the resolution by two times then just click on upscale and as you can see it's done a really good job at sharpening up all the details and then you can choose to export it the other method I use to increase the resolution of my videos is using topan has video AI so I've uploaded that video and then from the output resolution you can change you have a lot of options so I generally go four times upscale you can choose the frame rate I'll stick to the original which was 8 frames per second and then here you have a bunch of different options I'm just going to keep the auto settings on here and then I change my encoder to h265 change the quality level to high and export and the results look amazing it's really sharpened up all those edges and it just looks a lot cleaner okay so that's it for this video and I believe this is the start of something big in the animation space I know it's going to be very controversial and I know it's going to have a big effect on many people's jobs and the industry as a whole I think when we add them to our workflow it will just make getting our projects and Visions out there much easier and quicker so if any body has any comments about this software please leave them down below I would love to hear your feedback and if you gained anything from this video please give us a like And subscribe to our channel for more videos like this if you would like to see any of that other stuff then feel free to click the image you can see on screen thanks for watching

Channel: Atomic Gains

Views: 6,956

Keywords: ai news, ai animator, ai animation, toon crafter, tooncrafter, animation

Id: 9TtqYhp3haw

Length: 14min 51sec (891 seconds)

Published: Sat Jun 08 2024