I made 60fps Flipbooks using A.I.

what would happen if I took a flip book which flips at about 12 frames per second and ran it through AI frame interpolation software could I boost it up to 60 frames per second so that's what we're going to do in this video it's an experiment we're going to take some of my flipbooks run them through AI motion smoothing and see how well it does [Music] so we have this technology where you can take footage or animation that was originally filmed at say 24 frames per second and we can artificially increase it to say 60 frames per second 60 frames per second is definitely smoother but it's not always better I personally am not a fan of artificial motion smoothing on TVs I don't like it and it's the first feature I turn off on my TV because it looks fake and terrible but I'm still curious what would a flip book look like at 60 FPS if this animation is 12 frames per second and I want to increase it to 60 frames per second that's five times the number of frames that's a lot of interpolating you'll have one real frame here one real frame here and then the AI is going to fill in four artificial frames in between that means 80 percent of the final animation would be fake so let's start with my pencil flipbook I have some frame interpolation software called Rife let's run it through that and see what happens okay there are lots of confusing settings here let's figure this out foreign [Music] this could be more difficult than I thought it's time for some answers [Music] [Music] foreign kind of but not really so it's not super different actually there's a little bit of smoothing in there but it's it's not it's nothing significant but we have a couple things working against us first although this flip book is 12 frames per second the video of the flip book is 24 frames per second so we've got a bunch of redundant frames to begin with and second we have all these frames with the blur from the pages moving so what we need is a clean video to start with of this flipbook at 12 frames per second with no blur frames I could shoot these pages one at a time as a stop motion but I really want the final video to show the flipbook in my hands being flipped so I'm re-filming it flipping slowly and using a high shutter speed to keep every frame nice and crisp now I take the new footage loaded into Final Cut Pro I chop up the whole video into individual frames and then I delete every frame with a blur or a duplicate image and now we have a totally clean video at 12 frames per second with no blur frames okay now let's run that through the AI and see how the one problem with this software if you don't have a decent video card it is slower than a herd of turtles stampeding through peanut butter okay it's finally done uh and now I'm gonna watch the whole thing for the first time and see how it looks [Music] foreign [Music] the title's weird you can see the it's either like the jiggliness in the title I mean this AI thing is it's having to create a lot that wasn't there to begin with so you end up with a little bit of weirdness [Music] [Music] yeah there's some weird frames in here there's definitely a crispness to the original animation that's lost with this overly smoothed version okay I want to try this a couple more times for these next flip books I made clean flat stop-motion versions of them to start with I'm going to run them through the software and now here's what they look like at AI generated 60fps [Music] thank you [Music] thank you [Music] [Music] and now for my final test I ran my giant return of grumpy Cloud flipbook through the AI here's how it looks foreign [Music] [Music] [Music] [Music] [Music] when you watch through the AI versions of these flipbooks slowly or frame by frame you definitely see some weird stuff but despite the weirdness it's pretty interesting to think about the fact that 80 of what you're seeing is fake it was never there to begin with [Music] I'm a purist I like the original better for me fake motion smoothing will never be able to match the intention of the animator who created the original animation I think the smoothed versions lose all feelings of snap and impact kind of messes up the timing of the movements and just overall turns things into wobbly Jello I would say the most successful one was the balloon that one was pretty clean but yeah really interesting experiment cool technology but I still don't like motion smoothing but what do you guys think you can totally disagree with me let me know down in the comments what you prefer what you thought as always stay creative love you guys and we'll see you in the next video foreign

Channel: Andymation

Views: 15,906,320

Keywords: flipbook, flip book, flipbooks, flip books, andymation, flipbook fest, animation, stop-motion, flipbook tutorial, best flipbooks, flipbook contest, flip book drawing, how to make a flipbook, andymation flipbook, 360 book, japanese 360 book, paper craft, 60 fps, frame interpolation, motion smoothing, 60fps

Id: WG_A1DjPqIs

Length: 8min 4sec (484 seconds)

Published: Fri Apr 22 2022

Reddit Comments

[u/BobKain]

Skip to 3:50 to just see the flip comparison.

[u/alan-the-all-seeing]

i think a key ingredient in all this is that he made 12fps animation, and so was guided by that knowledge in what he did and how - if you were designing animation to be 30-60fps, i think you might make some different choices

[u/Vilhelmgg]

Actual video starts at 02:35 lol

[u/ForresterQ]

I was struggling to see the difference

[u/crippler95]

Actually i like the 60fps version, a lot of weird frames, but good job from the AI generally.

[u/PreferablyAnonymous]

Well that’s cool!

[u/mangalci]

Even with the current results, I'm happy with the AI one. Considering AI technology could get even better in time, it'll work perfect for humans to work lesser. I'm just afraid that making things easier for humankind simply makes them create too much, and too much always ends up with bad quality content.

[u/t0mt0mt0m]

Beautiful. My thoughts exactly, motion smoothing makes me a bit sick honestly. Great video.

[u/playnbagpipesonatank]

I totally understand why animators don’t like it, it it would be nice if studios would animate in 60fps more often. It’s very pleasing to the eye for some animations.

Again, I get why most studios don’t. However it would be nice, for example, if the studio that animated Naruto didn’t pump out ~300 episodes of filler and instead had made smoother animations.