#HTE

Turn Stop-Motion Footage Into Smooth Video Using AI Frame Interpolation

YouTuber LegoEddy, who creates stop-motion animation shorts with LEGOs, typically shoots at 15 frames per second. That’s fifteen set-ups for each second of footage. More fanatical stop-motion animators will go for 60 f.p.s., which is why it can take them years to complete a short that runs for mere minutes.

After learning about video frame interpolation, an AI-based technology that renders and fills in the differences between two shots, LegoEddy wondered if it could be applied to stop-motion animation. In other words, could he shoot 15 f.p.s. and have the AI fill in the other 45 frames, to achieve a 60 f.p.s. look with just 25% of the labor?

The answer, stunningly, is yes:

Link to download DAIN (for free).

Link to the source code.

Links to LegoEddy’s Apollo 11 movie, both original and interpolated.

https://www.core77.com/posts/101838/Turn-Stop-Motion-Footage-Into-Smooth-Video-Using-AI-Frame-Interpolation