What it is:

Creating a multi-step, 600-frame animation from an original video.

What I did:

  • Isolate individual frames from a source video using DaVinci Resolve.
  • Apply an anime style to each frame using Stable Diffusion.
  • Remove the background from processed frames with Runway ML.
  • Generate dynamic background using Stable Diffusion (Deforum).
  • Combine the output with the new background using DaVinci Resolve.
Read Full Post Details...

Software Used

  • Stable Diffusion with Deforum
  • DaVinci Resolve
  • Runway ML

This is a tutorial-based project. I followed a tutorial by Matt Wolfe on YouTube: Watch the Tutorial

Example Videos

  • Video 1
  • Video 2
  • Video 3
  • Video 4