[ CODE ] PROJECT

Video automation pipelines

Two generations of pipelines that turn a topic into a finished, narrated, illustrated short video automatically.

TYPECode
MADE WITHPython · LLMs · ComfyUI · TTS · Whisper · ffmpeg · Flask
Video automation pipelines

Overview

A write-up only. The code is private.

Generation 1: LeMone

Scrapes a story, writes a script, generates TTS narration and word-timed subtitles, and renders a finished vertical video with ffmpeg and MoviePy. Uploaders for short-video platforms were built on top.

Generation 2: HalfAwake

A full production line for animated narration videos:

  • Script: an LLM writes the script from a topic
  • Art: consistent characters and scene illustrations generated with image models
  • Voice: TTS narration, Whisper for timing
  • Edit: automatic video assembly with SFX
  • Ops: per-stage checkpoints so a crashed run resumes, and a Flask dashboard to queue and monitor jobs