Project Auteur: The Agentic Animation Studio

“From Script to Cinema in One Click.”

Project Auteur is a state-of-the-art AI-Native Animation Pipeline that democratizes high-end storytelling. By orchestrating a team of autonomous agents—Director, Cinematographer, Animator, and Editor—it transforms raw text into fully realized animated films.

The Architecture (7-Step Pipeline)

This project implements a “Studio-Level” workflow, moving beyond simple chatbots to a complex, multi-agent production system.

1. The Director (Gemini 2.0 Flash): Analyzes the script, breaking it down into a beat-sheet and shot list.
2. Pre-Viz (Mixboard): Establishes the “Style Anchor” (e.g., Claymation, Watercolor, Cyberpunk) to ensure visual consistency.
3. Asset Factory (Google Whisk): Generates consistent character sheets and environmental assets.
4. Motion Engine (Google Veo): Simulates camera movement and character acting (Pan, Zoom, Emote).
5. Voice Synthesis (ElevenLabs v3): Delivers emotive, character-specific dialogue using the new “Meta-Prompting” engine.
6. Composition (Remotion): Programmatically assembles video, audio, and subtitles into the final MP4.
7. Delivery: Instant rendering via Next.js and Cloud Run.

Case Study: “Mr. Putter & Tabby”

To validate the pipeline, we produced a short adaptation of Mr. Putter & Tabby Fly the Plane.

Key Innovations:

• No Hallucinations: The “Director Agent” enforces strict adherence to the source text.
• Zero API Key Leakage: Secure server-side synthesis.
• Dynamic Styling: The entire visual style can be swapped (e.g., from Cartoon to Noir) by changing a single “Style Anchor” variable.

Tech Stack using Moonlang Intelligence

• Core: Next.js 15, React, TypeScript
• Video Engine: Remotion (Programmatic Video)
• AI Models: Gemini 2.0, Veo 3 (Proxy), Flux Schnell, ElevenLabs v3
• Infrastructure: Vercel, Docker

This project represents the next leap in Generative UI—where interfaces don’t just display data, they direct it.

View Source on GitHub | Launch Studio