Local AI Automation
AI Advertising

Prompt-to-Video: Plain English to Finished MP4 With HyperFrames

Treat a video as an animated website: describe source, length, and vibe, let an AI agent write the code, and render the MP4 locally — free and fully editable.

Piyabhum Sornpaisarn4 min read
Share
Pixel art hero illustration — an abstract landscape of circuit traces and connected workflow nodes (artwork for "Prompt-to-Video: Plain English to Finished MP4 With HyperFrames")

A thirty-second product video used to cost an afternoon: find the clips, cut them on a timeline, sync the voiceover, build the motion graphics by hand. Then change one sentence in the script and do half of it again.

There is now a workflow that flips the direction of the work. Instead of editing frames, you write a paragraph in plain English — "a 30-second bold, cinematic launch video for this product, faceless explainer style" — and an AI coding agent builds the video as code, then renders it to a normal MP4 on your own machine. One open-source tool at the center of this is HyperFrames, and the mental shift it asks for is small but strange: treat a video as an animated website.

If you have ever built a web page — or watched one load — you already understand the mechanics. Text, images, motion, timing. Record that page frame by frame and you have a video file.

Direct answer

HyperFrames is an open-source tool that turns plain-English prompts into finished videos by treating the video as an animated website. You describe the topic, length, and vibe; an AI coding agent like Claude Code writes the animation code; your own computer renders it to a standard MP4. Because every stage — script, storyboard, design — is saved as an editable text file, you can tweak one scene and rebuild without redoing the whole video.

The old way vs. the prompted way

Traditional editor (Premiere, Resolve)Cloud video generatorsHyperFrames + AI agent
You produceCuts, keyframes, motionA promptA prompt + reviewable text files
Iteration costHigh — timeline surgeryRe-roll, hope, creditsEdit one text file, rebuild
Runs onYour machineTheir cloudYour machine
Output controlTotal, manualLimited, black boxTotal — it is just code
Recurring costLicensePer-generation creditsFree and open source

The third column is the interesting one: full control and automation, because the video is built from files you can read and edit rather than a project binary or a cloud render you never see inside.

Setup: one folder and one sentence

The toolchain is deliberately boring:

  1. Create a folder — my-videos — anywhere on your machine.
  2. Open your AI coding agent in that folder (in the Claude desktop app: the Code tab, pick the folder).
  3. Tell it: install hyperframes.

The agent runs the actual commands; you watch. What lands is a small framework for building videos as code, plus a set of workflow templates, all inside your folder.

# What the agent is effectively doing for you
cd my-videos
npx hyperframes init        # scaffold the video workspace
ls
# DESIGN.md  SCRIPT.md  STORYBOARD.md  voiceover/  out/

That file list is the whole philosophy. The video is not a blob — it is four text files and an output folder.

Prompts, from shallow to deep

The basic prompt

Start lazy and see what happens:

"Create an 8-second video explaining the health benefits of sleep with a clear visual metaphor."

The agent writes the animation, renders it, and saves an MP4 to out/. For a first test, good enough is the goal.

The prompt that actually works

Basic prompts give basic results. Reliable output needs exactly three ingredients:

  • The source — a topic, an outline, or a URL to build from
  • The length — "30 seconds", bounded and explicit
  • The vibe — "bold and cinematic", "clean and minimal", "playful"
Create a 30-second faceless explainer from https://example.com pricing page.
Vibe: clean and minimal, cream on charcoal, generous whitespace.
Narration: concise, no hype words. End on the product name.

Source, length, vibe. Miss one and the agent fills the gap with guesses — which is where "the AI made something weird" stories come from.

The recipes

HyperFrames ships purpose-built workflows that bundle the prompt scaffolding for common formats:

  • /product-launch-video — point it at a product page, get a promo
  • /faceless-explainer — educational, narrated, no on-camera human
  • /motion-graphics — logo stings, data graphics, simple animation
  • /website-to-video — reads your site's actual colors and fonts so the video matches your brand without you specifying anything

The last one deserves a note: brand consistency is normally the first casualty of automated video. Pulling the palette from the live site removes that failure mode entirely.

The part that changes everything: editable stages

Here is the structural difference from both timeline editors and cloud generators. The pipeline saves each production stage as a separate, human-readable file:

StageFileWhat lives there
DesignDESIGN.mdBrand rules — colors, fonts, spacing
ScriptSCRIPT.mdThe narration, word for word
StoryboardSTORYBOARD.mdEvery scene: visual, text, timing
Voiceovervoiceover/Generated audio tracks

Say you love 90% of the video but one transition is wrong. In a timeline editor, that is surgery. With a cloud generator, that is a re-roll that destroys the 90% you liked. Here, you open STORYBOARD.md, change one scene's text, and ask the agent to rebuild just that section:

// STORYBOARD.md, scene 4 — before
{ "scene": 4, "duration": 3.0, "visual": "pricing table zoom",
  "narration": "Three plans, one for every stage." }

// after your edit
{ "scene": 4, "duration": 3.5, "visual": "pricing table slide-up, highlight middle plan",
  "narration": "Start free. Upgrade when the team grows." }

Rebuild, and only scene 4 changed. The iteration cost approaches the cost of typing.

A TypeScript-shaped safety net

Because the output is code, you can also enforce your own rules on it. A small check that fails the render when the script breaks your own constraints:

import { readFileSync } from "node:fs";

const script = readFileSync("SCRIPT.md", "utf-8");

const banned = ["revolutionary", "game-changer", "unleash"];
const hits = banned.filter((w) => script.toLowerCase().includes(w));

if (hits.length > 0) {
  console.error(`Hype words found: ${hits.join(", ")} — rewrite before render`);
  process.exit(1);
}
console.log("Script clean. Rendering.");

Try building that guard into a cloud video generator. This is what "the video is code" buys you: quality control becomes ordinary programming.

Where the limits are

Honest boundaries, because they matter:

  • Render time is yours. Local rendering means your machine does the work — fine for 30-second explainers, plan coffee breaks for long videos.
  • The agent is only as good as the brief. Vague vibe, vague video. The three-ingredient prompt is not optional decoration.
  • Photorealistic footage is not this. HyperFrames excels at motion graphics, explainers, and branded animation — not cinematic live-action replacement.

Final thoughts

The traditional editor made video production a craft of the timeline. Cloud generators made it a slot machine. The HyperFrames pattern — video as code, built by an agent, rendered locally, stored as editable text files — makes it something closer to writing: draft, review, revise one paragraph, republish. You keep every bit of control the timeline gave you, hand the manual labor to the machine, and pay nothing per render. Describe the video you want. Read the video you got. Edit the paragraph you hate.

Newsletter

Get the next guide in your inbox

New articles plus the workflow files from each guide — and instant access to the free download library.

No spam. Unsubscribe anytime.

Related posts

Local AI

Build an AI Test-Prep Question Generator With Ollama

Turn a local LLM into an endless practice-question machine: generate exam drills with Ollama, validate the JSON, and auto-retry when the model slips.

5 min readAI test prep question generator
AI Agents

Mastering Autonomous Workflows with Claude's /goal Command

Stop typing every instruction. Claude's /goal command hands the AI a finish line and a 5-part framework — Task, Why, Outcome, Constraints, Verification — so it works autonomously until the job is truly done.

4 min readclaude goal command autonomous workflows