JuneYaooo/rea-video Agent Skills on GitHub

Repository README

Repository README source: README.md

Expand full README

<div align="center"> <picture> <source media="(prefers-color-scheme: dark)" srcset="docs/brand/logo-light.svg"> <img src="docs/brand/logo-dark.svg" width="400" alt="rea-video"> </picture> Reverse-engineer any video. Shot by shot: was it filmed, AI-generated or coded, and how to remake it. Every breakdown is written in **[VIDEO.md](https://videomd.github.io/videomd/)**, an open format that agents read layer by layer. [Website](https://www.reavideo.ai) | [中文](i18n/README_zh.md) | English | [Русский](i18n/README_ru.md) | [日本語](i18n/README_ja.md) | [한국어](i18n/README_ko.md) | [Español](i18n/README_es.md) | [Português](i18n/README_pt.md) | [Français](i18n/README_fr.md) | [Deutsch](i18n/README_de.md) | [Tiếng Việt](i18n/README_vi.md) [![Stars](https://img.shields.io/github/stars/JuneYaooo/rea-video?style=flat)](https://github.com/JuneYaooo/rea-video/stargazers) ![Python](https://img.shields.io/badge/python-%E2%89%A53.10-blue) ![Agent](https://img.shields.io/badge/runs%20in-Claude%20Code%20%7C%20Codex-8A2BE2) [![Output: VIDEO.md](https://img.shields.io/badge/output-VIDEO.md-3d4fd6)](https://videomd.github.io/videomd/) <a href="https://trendshift.io/repositories/334878" target="_blank"><img src="https://trendshift.io/api/badge/trendshift/repositories/334878/daily" alt="JuneYaooo/rea-video | Trendshift" width="250" height="55"></a> [![Visit our website](https://img.shields.io/badge/Visit%20our%20website-6644D8?style=for-the-badge)](https://www.reavideo.ai) [![Join our Discord](https://img.shields.io/badge/Join%20our%20Discord-5865F2?style=for-the-badge&logo=discord&logoColor=white)](https://discord.gg/dZj8D3GqWT) [![WeChat group](https://img.shields.io/badge/WeChat%20group-07C160?style=for-the-badge&logo=wechat&logoColor=white)](i18n/README_zh.md#社区) [![Follow on X](https://img.shields.io/badge/Follow%20%40yao__june12106-000000?style=for-the-badge&logo=x&logoColor=white)](https://x.com/yao_june12106) ⭐ *Help more people find rea-video. Star this repo!* <img src="docs/cases/demo.gif" width="440" alt="Left: TikTok original shot on a phone; right: someone's AI remake with a different product"> Left: a TikTok ad shot on a phone. Right: an AI remake with another product. rea-video's verdict: the left is all live footage, one set and two camera positions; the right is all AI, 8 shots across 3 generations. </div> ## Quick start rea-video is built for AI agents. In Claude Code, Codex or any agent that can run commands, say: ```text Install https://github.com/JuneYaooo/rea-video, then break down this video: /path/to/video.mp4 ``` The agent installs the CLI, learns the workflow and runs the whole thing. You need ffmpeg and Python 3.10+. Breakdowns are fully upgraded. Each one gives you two outputs: - **Report** (`report.html` / PDF), for you: more reader-friendly, with a clearer structure, easier to learn from and to understand how the video was made and how to remake it. - **[VIDEO.md](https://videomd.github.io/videomd/)**, for your AI: layered, so the AI reads only what a question needs and uses fewer tokens. You can also hook up a video-capable model (Gemini or Doubao both work) by giving the agent its endpoint and key. That makes the live/AI/3D calls more accurate and adds a reverse-engineered prompt for every shot. It works fine without one; if your agent can see images, it checks the uncertain shots itself. > Reports are written in whichever language you ask in (Chinese or English). The example reports below are in English. ## What it can break down | Video type | Examples | What you get | |---|---|---| | Live footage | Talking-head, tabletop, handheld product demo, vlog, store visit | Setups and camera positions, framing, camera moves, lighting (12 setups with gear lists), color grade | | AI video | Text/image-to-video, AI short drama, AI music video | Evidence, a reverse-engineered prompt per shot, how to batch into generations and which model to use | | Avatar | A portrait driven by audio, lip-sync | Which shots are avatar shots, what portrait and audio you need | | 3D / animation | Blender / C4D explainers, product animation, 2D animation, stop-motion | Whether to generate with a video model or render from 3D code | | Code / template | Kinetic type, UI demos, charts, slide-style cards | Text, layout and motion timing, ready to rebuild as a Remotion project | | Screen recording | Software tutorials, web demos | Which parts are real material you'll need to record yourself | | Mixed / edits | AI characters + code UI + real screen capture; live footage with AI edits | Each shot judged separately, then reassembled on the original timeline | Besides how the visuals were made, every breakdown also covers: - Captions and styled text: start and end of each line (exports to SRT / ASS), plus color, outline and how the text comes in - Stickers, emoji, picture-in-picture: where they sit and how long they stay - Editing: where the cuts are, how fast, whether they hit the beat - Audio: human or AI voice, AI or library music and its BPM, where each sound effect lands - Material you'll need to supply yourself: screen recordings, screenshots, product photos ## Examples The sample videos in `docs/cases/videos/` are re-compressed to keep the repo small, which strips the TikTok / Douyin platform tags. So if you run them yourself, you'll get different results from the reports below, especially without a vision model. To reproduce them, use the original downloads from the platform. <table> <tr> <td width="50%" valign="top"> <a href="docs/cases.md#2-混合片ai-人物对话--代码界面--真实录屏"><img src="docs/cases/dual_role/thumb.jpg"></a> Mixed-media clip · 19 s · 10 shots AI characters talking + code-built UI + 8 s of real screen recording. The 5 dialogue shots are broken up by UI segments but share one set, so a single generation covers all of them. <a href="docs/cases/videos/dual_role.mp4">Video</a> · <a href="docs/cases/dual_role/report_en.md">Report</a> </td> <td width="50%" valign="top"> <a href="docs/cases.md#3-3d-科普片咸鸭蛋为什么会流油"><img src="docs/cases/salted_egg/thumb.jpg"></a> 3D explainer · 67 s · 21 shots All 3D, AI narration. You can do it in 10 video generations, or have an LLM write Blender / Three.js code. <a href="docs/cases/videos/salted_egg.mp4">Video</a> · <a href="docs/cases/salted_egg/report_en.md">Report</a> </td> </tr> <tr> <td width="50%" valign="top"> <a href="docs/cases.md#4-代码-ui-动效产品宣传片"><img src="docs/cases/v10/thumb.jpg"></a> Product promo · 70 s · 12 shots 83% code-driven motion graphics, 12% screen recording. No video model needed; one Remotion project does it. <a href="docs/cases/videos/v10_oiioii_gen_coding_first.mp4">Video</a> · <a href="docs/cases/v10/report_en.md">Report</a> </td> <td width="50%" valign="top"> <a href="docs/cases.md#5-ai-音乐-mv歌是-ai-写的还是曲库的"><img src="docs/cases/qing_mv/thumb.jpg"></a> AI music video · 165 s · 86 shots Correctly flags the song as AI-generated (it was made with Suno). The vision model called some shots "live-action drama"; the agent spotted fake Chinese characters on a scroll and ruled them AI. <a href="docs/cases/videos/qing_mv.mp4">Video</a> · <a href="docs/cases/qing_mv/report_en.md">Report</a> </td> </tr> <tr> <td width="50%" valign="top"> <a href="docs/cases.md#6-实拍带货沉浸式开箱"><img src="docs/cases/unboxing/thumb.jpg"></a> Live-action unboxing · 72 s · 29 shots All real footage: an overhead phone rig, one rug, one camera position, no voice-over, room sound plus library BGM. After platform transcoding, the offline tools called 35% of it AI; after agent review it came out 97% live-action. <a href="docs/cases/videos/unboxing.mp4">Video</a> · <a href="docs/cases/unboxing/report_en.md">Report</a> </td> </tr> </table> ## Remakes After rea-video breaks a video down, the remake recipe in [capsule-cinema](https://github.com/JuneYaooo/capsule-cinema) generates a new version that keeps the original's camera, motion, pacing and transitions and swaps only the elements you pick. These were made with a self-hosted MiniMax H3, using the original shot as the motion reference and keyframes with the swapped elements (gpt-image-2) for the look. Below are three remakes OiiOii showed in its WeChat articles. We made two versions of each: one with the same swap as OiiOii, and one that also swaps the subject, setting and props. Each GIF plays four versions in sync: the original, OiiOii's remake, our remake and the element-swap version. <table> <tr><td> Overhead outfit change · 12 s Same swap: woman → man, three outfits → matching menswear. Element swap: a girl in three historical Hanfu outfits in a Chinese study; the remote becomes a round fan. <img src="docs/cases/remake/outfit.gif"> <a href="docs/cases/remake/outfit_compare.mp4">HD comparison video (with audio)</a> · <a href="docs/cases/remake/outfit_sheet.jpg">same-moment stills</a> </td></tr> <tr><td> Paper-craft / watercolor animation · 30 s Same swap: new clay girl as the lead. Element swap: a fox; forest → coral reef, clouds → starry sky, sunset → aurora. <img src="docs/cases/remake/paper.gif"> <a href="docs/cases/remake/paper_compare.mp4">HD comparison video (with audio)</a> · <a href="docs/cases/remake/paper_sheet.jpg">same-moment stills</a> </td></tr> <tr><td> Handheld product video · 21 s · 11 shots Same swap: an original new product, English sticker → Chinese caption. Element swap: pink product, kitchen → camping table, new ingredients. <img src="docs/cases/remake/juicer.gif"> <a href="docs/cases/remake/juicer_compare.mp4">HD comparison video (with audio)</a> · <a href="docs/cases/remake/juicer_sheet.jpg">same-moment stills</a> </td></tr> </table> The HD comparison videos use the original audio. The originals and OiiOii versions come from the articles and are shown for comparison only. You can also do the remake in [ChatCut](https://chatcut.io/r/github-e4rd), a hosted AI video editor: there is no model to set up, and the generated shots land on a timeline you can keep editing. Sponsor ## Sponsors rea-video is free and open source. Sponsors help keep it maintained. <table><tr> <td align="center" width="200"><a href="https://chatcut.io/r/github-e4rd"><picture> <source media="(prefers-color-scheme: dark)" srcset="docs/brand/chatcut-logo-light.svg"> <img src="docs/brand/chatcut-logo-dark.svg" height="32" alt="ChatCut"> </picture></a></td> <td><a href="https://chatcut.io/r/github-e4rd">ChatCut</a> is an AI video editor for Claude Code and Codex that generates the shots, cuts them on a timeline and exports the finished video. <a href="https://chatcut.io/r/github-e4rd">Try ChatCut for free</a></td> </tr></table> Sponsored · <a href="https://reavideo.ai/en/contact/">Become a sponsor</a> ## Accuracy Accuracy of the how-it-was-made call, weighted by shot duration: | | Tuning set (15) | Holdout (16) | Re-encoded WeChat videos (10) | |---|---|---|---| | Tools only (offline, free) | 98.3% | 99.6% / 98.9% | 88.6% | | + vision model (Gemini) | — | 99.6% / 99.8% | 99.6% | | + agent visual review | — | 99.6% / 99.8% | 100% | The Holdout column shows two numbers: holdout (9 videos) and holdout2 (7 videos). On original files, the tools alone are usually enough. Videos downloaded from platforms have been recompressed, which wipes out the noise evidence, so you need a visual check to get back above 99%. Real-asset detection is 97–99%; on nine hand-labelled clips, shot boundaries reach 95% recall and 94% precision. Numbers and how to reproduce them: [eval/RESULTS.md](eval/RESULTS.md). ## How it works ![rea-video pipeline](docs/rea-flow_en.svg) 1. Split: cut the video into shots and split the audio into voice, music and effects. 2. Gather evidence: measure (frame cadence, sensor noise, whether the whole image moves as one flat plane, AIGC tags in the metadata), look (hands, text, physics) and listen (BPM, key, singing vs speech). 3. Decide: hard evidence like AIGC tags and frame cadence beats "looks like". Conflicts get flagged for the agent to check visually. 4. Plan the remake: batch shots according to what the target video model can actually do, such as max clip length, multi-shot support and how many reference images it takes. ## Star History [![Star History Chart](https://api.star-history.com/svg?repos=JuneYaooo/rea-video&type=Date)](https://star-history.com/#JuneYaooo/rea-video&Date) ## FAQ <details> <summary>How is this different from one-click remake tools like Hypit?</summary> [Hypit](https://github.com/hypit-ai/hypit) takes a reference video and makes a new one: the agent reads frame grids to understand the original, generates footage with the models it supports (Seedance, PixVerse, MiniMax, Wan and others), and renders captions and motion graphics in HTML. It doesn't ask how the original was made. A live-action source goes through the same pipeline; it won't tell you how many cameras were used or how it was lit. What AI video it can match depends on the models it supports: no Kling or Veo, no dedicated avatar or 3D path, and no AI music (you bring your own). It's strongest on talking-head, podcast and interview videos that follow a script, and weaker on music-driven edits, product motion graphics and cinematic shorts. rea-video doesn't render a video. It works out shot by shot whether something was filmed, AI-generated or built in code, then gives a shooting plan, prompts or a code approach for each. For a quick lookalike, Hypit is faster. To understand how the original was made and remake it cheaply, use rea-video. They work fine together. </details> <details> <summary>Do I need a video-capable model? What does it cost?</summary> No. Tools-only mode is offline and free, and already accurate on original files. For recompressed platform downloads, add a video-capable model (Gemini or Doubao both work) or use an agent that can see images; you pay whatever that service charges. Automatic video generation (capsule-cinema) does a free dry run first and only calls paid models after you confirm. </details> <details> <summary>Can it remake the whole video automatically?</summary> Partly. With [capsule-cinema](https://github.com/JuneYaooo/capsule-cinema) installed, AI shots are generated and placed back on the original timeline automatically. You film the live shots from the shooting plan, and the agent writes the code shots as a Remotion project. See [docs/replicate.md](docs/replicate.md). </details> <details> <summary>What is VIDEO.md, and why does rea-video write one?</summary> Every skill has a `SKILL.md`; every video gets a `VIDEO.md`. It is an open format for video breakdowns, made so that models read only what a question needs. A full breakdown runs to hundreds of thousands of tokens; VIDEO.md lays it out in levels: a card of a few hundred tokens, an overview and map, a timeline with one line per shot, then one file per shot. Every file states its size, and what is seen on screen is kept apart from what the tools infer. rea-video writes one into every output folder (`out/ref/VIDEO.md`), and its agent skill reads it instead of the raw data. Other agents and tools can read it without knowing rea-video: `pip install videomd`, then `videomd check out/ref`. The spec and guides are at [videomd.github.io/videomd](https://videomd.github.io/videomd/). </details> <details> <summary>Can I just repost someone else's video?</summary> No. rea-video is for learning a video's structure, pacing and techniques, then remaking it with material you have the rights to. Don't reuse other people's footage, music, characters or likeness. Follow platform rules and local AI-content labeling requirements when you publish. </details> ## Docs - [docs/what-it-detects.md](docs/what-it-detects.md): everything it detects (10 visual types, camera, lighting, grade, audio) - [docs/replicate.md](docs/replicate.md): how to remake from the report - [docs/cases.md](docs/cases.md): details on each example - [docs/decompose.md](docs/decompose.md): detection rules - [docs/cli.md](docs/cli.md): CLI usage and capsule-cinema integration - [docs/videomd.md](docs/videomd.md): VIDEO.md, the standard breakdown package that agents and downstream tools read (open format: [videomd/videomd](https://github.com/videomd/videomd)) - [rea_video/capabilities/](rea_video/capabilities/README.md): capability tables for video / image / audio models, used to pick models for the remake plan - [eval/RESULTS.md](eval/RESULTS.md): eval results The docs are in Chinese for now. ## Community Questions, breakdowns and remake ideas: [GitHub Discussions](https://github.com/JuneYaooo/rea-video/discussions). Chat with us on [Discord](https://discord.gg/dZj8D3GqWT). Chinese speakers can also find us on [linux.do](https://linux.do/). Want a video broken down? Open a [request issue](https://github.com/JuneYaooo/rea-video/issues/new?template=request_breakdown.yml) with the link and we'll publish the result as a case. ## Credits Inspired by [REA (Reverse Engineer Anything)](https://github.com/morluto/rea): work back from what you see to how it was made, back every claim with evidence, and verify by measuring. Sound separation uses [UVR MDX-Net](https://github.com/TRvlvr/model_repo) for voice and music, and [BandIt v2](https://github.com/kwatcharasupat/bandit-v2) (Watcharasupat, Wu and Orife; weights CC BY-SA 4.0) for sound effects. Both models are downloaded on first use and are not part of this repo.

rea-video

unclassified

逆向拆解一条视频是怎么做出来的——逐镜头判断实拍 / AI 生成 / 3D 渲染 / 2D 动画 / 定格动画 / 代码模板渲染 / 录屏截图 / 静态图推拉 / 静帧，以及实拍是否经过 AI 加工（换脸、对口型、风格化），标出后期叠加层（逐句字幕时间轴、花字、标题、贴纸 / GIF / 表情包、画中画）和用户真实素材，拆解人声、背景音乐、音效（卡在哪个画面事件上）与剪辑节奏，并给出可执行的复刻方案（可对接 capsule-cinema）。当用户给出参考视频、问"这条视频怎么做的 / 是不是 AI /…

Source text: Chinese

2026-11-04

JuneYaooo/rea-video

Install with an AI assistant

Repository README

Skills in this repository

rea-video

Repository README