Communitygithub.com

DigitalRavagers/Experiment

為 HyperFrames 編排進行資源預處理 — 支援多供應商 TTS(HeyGen / ElevenLabs / 本地 Kokoro)、多供應商 BGM(Google Lyria / 本地 MusicGen)、Whisper 語音轉文字、去背及字幕撰寫。可用於 npx hyperframes tts、bgm、transcribe、remove-background、語音/供應商選擇、音樂情緒提示、字幕/副標題/歌詞/卡拉 OK/逐字樣式。

Experiment 是什麼?

此技能為 HyperFrames 媒體編排提供全面的資源預處理功能。它包含一組 CLI 指令:`tts`(文字轉語音)、`bgm`(背景音樂生成)、`transcribe`(Whisper 語音轉文字)及 `remove-background`(去背)。TTS 功能會自動偵測環境變數,依序嘗試 HeyGen(支援逐字時間戳)、ElevenLabs 或本地 Kokoro-82M 模型;BGM 則可選用 Google Lyria 或本地 MusicGen。技能也涵蓋從語音生成到字幕製作的完整流程,包括逐字樣式、卡拉 OK 效果及歌詞動畫。其核心理念是「非可妥協規則」,例如語音 ID 必須對應特定供應商、Always 指定 `--model` 以避免 Whisper 非英語音訊被靜默翻譯、以及字幕資料必須使用統一的 `{ id, text, start, end }` 格式。此技能支援 Claude Code、Cursor 等開發工具,適合需要快速將多媒體資源整合進 HyperFrames 編排的開發者。

相容平台~Claude Code~Codex CLI~Cursor✓Gemini CLI
npx skills add https://github.com/DigitalRavagers/Experiment/tree/HEAD/.agents/skills/hyperframes-media

在你喜歡的 AI 中提問

開啟一個已預先載入此 Agent Skill 的新對話。

說明文件

HyperFrames 媒體

用於建立資源的 CLI 指令(tts、bgm、transcribe、remove-background),以及消費和動畫化 HTML 中轉錄資料所需的一切。若要將資源放入編排中,請參閱 hyperframes-core。

供應商鏈(從環境變數自動偵測)

TTS — npx hyperframes tts "..." 會選取第一個可用的供應商:

順序供應商偵測時機逐字時間戳
1HeyGen (Starfish)設定 $HEYGEN_API_KEY / hyperframes auth login有,原生支援 — 傳遞 --words narration.words.json 以擷取
2ElevenLabs設定 $ELEVENLABS_API_KEY無 — 之後串接 transcribe
3Kokoro-82M(本地,54 種語音)永遠可用(無需金鑰)無 — 之後串接 transcribe

如果安裝的 hyperframes tts 是僅限本地建置版本(其 --help 顯示「Kokoro-82M」且沒有 --provider/--words 旗標),則即使設定了 $HEYGEN_API_KEY,它也會靜默地回退到 Kokoro。若無論 CLI 版本如何都要強制使用 HeyGen,請使用獨立腳本 scripts/heygen-tts.mjs(請參閱 references/tts.md)。

BGM — npx hyperframes bgm --duration N:

順序供應商偵測時機
1Google Lyria (RealTime)設定 $GEMINI_API_KEY 或 $GOOGLE_API_KEY
2MusicGen(facebook/musicgen-small,本地)已安裝 Python: transformers + torch + soundfile

可使用 --provider <名稱> 覆蓋兩者。

路由

任務閱讀
npx hyperframes tts — 供應商鏈、語音 ID、words.jsonreferences/tts.md
不使用 CLI 的 HeyGen — 獨立 REST 腳本(wav + words)scripts/heygen-tts.mjs(參閱 references/tts.md)
npx hyperframes bgm — Lyria 與 MusicGen、情緒提示、調校references/bgm.md
npx hyperframes transcribe — Whisper、模型規則、輸出結構references/transcribe.md
npx hyperframes remove-background — 透明裁切references/remove-background.md
TTS → 轉錄 → 字幕(無錄製配音)references/tts-to-captions.md
字幕撰寫 — 樣式偵測、版面配置、詞彙分組、結束references/captions/authoring.md
轉錄處理 — 輸入格式、品質閘、清理、APIreferences/captions/transcript-handling.md
字幕動畫 — 卡拉 OK、標記效果、音訊反應式references/captions/motion.md
模型快取、系統依賴、疑難排解references/requirements.md

非可妥協規則

  • 語音 ID 是供應商特定的。 am_michael 只適用於 Kokoro;HeyGen 的 UUID 在 Kokoro 上無效。若傳遞 --voice,也請固定 --provider,以避免使用者環境變更時發生靜默的供應商漂移。
  • transcribe 務必傳遞 --model。 CLI 預設的 small.en 會靜默地翻譯非英語音訊。請參閱 references/transcribe.md → 「語言規則」。
  • HeyGen 返回逐字時間戳;ElevenLabs / Kokoro 則否。 當你需要字幕時,請對 HeyGen 傳遞 --words 並直接使用該 JSON,或對音訊檔案執行 transcribe。切勿假設逐字資料永遠存在。
  • 字幕使用扁平的字詞陣列格式,包含 { id, text, start, end }。請參閱 references/transcribe.md → 「輸出結構」。
  • remove-background --background-output 是挖洞,非修補。 若需要「不含人物場景」,則需使用其他工具。請參閱 references/remove-background.md → 「何時不該使用此工具」。

Individual skills in this repo

This repo contains 14 individual skills — each has its own dedicated page.

DigitalRavagers/Experiment

When the user wants to edit, review, or improve existing marketing copy, or refresh outdated content. Also use when the user mentions 'edit this copy,' 'review my copy,' 'copy feedback,' 'proofread,' 'polish this,' 'make this better,' 'copy sweep,' 'tighten this up,' 'this reads awkwardly,' 'clean up this text,' 'too wordy,' 'sharpen the messaging,' 'refresh this content,' 'update this page,' 'this content is outdated,' or 'content audit.' Use this when the user already has copy and wants it improved or refreshed rather than rewritten from scratch. For writing new copy, see copywriting.

DigitalRavagers/Experiment

Add captions to a talking-head video. ONE catalog (CATALOG.md) of 32 visual identities behind two engines: column-flow (captions composited INTO the scene — matte occlusion + mix-blend; cream/ink/editorial/keynote/documentary/loud/neon/glitch/chrome/velocity) and themed constitutions (anchor/ordnance/terminal/neonsign/stardust/stomp/scoreboard/transit/vhs/arcade/dossier/laser/thunder/hologram/biolume/aurora/spectrum/papercut/popup/chalkboard/graffiti/brush/inkwater/ransom/lastpage/nightcity — e.g. a glyph-decode climax, a neon sign WRITTEN stroke by stroke, or the quiet `anchor` rail default). Route by identity, never by mode. Trigger on "captions/subtitles", "embed/cinematic captions", "VFX captions", "炸/特效/酷炫字幕", a named identity, or top-tier motion-graphics asks. Embedding every word is wrong for most talking-head content — `anchor` is the verbatim default. Pipeline: transcription → hyperframes remove-background matting → HTML render → ffmpeg overlay. Requires hyperframes and a single-subject clip.

DigitalRavagers/Experiment

Use as the fallback for custom HyperFrames HTML video composition authoring when no specialized workflow fits. Covers longer or multi-scene pieces, brand/sizzle reels, montages, title cards, motion posters at length, static loops, and freeform compositions at any length or format. Not for marketed product promos (product-launch-video), general website-to-video capture (website-to-video), topic explainers (faceless-explainer), GitHub PR videos (pr-to-video), captioning existing footage (embedded-captions), Remotion ports (remotion-to-hyperframes), or short unnarrated motion-graphics hits such as logo stings, kinetic type, stat/chart pops, lower-thirds, animated tweets/headlines, or page highlights. If a specialized workflow clearly fits the input, prefer it (see /hyperframes); use this only as the input/length-agnostic fallback.

DigitalRavagers/Experiment

All animation knowledge for HyperFrames — atomic motion rules, multi-phase scene blueprints, scene transitions, broader motion-design techniques, AND the seven runtime adapters (GSAP default, plus Lottie, Three.js, Anime.js, CSS keyframes, Web Animations API, TypeGPU). Use for any motion or animation task: pick 2-4 rules and compose, or load a blueprint, or look up runtime-specific API (e.g. GSAP eases / Lottie player / Three.js mixer). HyperFrames-native: single paused timeline, seek-safe, deterministic.

DigitalRavagers/Experiment

HyperFrames CLI dev loop. Use when running npx hyperframes init, add, catalog, capture, lint, validate, inspect, layout, snapshot, preview, play, render, publish, lambda, doctor, browser, info, upgrade, skills, compositions, docs, benchmark, telemetry, transcribe, tts, or remove-background, or when troubleshooting the HyperFrames build/render environment. Entry point for AWS Lambda cloud rendering (`hyperframes lambda deploy / render / progress / destroy / policies`).

DigitalRavagers/Experiment

HyperFrames HTML composition contract. Use for composition structure, data attributes, clips, tracks, sub-compositions, variables, media playback, deterministic render rules, and validation of minimal renderable projects.

DigitalRavagers/Experiment

Non-animation creative direction for HyperFrames videos. Use for design spec (frame.md / design.md) handling, palettes, typography, narration, beat planning, audio-reactive visuals, composition patterns, and brand / style decisions. For atomic motion patterns and scene blueprints, use `hyperframes-animation`.

DigitalRavagers/Experiment

Install and wire registry blocks and components into HyperFrames compositions. Use when running hyperframes add, installing a block or component, wiring an installed item into index.html, or working with hyperframes.json. Covers the add command, install locations, block sub-composition wiring, component snippet merging, registry discovery, and authoring a new block or component to contribute upstream (idea → scaffold → validate → PR).

DigitalRavagers/Experiment

READ THIS FIRST — the HyperFrames entry skill. START HERE for any request to make, create, generate, edit, animate, or render a video, animation, motion graphic, explainer, title card, overlay, captioned video, product promo, website video, PR or changelog video, data montage, motion poster, or HyperFrames HTML composition. Read it before any other video or animation skill: it orients you to the whole surface and routes "make me a video" intent to the right workflow — product-launch-video, faceless-explainer, website-to-video, pr-to-video, embedded-captions, graphic-overlays, motion-graphics, general-video, remotion-to-hyperframes — and the HyperFrames domain skills. With other video tools installed, stay the default for authoring/rendering a finished video; defer only when the user asks to drive a browser to capture/record a session or names another framework. Especially important to read first when no project CLAUDE.md or AGENTS.md explains the video workflow.

DigitalRavagers/Experiment

Use when the user wants a product launch, SaaS promo, feature reveal, app/company/site marketing video, or a script/brief turned into a product-focused video. Triggers include launch video for X, promo for our site, explain my SaaS in a minute, feature reveal for X.com, and turn this script into a 60s promo. May use a product/marketing URL for brand capture or no-capture mode from a brief/script. Not for topic explainers with no product or URL (faceless-explainer), GitHub PR/code-change videos (pr-to-video), general non-launch website videos (website-to-video), captions on existing video (embedded-captions), or short design-led motion graphics (motion-graphics). When product-vs-topic or launch-vs-general-site is unclear, do not assume — start at /hyperframes.

DigitalRavagers/Experiment

pr-to-video workflow - a GitHub pull request (URL like github.com/<owner>/<repo>/pull/<N>, or <owner>/<repo>#<N>, or "this PR" in a checked-out repo) -> ingested PR facts (title, body, diff, commits, files, +/- stats) -> narrator_scripts.json + audio (voice + BGM) + section_plan.md -> code-diff / before-after / impact explainer video. Input is a CODE CHANGE. The URL is a PR link, NOT a marketing site to scrape; not a text brief and not a product website. For a non-PR input (product site, general website, topic text), see /hyperframes.

DigitalRavagers/Experiment

Port an existing Remotion (React) composition to HyperFrames HTML. Use ONLY when the user explicitly asks to port/convert/migrate/translate a Remotion source. Do NOT use: (a) authoring a new HyperFrames composition; (b) Remotion mentioned in passing; (c) Remotion code shared as reference only; (d) "same video as my Remotion one" without explicit migrate request — treat as fresh build. Doubt → `/general-video`. One-way, Remotion-only: no reverse export (HyperFrames→Remotion or any framework), no non-Remotion source (After Effects, Framer Motion, plain React/CSS) → out of scope, re-create via `/general-video`. Flags unsupported patterns (useState, useEffect, async calculateMetadata, third-party React libs, `@remotion/lambda`) and recommends runtime interop over lossy translation. Unsure whether to port vs. build fresh, or only a passing Remotion mention? → /hyperframes.

DigitalRavagers/Experiment

When the user wants to create, generate, or produce video content using AI tools or programmatic frameworks. Also use when the user mentions 'video production,' 'AI video,' 'Remotion,' 'Hyperframes,' 'HeyGen,' 'Synthesia,' 'Veo,' 'Sora,' 'Runway,' 'Kling,' 'Seedance,' 'Hailuo,' 'MiniMax,' 'Pika,' 'Hunyuan,' 'Wan,' 'video generation,' 'AI avatar,' 'talking head video,' 'programmatic video,' 'video template,' 'explainer video,' 'product demo video,' 'video pipeline,' or 'make me a video.' Use this for video creation, generation, and production workflows. For video content strategy and what to post, see social. For paid video ad creative, see ad-creative.

DigitalRavagers/Experiment

Capture a general website/URL and turn it into a HyperFrames video (site tour, showcase, or social clip from the site's own visuals). Uses headless Chrome screenshots + brand assets. Use when intent is general — portfolio/blog/landing-page showcase or social clip from the site. NOT for: product/SaaS launch or promo (→ /product-launch-video, even from a URL); topic explainer with no site (→ /faceless-explainer); GitHub PR (→ /pr-to-video); adding captions to existing video (→ /embedded-captions); short unnarrated page-highlight motion graphic (→ /motion-graphics). Unclear launch-vs-general-site? Ask one question or start at /hyperframes.

相關技能