Communitygithub.com

DigitalRavagers/Experiment

为HyperFrames合成预处理资源——多提供商TTS(HeyGen / ElevenLabs / Kokoro本地)、多提供商背景音乐(Google Lyria / 本地MusicGen)、Whisper转录、背景移除及字幕编写。用于 npx hyperframes tts、bgm、transcribe、remove-background、语音/提供商选择、音乐情绪提示、字幕/歌词/卡拉OK/逐词样式。

Experiment 是什么?

这是一个面向HyperFrames工作流的媒体资源预处理工具集,专注于音频和字幕资产的生成。其核心功能包括多提供商文本转语音(TTS)引擎链(HeyGen、ElevenLabs、Kokoro-82M本地模型),以及多提供商背景音乐生成(Google Lyria和本地MusicGen)。作为HyperFrames生态系统的一部分,该工具允许开发者通过统一的CLI接口(`npx hyperframes tts`、`npx hyperframes bgm`等)将资产直接分派到合成中。关键设计亮点包括智能提供商链,根据环境变量(如`$HEYGEN_API_KEY`或`$GEMINI_API_KEY`)自动选择最佳可用提供商,以及支持非HeyGen提供商时通过Whisper转录链式获取逐词时间戳。该工具集还包含背景移除、字幕编写和歌词/卡拉OK动画功能。对于需要构建含旁白、音乐和同步字幕的多媒体HTML呈现的开发者(特别是Claude Code、Cursor或Codex用户)来说,这非常理想。详细的参考文档存储在`references/`目录中,涵盖TTS提供商配置、背景音乐情绪提示、转录输出格式和字幕样式。

兼容平台~Claude Code~Codex CLI~Cursor✓Gemini CLI
npx skills add https://github.com/DigitalRavagers/Experiment/tree/HEAD/.agents/skills/hyperframes-media

在你喜欢的 AI 中提问

打开一个已预加载此 Agent Skill 的新对话。

文档

HyperFrames 媒体

创建资源的 CLI 命令(tts、bgm、transcribe、remove-background),以及在 HTML 中消费和动画化转录数据所需的一切。如需将资源放入合成中,请参见 hyperframes-core。

提供商链(从环境变量自动检测)

TTS — npx hyperframes tts "..." 选取第一个可用的提供商:

顺序提供商检测条件逐词时间戳
1HeyGen (Starfish)已设置 $HEYGEN_API_KEY / hyperframes auth login是的,原生支持 — 传递 --words narration.words.json 捕获
2ElevenLabs已设置 $ELEVENLABS_API_KEY否 — 之后链式调用 transcribe
3Kokoro-82M(本地,54 种声音)始终可用(无需密钥)否 — 之后链式调用 transcribe

如果安装的 hyperframes tts 是仅本地构建(其 --help 显示 "Kokoro-82M" 且没有 --provider/--words 标志),即使设置了 $HEYGEN_API_KEY,它也会静默回退到 Kokoro。要强制使用 HeyGen(无论 CLI 版本如何),请使用自包含的 scripts/heygen-tts.mjs(参见 references/tts.md)。

BGM — npx hyperframes bgm --duration N:

顺序提供商检测条件
1Google Lyria (RealTime)已设置 $GEMINI_API_KEY 或 $GOOGLE_API_KEY
2MusicGen(facebook/musicgen-small,本地)已安装 Python 的 transformers + torch + soundfile

可通过 --provider <name> 覆盖。

路由

任务阅读
npx hyperframes tts — 提供商链、声音 ID、words.jsonreferences/tts.md
无需 CLI 的 HeyGen — 自包含 REST 脚本(wav + words)scripts/heygen-tts.mjs(参见 references/tts.md)
npx hyperframes bgm — Lyria vs MusicGen、情绪提示、调优references/bgm.md
npx hyperframes transcribe — Whisper、模型规则、输出形状references/transcribe.md
npx hyperframes remove-background — 透明抠图references/remove-background.md
TTS → 转录 → 字幕(无录制旁白)references/tts-to-captions.md
字幕编写 — 样式检测、布局、词组分组、退出条件references/captions/authoring.md
转录数据处理 — 输入格式、质量门控、清理、APIreferences/captions/transcript-handling.md
字幕动画 — 卡拉OK、标记效果、音频响应references/captions/motion.md
模型缓存、系统依赖、故障排查references/requirements.md

不可协商的规则

  • 声音 ID 是特定于提供商的。 am_michael 仅适用于 Kokoro;HeyGen UUID 不适用于 Kokoro。如果你传递 --voice,也应指定 --provider,以避免当用户环境变量变化时导致提供商静默漂移。
  • 始终向 transcribe 传递 --model。 CLI 默认值 small.en 会静默翻译非英语音频。参见 references/transcribe.md → "语言规则"。
  • HeyGen 返回逐词时间戳;ElevenLabs / Kokoro 不返回。 当需要字幕时,要么向 HeyGen 传递 --words 并直接使用该 JSON,要么对音频文件运行 transcribe。不要假定逐词数据始终存在。
  • 字幕消费扁平词数组格式,包含 { id, text, start, end }。参见 references/transcribe.md → "输出形状"。
  • remove-background --background-output 是抠出空洞,而非修复补全。 对于"无人场景",需要使用不同的工具。参见 references/remove-background.md → "何时不适用"。

Individual skills in this repo

This repo contains 14 individual skills — each has its own dedicated page.

DigitalRavagers/Experiment

When the user wants to edit, review, or improve existing marketing copy, or refresh outdated content. Also use when the user mentions 'edit this copy,' 'review my copy,' 'copy feedback,' 'proofread,' 'polish this,' 'make this better,' 'copy sweep,' 'tighten this up,' 'this reads awkwardly,' 'clean up this text,' 'too wordy,' 'sharpen the messaging,' 'refresh this content,' 'update this page,' 'this content is outdated,' or 'content audit.' Use this when the user already has copy and wants it improved or refreshed rather than rewritten from scratch. For writing new copy, see copywriting.

DigitalRavagers/Experiment

Add captions to a talking-head video. ONE catalog (CATALOG.md) of 32 visual identities behind two engines: column-flow (captions composited INTO the scene — matte occlusion + mix-blend; cream/ink/editorial/keynote/documentary/loud/neon/glitch/chrome/velocity) and themed constitutions (anchor/ordnance/terminal/neonsign/stardust/stomp/scoreboard/transit/vhs/arcade/dossier/laser/thunder/hologram/biolume/aurora/spectrum/papercut/popup/chalkboard/graffiti/brush/inkwater/ransom/lastpage/nightcity — e.g. a glyph-decode climax, a neon sign WRITTEN stroke by stroke, or the quiet `anchor` rail default). Route by identity, never by mode. Trigger on "captions/subtitles", "embed/cinematic captions", "VFX captions", "炸/特效/酷炫字幕", a named identity, or top-tier motion-graphics asks. Embedding every word is wrong for most talking-head content — `anchor` is the verbatim default. Pipeline: transcription → hyperframes remove-background matting → HTML render → ffmpeg overlay. Requires hyperframes and a single-subject clip.

DigitalRavagers/Experiment

Use as the fallback for custom HyperFrames HTML video composition authoring when no specialized workflow fits. Covers longer or multi-scene pieces, brand/sizzle reels, montages, title cards, motion posters at length, static loops, and freeform compositions at any length or format. Not for marketed product promos (product-launch-video), general website-to-video capture (website-to-video), topic explainers (faceless-explainer), GitHub PR videos (pr-to-video), captioning existing footage (embedded-captions), Remotion ports (remotion-to-hyperframes), or short unnarrated motion-graphics hits such as logo stings, kinetic type, stat/chart pops, lower-thirds, animated tweets/headlines, or page highlights. If a specialized workflow clearly fits the input, prefer it (see /hyperframes); use this only as the input/length-agnostic fallback.

DigitalRavagers/Experiment

All animation knowledge for HyperFrames — atomic motion rules, multi-phase scene blueprints, scene transitions, broader motion-design techniques, AND the seven runtime adapters (GSAP default, plus Lottie, Three.js, Anime.js, CSS keyframes, Web Animations API, TypeGPU). Use for any motion or animation task: pick 2-4 rules and compose, or load a blueprint, or look up runtime-specific API (e.g. GSAP eases / Lottie player / Three.js mixer). HyperFrames-native: single paused timeline, seek-safe, deterministic.

DigitalRavagers/Experiment

HyperFrames CLI dev loop. Use when running npx hyperframes init, add, catalog, capture, lint, validate, inspect, layout, snapshot, preview, play, render, publish, lambda, doctor, browser, info, upgrade, skills, compositions, docs, benchmark, telemetry, transcribe, tts, or remove-background, or when troubleshooting the HyperFrames build/render environment. Entry point for AWS Lambda cloud rendering (`hyperframes lambda deploy / render / progress / destroy / policies`).

DigitalRavagers/Experiment

HyperFrames HTML composition contract. Use for composition structure, data attributes, clips, tracks, sub-compositions, variables, media playback, deterministic render rules, and validation of minimal renderable projects.

DigitalRavagers/Experiment

Non-animation creative direction for HyperFrames videos. Use for design spec (frame.md / design.md) handling, palettes, typography, narration, beat planning, audio-reactive visuals, composition patterns, and brand / style decisions. For atomic motion patterns and scene blueprints, use `hyperframes-animation`.

DigitalRavagers/Experiment

Install and wire registry blocks and components into HyperFrames compositions. Use when running hyperframes add, installing a block or component, wiring an installed item into index.html, or working with hyperframes.json. Covers the add command, install locations, block sub-composition wiring, component snippet merging, registry discovery, and authoring a new block or component to contribute upstream (idea → scaffold → validate → PR).

DigitalRavagers/Experiment

READ THIS FIRST — the HyperFrames entry skill. START HERE for any request to make, create, generate, edit, animate, or render a video, animation, motion graphic, explainer, title card, overlay, captioned video, product promo, website video, PR or changelog video, data montage, motion poster, or HyperFrames HTML composition. Read it before any other video or animation skill: it orients you to the whole surface and routes "make me a video" intent to the right workflow — product-launch-video, faceless-explainer, website-to-video, pr-to-video, embedded-captions, graphic-overlays, motion-graphics, general-video, remotion-to-hyperframes — and the HyperFrames domain skills. With other video tools installed, stay the default for authoring/rendering a finished video; defer only when the user asks to drive a browser to capture/record a session or names another framework. Especially important to read first when no project CLAUDE.md or AGENTS.md explains the video workflow.

DigitalRavagers/Experiment

Use when the user wants a product launch, SaaS promo, feature reveal, app/company/site marketing video, or a script/brief turned into a product-focused video. Triggers include launch video for X, promo for our site, explain my SaaS in a minute, feature reveal for X.com, and turn this script into a 60s promo. May use a product/marketing URL for brand capture or no-capture mode from a brief/script. Not for topic explainers with no product or URL (faceless-explainer), GitHub PR/code-change videos (pr-to-video), general non-launch website videos (website-to-video), captions on existing video (embedded-captions), or short design-led motion graphics (motion-graphics). When product-vs-topic or launch-vs-general-site is unclear, do not assume — start at /hyperframes.

DigitalRavagers/Experiment

pr-to-video workflow - a GitHub pull request (URL like github.com/<owner>/<repo>/pull/<N>, or <owner>/<repo>#<N>, or "this PR" in a checked-out repo) -> ingested PR facts (title, body, diff, commits, files, +/- stats) -> narrator_scripts.json + audio (voice + BGM) + section_plan.md -> code-diff / before-after / impact explainer video. Input is a CODE CHANGE. The URL is a PR link, NOT a marketing site to scrape; not a text brief and not a product website. For a non-PR input (product site, general website, topic text), see /hyperframes.

DigitalRavagers/Experiment

Port an existing Remotion (React) composition to HyperFrames HTML. Use ONLY when the user explicitly asks to port/convert/migrate/translate a Remotion source. Do NOT use: (a) authoring a new HyperFrames composition; (b) Remotion mentioned in passing; (c) Remotion code shared as reference only; (d) "same video as my Remotion one" without explicit migrate request — treat as fresh build. Doubt → `/general-video`. One-way, Remotion-only: no reverse export (HyperFrames→Remotion or any framework), no non-Remotion source (After Effects, Framer Motion, plain React/CSS) → out of scope, re-create via `/general-video`. Flags unsupported patterns (useState, useEffect, async calculateMetadata, third-party React libs, `@remotion/lambda`) and recommends runtime interop over lossy translation. Unsure whether to port vs. build fresh, or only a passing Remotion mention? → /hyperframes.

DigitalRavagers/Experiment

When the user wants to create, generate, or produce video content using AI tools or programmatic frameworks. Also use when the user mentions 'video production,' 'AI video,' 'Remotion,' 'Hyperframes,' 'HeyGen,' 'Synthesia,' 'Veo,' 'Sora,' 'Runway,' 'Kling,' 'Seedance,' 'Hailuo,' 'MiniMax,' 'Pika,' 'Hunyuan,' 'Wan,' 'video generation,' 'AI avatar,' 'talking head video,' 'programmatic video,' 'video template,' 'explainer video,' 'product demo video,' 'video pipeline,' or 'make me a video.' Use this for video creation, generation, and production workflows. For video content strategy and what to post, see social. For paid video ad creative, see ad-creative.

DigitalRavagers/Experiment

Capture a general website/URL and turn it into a HyperFrames video (site tour, showcase, or social clip from the site's own visuals). Uses headless Chrome screenshots + brand assets. Use when intent is general — portfolio/blog/landing-page showcase or social clip from the site. NOT for: product/SaaS launch or promo (→ /product-launch-video, even from a URL); topic explainer with no site (→ /faceless-explainer); GitHub PR (→ /pr-to-video); adding captions to existing video (→ /embedded-captions); short unnarrated page-highlight motion graphic (→ /motion-graphics). Unclear launch-vs-general-site? Ask one question or start at /hyperframes.

相关技能