Communitygithub.com

DigitalRavagers/Experiment

HyperFramesコンポジション向けアセット前処理 — マルチプロバイダTTS(HeyGen / ElevenLabs / Kokoroローカル)、マルチプロバイダBGM(Google Lyria / ローカルMusicGen)、Whisper文字起こし、背景除去、キャプション作成を提供します。`npx hyperframes tts`、`bgm`、`transcribe`、`remove-background`、音声/プロバイダ選択、音楽ムードプロンプト、キャプション/字幕/歌詞/カラオケ/単語ごとのスタイリングに使用します。

Experiment とは?

このスキルは、HyperFramesコンポジション用のメディアアセットをCLIで生成・処理するためのツール群です。主にTTS(テキスト読み上げ)、BGM(背景音楽)、文字起こし、背景除去の4つのコマンドを提供し、それぞれ複数のプロバイダを自動選択(環境変数ベース)または明示指定できます。TTSではHeyGen(単語タイムスタンプ付き)、ElevenLabs、ローカルKokoro-82Mをサポートし、BGMではGoogle LyriaまたはローカルMusicGenから音楽を生成します。文字起こしはWhisperモデルを使用し、キャプション作成機能(カラオケスタイル、単語ごとのスタイリング、字幕、歌詞)のためのトランスクリプトデータも扱います。CLIツールとして汎用的に設計されており、`npx hyperframes` コマンドで呼び出せ、主要なクラウドプロバイダ(HeyGen、ElevenLabs、Google)とローカルモデル(Kokoro、MusicGen)をシームレスに切り替えられます。プロバイダ依存のルール(音声IDの固定、モデル指定の強制、単語タイムスタンプの有無)を非妥協ルールとして明示しており、開発者は環境に応じた正しいプロバイダ選択と引数指定を確実に行えます。

対応~Claude Code~Codex CLI~Cursor✓Gemini CLI
npx skills add https://github.com/DigitalRavagers/Experiment/tree/HEAD/.agents/skills/hyperframes-media

お気に入りのAIに質問する

このエージェントスキルを事前に読み込んだ状態で新しいチャットを開きます。

ドキュメント

HyperFrames Media

アセットを作成するCLIコマンド(tts、bgm、transcribe、remove-background)と、トランスクリプトデータをHTMLで消費・アニメーション化するために必要なすべての機能を提供します。コンポジションにアセットを配置するには、hyperframes-coreを参照してください。

プロバイダチェーン(環境変数から自動検出)

TTS — npx hyperframes tts "..." は利用可能な最初のプロバイダを選択します:

順位プロバイダ検出条件単語タイムスタンプ
1HeyGen(Starfish)$HEYGEN_API_KEY / hyperframes auth loginはい、ネイティブ — --words narration.words.json で取得
2ElevenLabs$ELEVENLABS_API_KEY が設定されているいいえ — 後で transcribe をチェーン
3Kokoro-82M(ローカル、54音声)常に(キー不要)いいえ — 後で transcribe をチェーン

インストールされている hyperframes tts がローカルのみのビルド(--help に「Kokoro-82M」と表示され、--provider/--words フラグがない)の場合、$HEYGEN_API_KEY が設定されていても、静かにKokoroにフォールバックします。CLIバージョンに関係なくHeyGenを強制するには、自己完結型の scripts/heygen-tts.mjs を使用してください(references/tts.md 参照)。

BGM — npx hyperframes bgm --duration N:

順位プロバイダ検出条件
1Google Lyria(RealTime)$GEMINI_API_KEY または $GOOGLE_API_KEY が設定
2MusicGen(facebook/musicgen-small、ローカル)Python transformers + torch + soundfile がインストール済み

どちらも --provider <name> で上書き可能です。

ルーティング

タスク参照先
npx hyperframes tts — プロバイダチェーン、音声ID、words.jsonreferences/tts.md
CLIなしのHeyGen — 自己完結型RESTスクリプト(wav + words)scripts/heygen-tts.mjs(references/tts.md参照)
npx hyperframes bgm — Lyria vs MusicGen、ムードプロンプト、チューニングreferences/bgm.md
npx hyperframes transcribe — Whisper、モデルルール、出力形状references/transcribe.md
npx hyperframes remove-background — 透明切り抜きreferences/remove-background.md
TTS → 文字起こし → キャプション(録音されたナレーションなし)references/tts-to-captions.md
キャプション作成 — スタイル検出、レイアウト、単語グループ化、終了references/captions/authoring.md
トランスクリプト処理 — 入力形式、品質ゲート、クリーンアップ、APIreferences/captions/transcript-handling.md
キャプションモーション — カラオケ、マーカーエフェクト、音声反応references/captions/motion.md
モデルキャッシュ、システム依存関係、トラブルシューティングreferences/requirements.md

非妥協ルール

  • 音声IDはプロバイダ固有です。 am_michael はKokoro専用。HeyGenのUUIDはKokoroでは動作しません。--voice を渡す場合は、ユーザーの環境が変わったときの静かなプロバイダ変動を避けるために、必ず --provider も指定してください。
  • transcribe には必ず --model を渡してください。 CLIのデフォルト small.en は非英語音声を静かに翻訳します。references/transcribe.md → 「言語ルール」を参照。
  • HeyGenは単語タイムスタンプを返しますが、ElevenLabs / Kokoroは返しません。 キャプションが必要な場合は、HeyGenに --words を渡してそのJSONを直接使うか、オーディオファイルに対して transcribe を実行してください。単語データが常にあるとは想定しないでください。
  • キャプションは { id, text, start, end } 形式のフラットな単語配列を使用します。 references/transcribe.md → 「出力形状」を参照。
  • remove-background --background-output は穴を開ける処理であり、インペインティングではありません。 「人物のいないシーン」が必要な場合は、別のツールが必要です。references/remove-background.md → 「適切なツールではない場合」を参照。

Individual skills in this repo

This repo contains 14 individual skills — each has its own dedicated page.

DigitalRavagers/Experiment

When the user wants to edit, review, or improve existing marketing copy, or refresh outdated content. Also use when the user mentions 'edit this copy,' 'review my copy,' 'copy feedback,' 'proofread,' 'polish this,' 'make this better,' 'copy sweep,' 'tighten this up,' 'this reads awkwardly,' 'clean up this text,' 'too wordy,' 'sharpen the messaging,' 'refresh this content,' 'update this page,' 'this content is outdated,' or 'content audit.' Use this when the user already has copy and wants it improved or refreshed rather than rewritten from scratch. For writing new copy, see copywriting.

DigitalRavagers/Experiment

Add captions to a talking-head video. ONE catalog (CATALOG.md) of 32 visual identities behind two engines: column-flow (captions composited INTO the scene — matte occlusion + mix-blend; cream/ink/editorial/keynote/documentary/loud/neon/glitch/chrome/velocity) and themed constitutions (anchor/ordnance/terminal/neonsign/stardust/stomp/scoreboard/transit/vhs/arcade/dossier/laser/thunder/hologram/biolume/aurora/spectrum/papercut/popup/chalkboard/graffiti/brush/inkwater/ransom/lastpage/nightcity — e.g. a glyph-decode climax, a neon sign WRITTEN stroke by stroke, or the quiet `anchor` rail default). Route by identity, never by mode. Trigger on "captions/subtitles", "embed/cinematic captions", "VFX captions", "炸/特效/酷炫字幕", a named identity, or top-tier motion-graphics asks. Embedding every word is wrong for most talking-head content — `anchor` is the verbatim default. Pipeline: transcription → hyperframes remove-background matting → HTML render → ffmpeg overlay. Requires hyperframes and a single-subject clip.

DigitalRavagers/Experiment

Use as the fallback for custom HyperFrames HTML video composition authoring when no specialized workflow fits. Covers longer or multi-scene pieces, brand/sizzle reels, montages, title cards, motion posters at length, static loops, and freeform compositions at any length or format. Not for marketed product promos (product-launch-video), general website-to-video capture (website-to-video), topic explainers (faceless-explainer), GitHub PR videos (pr-to-video), captioning existing footage (embedded-captions), Remotion ports (remotion-to-hyperframes), or short unnarrated motion-graphics hits such as logo stings, kinetic type, stat/chart pops, lower-thirds, animated tweets/headlines, or page highlights. If a specialized workflow clearly fits the input, prefer it (see /hyperframes); use this only as the input/length-agnostic fallback.

DigitalRavagers/Experiment

All animation knowledge for HyperFrames — atomic motion rules, multi-phase scene blueprints, scene transitions, broader motion-design techniques, AND the seven runtime adapters (GSAP default, plus Lottie, Three.js, Anime.js, CSS keyframes, Web Animations API, TypeGPU). Use for any motion or animation task: pick 2-4 rules and compose, or load a blueprint, or look up runtime-specific API (e.g. GSAP eases / Lottie player / Three.js mixer). HyperFrames-native: single paused timeline, seek-safe, deterministic.

DigitalRavagers/Experiment

HyperFrames CLI dev loop. Use when running npx hyperframes init, add, catalog, capture, lint, validate, inspect, layout, snapshot, preview, play, render, publish, lambda, doctor, browser, info, upgrade, skills, compositions, docs, benchmark, telemetry, transcribe, tts, or remove-background, or when troubleshooting the HyperFrames build/render environment. Entry point for AWS Lambda cloud rendering (`hyperframes lambda deploy / render / progress / destroy / policies`).

DigitalRavagers/Experiment

HyperFrames HTML composition contract. Use for composition structure, data attributes, clips, tracks, sub-compositions, variables, media playback, deterministic render rules, and validation of minimal renderable projects.

DigitalRavagers/Experiment

Non-animation creative direction for HyperFrames videos. Use for design spec (frame.md / design.md) handling, palettes, typography, narration, beat planning, audio-reactive visuals, composition patterns, and brand / style decisions. For atomic motion patterns and scene blueprints, use `hyperframes-animation`.

DigitalRavagers/Experiment

Install and wire registry blocks and components into HyperFrames compositions. Use when running hyperframes add, installing a block or component, wiring an installed item into index.html, or working with hyperframes.json. Covers the add command, install locations, block sub-composition wiring, component snippet merging, registry discovery, and authoring a new block or component to contribute upstream (idea → scaffold → validate → PR).

DigitalRavagers/Experiment

READ THIS FIRST — the HyperFrames entry skill. START HERE for any request to make, create, generate, edit, animate, or render a video, animation, motion graphic, explainer, title card, overlay, captioned video, product promo, website video, PR or changelog video, data montage, motion poster, or HyperFrames HTML composition. Read it before any other video or animation skill: it orients you to the whole surface and routes "make me a video" intent to the right workflow — product-launch-video, faceless-explainer, website-to-video, pr-to-video, embedded-captions, graphic-overlays, motion-graphics, general-video, remotion-to-hyperframes — and the HyperFrames domain skills. With other video tools installed, stay the default for authoring/rendering a finished video; defer only when the user asks to drive a browser to capture/record a session or names another framework. Especially important to read first when no project CLAUDE.md or AGENTS.md explains the video workflow.

DigitalRavagers/Experiment

Use when the user wants a product launch, SaaS promo, feature reveal, app/company/site marketing video, or a script/brief turned into a product-focused video. Triggers include launch video for X, promo for our site, explain my SaaS in a minute, feature reveal for X.com, and turn this script into a 60s promo. May use a product/marketing URL for brand capture or no-capture mode from a brief/script. Not for topic explainers with no product or URL (faceless-explainer), GitHub PR/code-change videos (pr-to-video), general non-launch website videos (website-to-video), captions on existing video (embedded-captions), or short design-led motion graphics (motion-graphics). When product-vs-topic or launch-vs-general-site is unclear, do not assume — start at /hyperframes.

DigitalRavagers/Experiment

pr-to-video workflow - a GitHub pull request (URL like github.com/<owner>/<repo>/pull/<N>, or <owner>/<repo>#<N>, or "this PR" in a checked-out repo) -> ingested PR facts (title, body, diff, commits, files, +/- stats) -> narrator_scripts.json + audio (voice + BGM) + section_plan.md -> code-diff / before-after / impact explainer video. Input is a CODE CHANGE. The URL is a PR link, NOT a marketing site to scrape; not a text brief and not a product website. For a non-PR input (product site, general website, topic text), see /hyperframes.

DigitalRavagers/Experiment

Port an existing Remotion (React) composition to HyperFrames HTML. Use ONLY when the user explicitly asks to port/convert/migrate/translate a Remotion source. Do NOT use: (a) authoring a new HyperFrames composition; (b) Remotion mentioned in passing; (c) Remotion code shared as reference only; (d) "same video as my Remotion one" without explicit migrate request — treat as fresh build. Doubt → `/general-video`. One-way, Remotion-only: no reverse export (HyperFrames→Remotion or any framework), no non-Remotion source (After Effects, Framer Motion, plain React/CSS) → out of scope, re-create via `/general-video`. Flags unsupported patterns (useState, useEffect, async calculateMetadata, third-party React libs, `@remotion/lambda`) and recommends runtime interop over lossy translation. Unsure whether to port vs. build fresh, or only a passing Remotion mention? → /hyperframes.

DigitalRavagers/Experiment

When the user wants to create, generate, or produce video content using AI tools or programmatic frameworks. Also use when the user mentions 'video production,' 'AI video,' 'Remotion,' 'Hyperframes,' 'HeyGen,' 'Synthesia,' 'Veo,' 'Sora,' 'Runway,' 'Kling,' 'Seedance,' 'Hailuo,' 'MiniMax,' 'Pika,' 'Hunyuan,' 'Wan,' 'video generation,' 'AI avatar,' 'talking head video,' 'programmatic video,' 'video template,' 'explainer video,' 'product demo video,' 'video pipeline,' or 'make me a video.' Use this for video creation, generation, and production workflows. For video content strategy and what to post, see social. For paid video ad creative, see ad-creative.

DigitalRavagers/Experiment

Capture a general website/URL and turn it into a HyperFrames video (site tour, showcase, or social clip from the site's own visuals). Uses headless Chrome screenshots + brand assets. Use when intent is general — portfolio/blog/landing-page showcase or social clip from the site. NOT for: product/SaaS launch or promo (→ /product-launch-video, even from a URL); topic explainer with no site (→ /faceless-explainer); GitHub PR (→ /pr-to-video); adding captions to existing video (→ /embedded-captions); short unnarrated page-highlight motion graphic (→ /motion-graphics). Unclear launch-vs-general-site? Ask one question or start at /hyperframes.

関連スキル