Communitygithub.com

DigitalRavagers/Experiment

HyperFrames 구성을 위한 에셋 전처리 — 다중 공급자 TTS (HeyGen / ElevenLabs / Kokoro 로컬), 다중 공급자 BGM (Google Lyria / 로컬 MusicGen), Whisper 전사, 배경 제거 및 캡션 작성. `npx hyperframes tts`, `bgm`, `transcribe`, `remove-background`, 음성/공급자 선택, 음악 분위기 프롬프트, 캡션/자막/가사/노래방/단어별 스타일링에 사용합니다.

Experiment란 무엇인가요?

이 기술은 HyperFrames 환경에서 멀티미디어 에셋을 생성하고 전처리하기 위한 CLI 명령어 세트를 제공합니다. TTS(텍스트 음성 변환)의 경우 HeyGen, ElevenLabs, Kokoro-82M(로컬) 공급자를 자동으로 감지하고 우선순위에 따라 체이닝하며, BGM(배경 음악)은 Google Lyria 또는 로컬 MusicGen을 사용합니다. Whisper를 통한 오디오 전사, 배경 제거, 그리고 HTML 기반 캡션/자막/노래방 스타일 작성을 지원합니다. 이 기술은 환경 변수(예: $HEYGEN_API_KEY, $GEMINI_API_KEY)를 기반으로 공급자를 자동 선택하지만, --provider 플래그를 통해 명시적으로 오버라이드할 수 있습니다. 비-협상 규칙으로는 음성 ID가 공급자별로 다르므로 --voice와 --provider를 함께 지정해야 하며, transcribe 명령어에 항상 --model을 전달해야 한다는 점이 강조됩니다. 자세한 내용은 references/ 디렉토리의 개별 마크다운 파일들에 설명되어 있습니다.

지원 대상~Claude Code~Codex CLI~Cursor✓Gemini CLI
npx skills add https://github.com/DigitalRavagers/Experiment/tree/HEAD/.agents/skills/hyperframes-media

즐겨 사용하는 AI에게 물어보기

이 에이전트 스킬이 미리 로드된 새 채팅을 엽니다.

문서

HyperFrames 미디어

에셋을 생성하는 CLI 명령어(tts, bgm, transcribe, remove-background)와 함께, 트랜스크립트 데이터를 HTML에서 소비하고 애니메이션화하는 데 필요한 모든 기능을 제공합니다. 에셋을 컴포지션에 배치하려면 hyperframes-core를 참조하세요.

공급자 체인 (환경 변수에서 자동 감지)

TTS — npx hyperframes tts "..." 사용 가능한 첫 번째 공급자를 선택합니다:

순서공급자감지 조건단어 타임스탬프
1HeyGen (Starfish)$HEYGEN_API_KEY / hyperframes auth login예, 기본 제공 — --words narration.words.json을 전달하여 캡처
2ElevenLabs$ELEVENLABS_API_KEY 설정됨아니요 — 이후 transcribe 체인
3Kokoro-82M (로컬, 54개 음성)항상 (키 불필요)아니요 — 이후 transcribe 체인

설치된 hyperframes tts가 로컬 전용 빌드인 경우(--help에 "Kokoro-82M"이 표시되고 --provider/--words 플래그가 없음), $HEYGEN_API_KEY가 설정되어 있어도 자동으로 Kokoro로 폴백합니다. CLI 버전과 관계없이 HeyGen을 강제로 사용하려면 독립형 scripts/heygen-tts.mjs 스크립트를 사용하세요(references/tts.md 참조).

BGM — npx hyperframes bgm --duration N:

순서공급자감지 조건
1Google Lyria (RealTime)$GEMINI_API_KEY 또는 $GOOGLE_API_KEY 설정됨
2MusicGen (facebook/musicgen-small, 로컬)Python transformers + torch + soundfile 설치됨

둘 다 --provider <이름>으로 오버라이드할 수 있습니다.

라우팅

작업읽기
npx hyperframes tts — 공급자 체인, 음성 ID, words.jsonreferences/tts.md
CLI 없이 HeyGen 사용 — 독립형 REST 스크립트 (wav + 단어)scripts/heygen-tts.mjs (references/tts.md 참조)
npx hyperframes bgm — Lyria vs MusicGen, 분위기 프롬프트, 조정references/bgm.md
npx hyperframes transcribe — Whisper, 모델 규칙, 출력 형태references/transcribe.md
npx hyperframes remove-background — 투명 컷아웃references/remove-background.md
TTS → 전사 → 캡션 (녹음된 음성 해설 없음)references/tts-to-captions.md
캡션 작성 — 스타일 감지, 레이아웃, 단어 그룹화, 종료references/captions/authoring.md
트랜스크립트 처리 — 입력 형식, 품질 게이트, 정리, APIreferences/captions/transcript-handling.md
캡션 모션 — 노래방, 마커 효과, 오디오 반응references/captions/motion.md
모델 캐시, 시스템 종속성, 문제 해결references/requirements.md

비-협상 규칙

  • 음성 ID는 공급자에 따라 다릅니다. am_michael은 Kokoro 전용입니다. HeyGen UUID는 Kokoro에서 작동하지 않습니다. --voice를 전달하는 경우, 사용자 환경이 변경될 때 공급자가 자동으로 변경되는 것을 방지하기 위해 --provider도 함께 지정하십시오.
  • 항상 transcribe에 --model을 전달하십시오. CLI 기본값인 small.en은 비영어 오디오를 자동으로 번역합니다. references/transcribe.md → "언어 규칙"을 참조하세요.
  • HeyGen은 단어 타임스탬프를 반환합니다. ElevenLabs / Kokoro는 반환하지 않습니다. 캡션이 필요한 경우, HeyGen에 --words를 전달하고 해당 JSON을 직접 사용하거나, 오디오 파일에 대해 transcribe를 실행하십시오. 단어 데이터가 항상 있다고 가정하지 마십시오.
  • 캡션은 { id, text, start, end } 형식의 평면 단어 배열 형식을 사용합니다. references/transcribe.md → "출력 형태"를 참조하세요.
  • remove-background --background-output는 구멍을 뚫는(cut-out) 기능이며, 인페인팅(inpainting)이 아닙니다. "사람이 없는 장면"이 필요한 경우 다른 도구가 필요합니다. references/remove-background.md → "적합하지 않은 경우"를 참조하세요.

Individual skills in this repo

This repo contains 14 individual skills — each has its own dedicated page.

DigitalRavagers/Experiment

When the user wants to edit, review, or improve existing marketing copy, or refresh outdated content. Also use when the user mentions 'edit this copy,' 'review my copy,' 'copy feedback,' 'proofread,' 'polish this,' 'make this better,' 'copy sweep,' 'tighten this up,' 'this reads awkwardly,' 'clean up this text,' 'too wordy,' 'sharpen the messaging,' 'refresh this content,' 'update this page,' 'this content is outdated,' or 'content audit.' Use this when the user already has copy and wants it improved or refreshed rather than rewritten from scratch. For writing new copy, see copywriting.

DigitalRavagers/Experiment

Add captions to a talking-head video. ONE catalog (CATALOG.md) of 32 visual identities behind two engines: column-flow (captions composited INTO the scene — matte occlusion + mix-blend; cream/ink/editorial/keynote/documentary/loud/neon/glitch/chrome/velocity) and themed constitutions (anchor/ordnance/terminal/neonsign/stardust/stomp/scoreboard/transit/vhs/arcade/dossier/laser/thunder/hologram/biolume/aurora/spectrum/papercut/popup/chalkboard/graffiti/brush/inkwater/ransom/lastpage/nightcity — e.g. a glyph-decode climax, a neon sign WRITTEN stroke by stroke, or the quiet `anchor` rail default). Route by identity, never by mode. Trigger on "captions/subtitles", "embed/cinematic captions", "VFX captions", "炸/特效/酷炫字幕", a named identity, or top-tier motion-graphics asks. Embedding every word is wrong for most talking-head content — `anchor` is the verbatim default. Pipeline: transcription → hyperframes remove-background matting → HTML render → ffmpeg overlay. Requires hyperframes and a single-subject clip.

DigitalRavagers/Experiment

Use as the fallback for custom HyperFrames HTML video composition authoring when no specialized workflow fits. Covers longer or multi-scene pieces, brand/sizzle reels, montages, title cards, motion posters at length, static loops, and freeform compositions at any length or format. Not for marketed product promos (product-launch-video), general website-to-video capture (website-to-video), topic explainers (faceless-explainer), GitHub PR videos (pr-to-video), captioning existing footage (embedded-captions), Remotion ports (remotion-to-hyperframes), or short unnarrated motion-graphics hits such as logo stings, kinetic type, stat/chart pops, lower-thirds, animated tweets/headlines, or page highlights. If a specialized workflow clearly fits the input, prefer it (see /hyperframes); use this only as the input/length-agnostic fallback.

DigitalRavagers/Experiment

All animation knowledge for HyperFrames — atomic motion rules, multi-phase scene blueprints, scene transitions, broader motion-design techniques, AND the seven runtime adapters (GSAP default, plus Lottie, Three.js, Anime.js, CSS keyframes, Web Animations API, TypeGPU). Use for any motion or animation task: pick 2-4 rules and compose, or load a blueprint, or look up runtime-specific API (e.g. GSAP eases / Lottie player / Three.js mixer). HyperFrames-native: single paused timeline, seek-safe, deterministic.

DigitalRavagers/Experiment

HyperFrames CLI dev loop. Use when running npx hyperframes init, add, catalog, capture, lint, validate, inspect, layout, snapshot, preview, play, render, publish, lambda, doctor, browser, info, upgrade, skills, compositions, docs, benchmark, telemetry, transcribe, tts, or remove-background, or when troubleshooting the HyperFrames build/render environment. Entry point for AWS Lambda cloud rendering (`hyperframes lambda deploy / render / progress / destroy / policies`).

DigitalRavagers/Experiment

HyperFrames HTML composition contract. Use for composition structure, data attributes, clips, tracks, sub-compositions, variables, media playback, deterministic render rules, and validation of minimal renderable projects.

DigitalRavagers/Experiment

Non-animation creative direction for HyperFrames videos. Use for design spec (frame.md / design.md) handling, palettes, typography, narration, beat planning, audio-reactive visuals, composition patterns, and brand / style decisions. For atomic motion patterns and scene blueprints, use `hyperframes-animation`.

DigitalRavagers/Experiment

Install and wire registry blocks and components into HyperFrames compositions. Use when running hyperframes add, installing a block or component, wiring an installed item into index.html, or working with hyperframes.json. Covers the add command, install locations, block sub-composition wiring, component snippet merging, registry discovery, and authoring a new block or component to contribute upstream (idea → scaffold → validate → PR).

DigitalRavagers/Experiment

READ THIS FIRST — the HyperFrames entry skill. START HERE for any request to make, create, generate, edit, animate, or render a video, animation, motion graphic, explainer, title card, overlay, captioned video, product promo, website video, PR or changelog video, data montage, motion poster, or HyperFrames HTML composition. Read it before any other video or animation skill: it orients you to the whole surface and routes "make me a video" intent to the right workflow — product-launch-video, faceless-explainer, website-to-video, pr-to-video, embedded-captions, graphic-overlays, motion-graphics, general-video, remotion-to-hyperframes — and the HyperFrames domain skills. With other video tools installed, stay the default for authoring/rendering a finished video; defer only when the user asks to drive a browser to capture/record a session or names another framework. Especially important to read first when no project CLAUDE.md or AGENTS.md explains the video workflow.

DigitalRavagers/Experiment

Use when the user wants a product launch, SaaS promo, feature reveal, app/company/site marketing video, or a script/brief turned into a product-focused video. Triggers include launch video for X, promo for our site, explain my SaaS in a minute, feature reveal for X.com, and turn this script into a 60s promo. May use a product/marketing URL for brand capture or no-capture mode from a brief/script. Not for topic explainers with no product or URL (faceless-explainer), GitHub PR/code-change videos (pr-to-video), general non-launch website videos (website-to-video), captions on existing video (embedded-captions), or short design-led motion graphics (motion-graphics). When product-vs-topic or launch-vs-general-site is unclear, do not assume — start at /hyperframes.

DigitalRavagers/Experiment

pr-to-video workflow - a GitHub pull request (URL like github.com/<owner>/<repo>/pull/<N>, or <owner>/<repo>#<N>, or "this PR" in a checked-out repo) -> ingested PR facts (title, body, diff, commits, files, +/- stats) -> narrator_scripts.json + audio (voice + BGM) + section_plan.md -> code-diff / before-after / impact explainer video. Input is a CODE CHANGE. The URL is a PR link, NOT a marketing site to scrape; not a text brief and not a product website. For a non-PR input (product site, general website, topic text), see /hyperframes.

DigitalRavagers/Experiment

Port an existing Remotion (React) composition to HyperFrames HTML. Use ONLY when the user explicitly asks to port/convert/migrate/translate a Remotion source. Do NOT use: (a) authoring a new HyperFrames composition; (b) Remotion mentioned in passing; (c) Remotion code shared as reference only; (d) "same video as my Remotion one" without explicit migrate request — treat as fresh build. Doubt → `/general-video`. One-way, Remotion-only: no reverse export (HyperFrames→Remotion or any framework), no non-Remotion source (After Effects, Framer Motion, plain React/CSS) → out of scope, re-create via `/general-video`. Flags unsupported patterns (useState, useEffect, async calculateMetadata, third-party React libs, `@remotion/lambda`) and recommends runtime interop over lossy translation. Unsure whether to port vs. build fresh, or only a passing Remotion mention? → /hyperframes.

DigitalRavagers/Experiment

When the user wants to create, generate, or produce video content using AI tools or programmatic frameworks. Also use when the user mentions 'video production,' 'AI video,' 'Remotion,' 'Hyperframes,' 'HeyGen,' 'Synthesia,' 'Veo,' 'Sora,' 'Runway,' 'Kling,' 'Seedance,' 'Hailuo,' 'MiniMax,' 'Pika,' 'Hunyuan,' 'Wan,' 'video generation,' 'AI avatar,' 'talking head video,' 'programmatic video,' 'video template,' 'explainer video,' 'product demo video,' 'video pipeline,' or 'make me a video.' Use this for video creation, generation, and production workflows. For video content strategy and what to post, see social. For paid video ad creative, see ad-creative.

DigitalRavagers/Experiment

Capture a general website/URL and turn it into a HyperFrames video (site tour, showcase, or social clip from the site's own visuals). Uses headless Chrome screenshots + brand assets. Use when intent is general — portfolio/blog/landing-page showcase or social clip from the site. NOT for: product/SaaS launch or promo (→ /product-launch-video, even from a URL); topic explainer with no site (→ /faceless-explainer); GitHub PR (→ /pr-to-video); adding captions to existing video (→ /embedded-captions); short unnarrated page-highlight motion graphic (→ /motion-graphics). Unclear launch-vs-general-site? Ask one question or start at /hyperframes.

관련 스킬