Communitygithub.com

Army161/OpenMontage

Volcengine Doubao Speech 2.0을 사용하여 중국어 및 다국어 내레이션을 생성합니다. 중국어 음성 해설이 필요할 때, 사용자가 Doubao/Volcengine/火山引擎/豆包 TTS를 선호할 때, 또는 자막을 위한 문자 수준 타임스탬프 메타데이터가 필요한 내레이션에 사용하세요.

OpenMontage란 무엇인가요?

이 스킬은 Volcengine Doubao Speech 2.0 TTS API를 통합하여 고품질 중국어 및 다국어 음성 내레이션을 생성합니다. 주로 Claude Code, Cursor, Codex와 같은 AI 에이전트 플랫폼에서 사용되며, 사용자가 Doubao 또는 Volcengine TTS를 선호하거나, 중국어 음성 해설이 필요하거나, 자막 생성을 위해 문자 수준 타임스탬프가 포함된 정밀한 내레이션을 요구할 때 자동으로 활성화됩니다. 비동기 엔드포인트를 통해 오디오 URL과 `sentences[].words[]` 타이밍 메타데이터를 반환하여 완벽한 자막 동기화를 지원합니다. 또한 음성 속도 조절, 다양한 음성 선택, 샘플 생성 워크플로우 등 내레이션 품질을 최적화하기 위한 여러 파라미터와 모범 사례를 제공합니다.

지원 대상~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/Army161/OpenMontage/tree/HEAD/.agents/skills/doubao-tts

즐겨 사용하는 AI에게 물어보기

이 에이전트 스킬이 미리 로드된 새 채팅을 엽니다.

문서

Doubao TTS

.env 파일에 DOUBAO_SPEECH_API_KEY가 필요합니다. 기본 음성을 설정하려면 DOUBAO_SPEECH_VOICE_TYPE을 설정하거나, 도구에 voice_id를 전달하세요.

현재 API

새 콘솔 API 키 흐름을 사용하세요:

X-Api-Key: ${DOUBAO_SPEECH_API_KEY}
X-Api-Resource-Id: seed-tts-2.0

새 콘솔 API 키와 함께 X-Api-App-Id 및 X-Api-Access-Key를 사용하지 마세요. API가 load grant: requested grant not found를 반환하면 키 유형이나 인증 헤더가 잘못된 것입니다.

긴 형식의 비디오 내레이션의 경우 비동기 엔드포인트를 선호합니다:

POST https://openspeech.bytedance.com/api/v3/tts/submit
POST https://openspeech.bytedance.com/api/v3/tts/query

이 엔드포인트는 audio_url과 자막 제작에 사용할 수 있는 sentences[].words[] 타이밍 메타데이터를 반환합니다.

OpenMontage 사용법

TTS 선택기로 생성:

from tools.audio.tts_selector import TTSSelector

result = TTSSelector().execute({
    "preferred_provider": "doubao",
    "text": "如果 AI 真的会改变未来,普通人到底该怎么参与?",
    "voice_id": "zh_female_vv_uranus_bigtts",
    "output_path": "projects/my-video/assets/audio/narration.mp3",
    "speech_rate": 0,
    "enable_timestamp": True,
})

또는 제공자를 직접 호출:

from tools.audio.doubao_tts import DoubaoTTS

result = DoubaoTTS().execute({
    "text": "短样本试听文本。",
    "voice_id": "zh_female_vv_uranus_bigtts",
    "output_path": "projects/my-video/assets/audio/doubao_sample.mp3",
})

제공자는 다음을 기록합니다:

  • output_path: 다운로드된 오디오 파일
  • metadata_path: 전체 쿼리 응답 JSON, 기본값 <output_path>.json

권장 워크플로우

  1. 전체 유료 내레이션 전에 10-15초 샘플을 생성하세요.
  2. 사용자에게 음색, 억양, 속도에 대한 승인을 요청하세요.
  3. 승인 후에만 전체 내레이션을 생성하세요.
  4. 쿼리 JSON을 보관하세요. 자막 타이밍의 진실 공급원입니다.
  5. 예상 텍스트 길이가 아닌 sentences[].words[]에서 자막을 작성하세요.
  6. 타임스탬프를 적용하기 전에 중국어 의미 구문 단위로 자막을 그룹화하세요. 고정된 문자 수로만 분할하지 마십시오. "在不押单个公司的情况下" 또는 "可能会被慢慢稀释"와 같은 구문이 깨져 이해도를 떨어뜨릴 수 있습니다.
  7. 사용자가 명시적으로 이전 런타임과 일치하도록 요청하지 않는 한 비디오 길이는 승인된 음성 리듬을 따르도록 하세요.

파라미터

  • voice_id: Doubao speaker / 음성 유형. 기본값은 DOUBAO_SPEECH_VOICE_TYPE입니다.
  • resource_id: Doubao Speech 2.0 음성에는 seed-tts-2.0을 사용하세요.
  • speech_rate: 0은 보통, 100은 2배속, -50은 0.5배속입니다.
  • sample_rate: 기본값 24000.
  • enable_timestamp: 기본값 true.
  • return_usage: 기본값 true, 사용 가능한 경우 사용 메타데이터를 요청합니다.

기본적으로 additions.explicit_language를 전달하지 마세요. 일부 엔드포인트/키 조합은 zh-cn을 unsupported additions explicit language zh-cn 오류와 함께 거부합니다.

조용한 중국어 설명 영상의 경우 speech_rate: 0으로 시작하세요. 결과가 승인된 형식에 비해 너무 길면 전체 내레이션을 다시 생성하기 전에 speech_rate: 25 또는 50으로 짧은 비교 샘플을 만드세요. 사용자가 Doubao의 자연스러운 속도를 선호하는 경우 이전 제공자의 길이에 맞추기 위해서만 속도를 높이지 마세요.

문제 해결

  • load grant: requested grant not found: 잘못된 키 유형 또는 잘못된 인증 헤더. 새 콘솔 API 키에는 X-Api-Key를 사용하세요.
  • speaker permission denied: 음성 ID가 잘못되었거나 선택한 리소스에 대해 권한이 없습니다.
  • quota exceeded: 할당량, 평생 문자 수 또는 동시 실행 수가 초과되었습니다.
  • 타임스탬프 누락: enable_timestamp: true인지 확인하고, 쿼리 JSON을 보관하며, 선택한 엔드포인트가 sentences를 반환했는지 확인하세요.

안전

API 키를 로그, 메타데이터, 패치 또는 프로젝트 아티팩트에 절대 출력하거나 기록하지 마세요. .env.example에는 빈 변수 이름만 포함되어야 합니다.

Individual skills in this repo

This repo contains 20 individual skills — each has its own dedicated page.

Army161/OpenMontage

Generate AI videos from text prompts using multiple provider gateways. Use when: (1) Generating videos from text descriptions, (2) Creating AI-generated video clips for content production, (3) Image-to-video generation with a reference image, (4) Choosing between video generation providers (VEO, Kling, Sora, Runway, Seedance, MiniMax). Supports two gateways: HeyGen API and fal.ai API.

Army161/OpenMontage

Create AI avatar videos with precise control over avatars, voices, scripts, scenes, and backgrounds using HeyGen's v2 API. Use when: (1) Choosing a specific avatar and voice for a video, (2) Writing exact scripts for an avatar to speak, (3) Building multi-scene videos with different backgrounds per scene, (4) Creating transparent WebM videos for compositing, (5) Using talking photos as video presenters, (6) Integrating HeyGen avatars with Remotion, (7) Batch video generation with exact specs, (8) Brand-consistent production videos with precise control.

Army161/OpenMontage

Use p5.js/canvas for local procedural character effects: particles, weather, squash/stretch, walk cycles, and environmental motion.

Army161/OpenMontage

Review local character animation with schema checks, Playwright browser previews, frame sampling, and FFmpeg/ffprobe final output checks.

Army161/OpenMontage

Create videos from a text prompt using HeyGen's Video Agent. Use when: (1) Creating a video from a description or idea, (2) Generating explainer, demo, or marketing videos from a prompt, (3) Making a video without specifying exact avatars, voices, or scenes, (4) Quick video prototyping or drafts, (5) One-shot prompt-to-video generation, (6) User says "make me a video" or "create a video about X".

Army161/OpenMontage

Video and audio processing with FFmpeg. Use for format conversion, resizing, compression, audio extraction, and preparing assets for Remotion. Triggers include converting GIF to MP4, resizing video, extracting audio, compressing files, or any media transformation task.

Army161/OpenMontage

Use when implementing Disney's 12 animation principles with Framer Motion in React applications

Army161/OpenMontage

All animation knowledge for HyperFrames — atomic motion rules, multi-phase scene blueprints, scene transitions, broader motion-design techniques, AND the seven runtime adapters (GSAP default, plus Lottie, Three.js, Anime.js, CSS keyframes, Web Animations API, TypeGPU). Use for any motion or animation task: pick 2-4 rules and compose, or load a blueprint, or look up runtime-specific API (e.g. GSAP eases / Lottie player / Three.js mixer). HyperFrames-native: single paused timeline, seek-safe, deterministic.

Army161/OpenMontage

HyperFrames CLI dev loop. Use when running npx hyperframes init, add, catalog, capture, lint, validate, inspect, layout, snapshot, preview, play, render, publish, lambda, doctor, browser, info, upgrade, skills, compositions, docs, benchmark, telemetry, transcribe, tts, or remove-background, or when troubleshooting the HyperFrames build/render environment. Entry point for AWS Lambda cloud rendering (`hyperframes lambda deploy / render / progress / destroy / policies`).

Army161/OpenMontage

The HyperFrames composition contract — build one renderable project. Use for composition structure, the `data-*` timing attributes, `class="clip"`, tracks, sub-compositions, variables, framework-owned media playback, deterministic-render rules, and validation. Read before writing composition HTML.

Army161/OpenMontage

Non-animation creative direction for HyperFrames videos. Use for design spec (frame.md / design.md) handling, palettes, typography, narration, beat planning, audio-reactive visuals, composition patterns, and brand / style decisions. For atomic motion patterns and scene blueprints, use `hyperframes-animation`.

Army161/OpenMontage

Audio and media assets for HyperFrames compositions, produced by one shared audio engine (`scripts/audio.mjs`) — multi-provider TTS (HeyGen / ElevenLabs / Kokoro local), background music + sound effects (HeyGen audio-library retrieval by default, with local Lyria / MusicGen BGM generation and a bundled SFX library as the no-credential fallback), Whisper transcription, background removal, and caption authoring. Use for voiceover / TTS, BGM, SFX / sound effects, transcription, captions / subtitles / lyrics / karaoke / per-word styling, voice + provider selection, and music-mood prompting.

Army161/OpenMontage

Install and wire registry blocks and components into HyperFrames compositions. Use when running hyperframes add, installing a block or component, wiring an installed item into index.html, or working with hyperframes.json. Covers the add command, install locations, block sub-composition wiring, component snippet merging, registry discovery, and authoring a new block or component to contribute upstream (idea → scaffold → validate → PR).

Army161/OpenMontage

Use when the user wants a short, design-led motion graphic where motion is the message: kinetic typography, stat or number count-up, chart/data-viz hit, logo sting, brand lockup, lower-third, callout, social overlay, animated headline/tweet/news item, motion poster, or quick captured-page highlight. Usually under 10s and up to ~30s, with no narration arc, voice-over, or live-action subject. Can render to MP4 or transparent overlay. Not for longer, multi-scene, narrated, or brand-reel pieces (use general-video), narrated website videos (website-to-video), topic explainers (faceless-explainer), product promos (product-launch-video), PR videos (pr-to-video), or captions on existing footage (embedded-captions). When unsure whether it's a quick motion-first piece or a longer / narrated treatment, see /hyperframes.

Army161/OpenMontage

Use when the user has a music track (an audio file, or a video to pull audio from) and wants a beat-synced HyperFrames video, calm to hard-hitting. The music drives everything: one analyzer reads it once, the orchestrator lays out the frames and fills a per-frame plan, and one sub-agent builds each frame. Typography and templates are the floor — a complete video needs zero assets — but any images or videos the user supplies are cut into the frames on the same beat grid (beat-cut / ken-burns). The genre (lyric video, slideshow, kinetic promo) falls out of the per-frame choices; the pipeline never branches on it.

Army161/OpenMontage

Best practices for Remotion - Video creation in React

Army161/OpenMontage

Toolkit-specific Remotion patterns — custom transitions, shared components, and project conventions. For core Remotion framework knowledge (hooks, animations, rendering, etc.), see the `remotion-official` skill.

Army161/OpenMontage

Port an existing Remotion (React) composition to HyperFrames HTML. Use ONLY when the user explicitly asks to port/convert/migrate/translate a Remotion source. Do NOT use: (a) authoring a new HyperFrames composition; (b) Remotion mentioned in passing; (c) Remotion code shared as reference only; (d) "same video as my Remotion one" without explicit migrate request — treat as fresh build. Doubt → `/general-video`. One-way, Remotion-only: no reverse export (HyperFrames→Remotion or any framework), no non-Remotion source (After Effects, Framer Motion, plain React/CSS) → out of scope, re-create via `/general-video`. Flags unsupported patterns (useState, useEffect, async calculateMetadata, third-party React libs, `@remotion/lambda`) and recommends runtime interop over lossy translation. Unsure whether to port vs. build fresh, or only a passing Remotion mention? → /hyperframes.

Army161/OpenMontage

Animate SVG character rigs with GSAP, CSS transforms, Remotion frame control, and HyperFrames-compatible browser previews.

Army161/OpenMontage

Three.js animation - keyframe animation, skeletal animation, morph targets, animation mixing. Use when animating objects, playing GLTF animations, creating procedural motion, or blending animations.

관련 스킬