Communitygithub.com

Aseel1600/Edit01

使用 fish.audio(S1 / S2 生成模型)生成富有表現力、多語言的旁白,並可透過 reference_id 重複使用已複製的聲音。當使用者偏愛 fish.audio/Fish Audio TTS、需要特定遊樂場語音模型,或需要高情緒語音複製旁白時使用。

Edit01 是什麼?

這項技能讓 AI 代理能夠透過 fish.audio API 生成高品質、富有情感的多語言文字轉語音(TTS)音訊。它支援 S1 和 S2 系列後端模型(包括最新的 s2.1-pro),可實現即時情緒標籤(例如 [laugh]、[whispers])、80 多種語言以及多說話者旁白。開發者可以在 fish.audio 遊樂場建立語音模型,並使用 reference_id 無縫重複使用這些聲音,從而確保後續生成時語音角色的一致性。此工具專為與 OpenMontage 等程式碼庫整合而設計,同時也提供 Python API 供直接呼叫。它包含詳細的用法說明、參數微調建議(如延遲、正規化、音訊位元率),以及成本管理策略。安全性方面,強調 API 金鑰處理的最佳實踐,確保敏感憑證不會意外洩漏。

相容平台~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/Aseel1600/Edit01/tree/HEAD/.agents/skills/fish-audio-tts

在你喜歡的 AI 中提問

開啟一個已預先載入此 Agent Skill 的新對話。

說明文件

fish.audio TTS

需要在 .env 中設定 FISH_AUDIO_API_KEY(可在 https://fish.audio/go-api/api-keys/ 建立)。 在 fish.audio 遊樂場建立語音模型,並將其 ID 作為 reference_id 傳遞,即可重複使用已複製的聲音。

目前 API

單次同步呼叫,回傳原始音訊位元組:

POST https://api.fish.audio/v1/tts
Authorization: Bearer ${FISH_AUDIO_API_KEY}
Content-Type: application/json
model: <後端模型>     # HTTP 標頭選擇後端,例如 s1

後端模型是透過 model HTTP 標頭來選擇的,而非請求體內欄位。在 OpenMontage 中,這會對應到工具的 model 輸入。

後端模型

model 是必填的 — 沒有預設值。請傳遞下列其中一個:

  • s2.1-pro — 最新一代。最佳品質:支援行內情緒標籤、80 多種語言、多說話者。適用於英雄式旁白。
  • s2.1-pro-free — 促銷免費使用 s2.1-pro。僅在促銷期間內,適用於草稿、樣本和驗證運行,費用為 $0。根據 fish.audio 公告:截至 2026 年 8 月 31 日免費,受合理使用條款約束,不提供 SLA/延遲保證,請求可能會被保留,且商業使用受到限制。切勿將生產環境或用戶旁白透過此模式處理。
  • s2-pro — 第一代 S2 生成。穩定高品質,支援情緒標籤。
  • s1 — 前一代旗艦模型。為保持與現有整合的相容性而保留。

計費方式為按輸入文字的 UTF-8 位元組計費(非按字元)。中日韓(CJK)文字和表情符號的費用約為相同可見長度 ASCII 字元的 3-4 倍。目前定價:s1 / s2-pro / s2.1-pro = 每 100 萬位元組 $15 美元,s2.1-pro-free = 僅促銷期間 $0 美元(工具的 estimate_cost() 會在 2026 年 8 月 31 日後切換至付費的 s2.1-pro 費率)。在大量使用前,請前往 https://docs.fish.audio/developer-guide/models-pricing/pricing-and-rate-limits 確認最新定價。

行內情緒標籤(僅限 S2 模型)

s2-pro / s2.1-pro / s2.1-pro-free 會解析嵌入在文字中的行內情緒標籤:

  • 像 [laugh]、[whispers] 這類標籤能在句子中間改變語調。
  • 範例:"That's hilarious [laugh] but let me explain seriously."
  • s1 不解析情緒標籤 — 它們可能會被當作純文字唸出,因此在目標為 s1 時應移除這些標籤。

語音選擇(reference_id)

  • 在 fish.audio 遊樂場中建立或挑選一個語音,然後複製其模型 ID。
  • 將其作為 reference_id 傳遞。當 reference_id 不存在時,選擇器的通用 voice_id 可作為別名使用。
  • 若未提供 reference_id,fish.audio 將對所選模型使用其預設語音。

此工具不支援即時行內複製(每次請求上傳參考音訊 + 文字)— 請先在遊樂場中建立語音模型。

OpenMontage 使用方式

使用 TTS 選擇器生成:

from tools.audio.tts_selector import TTSSelector

result = TTSSelector().execute({
    "preferred_provider": "fish_audio",
    "text": "Here's why compound interest quietly beats every get-rich-quick scheme.",
    "model": "s1",
    "reference_id": "<遊樂場語音模型 ID>",
    "output_path": "projects/my-video/assets/audio/narration.mp3",
})

或直接呼叫提供者:

from tools.audio.fish_audio_tts import FishAudioTTS

result = FishAudioTTS().execute({
    "text": "Short sample line for approval.",
    "model": "s1",
    "reference_id": "<遊樂場語音模型 ID>",
    "output_path": "projects/my-video/assets/audio/fish_sample.mp3",
})

提供者會將音訊寫入 output_path,並回傳 data.output 以及解析後的 model 和 reference_id。

品質與延遲調校

  • latency:normal(預設,最佳品質)、balanced(稍快)或 low(最快,犧牲少許品質)。
  • normalize:預設為 true;建議保持開啟,以便數字、日期和貨幣能自然朗讀。
  • prosody:可選的 { "speed": 1.0, "volume": 0 },用於調整語速/音量。
  • mp3_bitrate:128 是不錯的預設值;若混音中音樂背景較重,可提高至 192。
  • temperature:預設為 0.7。可提高至 0.9 左右以獲得更有表現力的朗讀(特別是在使用情緒標籤時建議這麼做);調低則可獲得更平穩、可預測的語調。
  • top_p / repetition_penalty:通常保留預設值(0.7 / 1.2)即可。

建議工作流程

  1. 在進行完整的付費旁白生成前,先使用所選的 model + reference_id 生成一段 10-15 秒的樣本。
  2. 請使用者確認語音自然度、情緒和語速。
  3. 只有在獲得批准後,再生成完整的旁白。
  4. 對於批次處理/本地化變體(成本考量),可先在 s2.1-pro-free 上建立原型(促銷期間 $0;僅限非商業草稿),然後將最終版本升級為 s2.1-pro。

故障排除

  • 401 Unauthorized:FISH_AUDIO_API_KEY 錯誤或缺失。
  • 402 / 付款錯誤:帳戶額度已用完。
  • 404 / 語音錯誤:reference_id 錯誤或不屬於此帳戶。
  • 音訊空白/過短:請檢查 text 是否為非空,以及 normalize 是否未將整個輸入清空。

安全性

切勿將 API 金鑰列印或寫入日誌、中繼資料、修補程式或專案產出物中。.env.example 應僅包含空的變數名稱。

Individual skills in this repo

This repo contains 20 individual skills — each has its own dedicated page.

Aseel1600/Edit01

Generate AI videos from text prompts using multiple provider gateways. Use when: (1) Generating videos from text descriptions, (2) Creating AI-generated video clips for content production, (3) Image-to-video generation with a reference image, (4) Choosing between video generation providers (VEO, Kling, Sora, Runway, Seedance, MiniMax, Gemini Omni). Supports gateways: HeyGen API, fal.ai API, Kling official direct API, and the Gemini API (Gemini Omni Flash).

Aseel1600/Edit01

Create AI avatar videos with precise control over avatars, voices, scripts, scenes, and backgrounds using HeyGen's v2 API. Use when: (1) Choosing a specific avatar and voice for a video, (2) Writing exact scripts for an avatar to speak, (3) Building multi-scene videos with different backgrounds per scene, (4) Creating transparent WebM videos for compositing, (5) Using talking photos as video presenters, (6) Integrating HeyGen avatars with Remotion, (7) Batch video generation with exact specs, (8) Brand-consistent production videos with precise control.

Aseel1600/Edit01

Use p5.js/canvas for local procedural character effects: particles, weather, squash/stretch, walk cycles, and environmental motion.

Aseel1600/Edit01

Review local character animation with schema checks, Playwright browser previews, frame sampling, and FFmpeg/ffprobe final output checks.

Aseel1600/Edit01

Create videos from a text prompt using HeyGen's Video Agent. Use when: (1) Creating a video from a description or idea, (2) Generating explainer, demo, or marketing videos from a prompt, (3) Making a video without specifying exact avatars, voices, or scenes, (4) Quick video prototyping or drafts, (5) One-shot prompt-to-video generation, (6) User says "make me a video" or "create a video about X".

Aseel1600/Edit01

Generate Mandarin and multilingual narration with Volcengine Doubao Speech 2.0. Use when creating Chinese voiceovers, when the user prefers Doubao/Volcengine/火山引擎/豆包 TTS, or when narration needs character-level timestamp metadata for subtitles.

Aseel1600/Edit01

Video and audio processing with FFmpeg. Use for format conversion, resizing, compression, audio extraction, and preparing assets for Remotion. Triggers include converting GIF to MP4, resizing video, extracting audio, compressing files, or any media transformation task.

Aseel1600/Edit01

Use when implementing Disney's 12 animation principles with Framer Motion in React applications

Aseel1600/Edit01

All animation knowledge for HyperFrames — atomic motion rules, multi-phase scene blueprints, scene transitions, broader motion-design techniques, AND the seven runtime adapters (GSAP default, plus Lottie, Three.js, Anime.js, CSS keyframes, Web Animations API, TypeGPU). Use for any motion or animation task: pick 2-4 rules and compose, or load a blueprint, or look up runtime-specific API (e.g. GSAP eases / Lottie player / Three.js mixer). HyperFrames-native: single paused timeline, seek-safe, deterministic.

Aseel1600/Edit01

HyperFrames CLI dev loop. Use when running npx hyperframes init, add, catalog, capture, lint, validate, inspect, layout, snapshot, preview, play, render, publish, lambda, doctor, browser, info, upgrade, skills, compositions, docs, benchmark, telemetry, transcribe, tts, or remove-background, or when troubleshooting the HyperFrames build/render environment. Entry point for AWS Lambda cloud rendering (`hyperframes lambda deploy / render / progress / destroy / policies`).

Aseel1600/Edit01

The HyperFrames composition contract — build one renderable project. Use for composition structure, the `data-*` timing attributes, `class="clip"`, tracks, sub-compositions, variables, framework-owned media playback, deterministic-render rules, and validation. Read before writing composition HTML.

Aseel1600/Edit01

Non-animation creative direction for HyperFrames videos. Use for design spec (frame.md / design.md) handling, palettes, typography, narration, beat planning, audio-reactive visuals, composition patterns, and brand / style decisions. For atomic motion patterns and scene blueprints, use `hyperframes-animation`.

Aseel1600/Edit01

Audio and media assets for HyperFrames compositions, produced by one shared audio engine (`scripts/audio.mjs`) — multi-provider TTS (HeyGen / ElevenLabs / Kokoro local), background music + sound effects (HeyGen audio-library retrieval by default, with local Lyria / MusicGen BGM generation and a bundled SFX library as the no-credential fallback), Whisper transcription, background removal, and caption authoring. Use for voiceover / TTS, BGM, SFX / sound effects, transcription, captions / subtitles / lyrics / karaoke / per-word styling, voice + provider selection, and music-mood prompting.

Aseel1600/Edit01

Install and wire registry blocks and components into HyperFrames compositions. Use when running hyperframes add, installing a block or component, wiring an installed item into index.html, or working with hyperframes.json. Covers the add command, install locations, block sub-composition wiring, component snippet merging, registry discovery, and authoring a new block or component to contribute upstream (idea → scaffold → validate → PR).

Aseel1600/Edit01

Use when the user wants a short, design-led motion graphic where motion is the message: kinetic typography, stat or number count-up, chart/data-viz hit, logo sting, brand lockup, lower-third, callout, social overlay, animated headline/tweet/news item, motion poster, or quick captured-page highlight. Usually under 10s and up to ~30s, with no narration arc, voice-over, or live-action subject. Can render to MP4 or transparent overlay. Not for longer, multi-scene, narrated, or brand-reel pieces (use general-video), narrated website videos (website-to-video), topic explainers (faceless-explainer), product promos (product-launch-video), PR videos (pr-to-video), or captions on existing footage (embedded-captions). When unsure whether it's a quick motion-first piece or a longer / narrated treatment, see /hyperframes.

Aseel1600/Edit01

Use when the user has a music track (an audio file, or a video to pull audio from) and wants a beat-synced HyperFrames video, calm to hard-hitting. The music drives everything: one analyzer reads it once, the orchestrator lays out the frames and fills a per-frame plan, and one sub-agent builds each frame. Typography and templates are the floor — a complete video needs zero assets — but any images or videos the user supplies are cut into the frames on the same beat grid (beat-cut / ken-burns). The genre (lyric video, slideshow, kinetic promo) falls out of the per-frame choices; the pipeline never branches on it.

Aseel1600/Edit01

Best practices for Remotion - Video creation in React

Aseel1600/Edit01

Toolkit-specific Remotion patterns — custom transitions, shared components, and project conventions. For core Remotion framework knowledge (hooks, animations, rendering, etc.), see the `remotion-official` skill.

Aseel1600/Edit01

Port an existing Remotion (React) composition to HyperFrames HTML. Use ONLY when the user explicitly asks to port/convert/migrate/translate a Remotion source. Do NOT use: (a) authoring a new HyperFrames composition; (b) Remotion mentioned in passing; (c) Remotion code shared as reference only; (d) "same video as my Remotion one" without explicit migrate request — treat as fresh build. Doubt → `/general-video`. One-way, Remotion-only: no reverse export (HyperFrames→Remotion or any framework), no non-Remotion source (After Effects, Framer Motion, plain React/CSS) → out of scope, re-create via `/general-video`. Flags unsupported patterns (useState, useEffect, async calculateMetadata, third-party React libs, `@remotion/lambda`) and recommends runtime interop over lossy translation. Unsure whether to port vs. build fresh, or only a passing Remotion mention? → /hyperframes.

Aseel1600/Edit01

Animate SVG character rigs with GSAP, CSS transforms, Remotion frame control, and HyperFrames-compatible browser previews.

相關技能