Communitygithub.com

NeverSight/learn-skills.dev

透過 inference.sh CLI 建立 AI 虛擬角色與說話頭影片。推薦:P-Video-Avatar(最快、最便宜、內建 TTS)。另可選:OmniHuman、Fabric、PixVerse。音訊支援:Inworld TTS-2(100 種以上語言、情緒引導角色)、ElevenLabs、Kokoro。功能:音訊驅動虛擬角色、文字轉虛擬角色、唇形同步影片、說話頭生成、虛擬主持人、UGC 內容。用途:AI 主持人、解說影片、虛擬網紅、配音、行銷影片、UGC 廣告、遊戲角色、NPC 對話。觸發詞:ai avatar、talking head、lipsync、avatar video、virtual presenter、ai spokesperson、audio driven video、heygen alternative、synthesia alternative、talking avatar、lip sync、video avatar、ai presenter、digital human、ugc、ugc video、ugc ad、avatar ugc

learn-skills.dev 是什麼?

這個技能讓開發者能透過 inference.sh CLI,僅需一個命令就能建立 AI 虛擬角色與說話頭影片。它提供多種模型選擇,其中 P-Video-Avatar 因內建文字轉語音 (TTS)、速度快(18 倍)且成本低(6 倍)而成為首選。其他模型如 OmniHuman 1.5(支援多角色)、Fabric 1.0 和 PixVerse Lipsync(高度擬真唇形同步)則提供更進階的功能。支援的音訊引擎包含 Inworld TTS-2(100 種以上語言,具備情緒引導)、ElevenLabs 和 Kokoro。此技能能處理音訊驅動的虛擬角色、文字轉虛擬角色、唇形同步影片、說話頭生成、虛擬主持人以及 UGC 內容等多種工作流程。開發者可以用它來建立 AI 主持人、解說影片、虛擬網紅、配音、行銷影片、UGC 廣告、遊戲角色和 NPC 對話。此技能適用於任何支援 `belt` CLI 的平台,使用上需先執行 `belt login` 進行認證。

相容平台~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/NeverSight/learn-skills.dev/tree/HEAD/data/skills-md/101-skills/skills/ai-avatar-video

在你喜歡的 AI 中提問

開啟一個已預先載入此 Agent Skill 的新對話。

預覽

來自技能 README

AI 虛擬角色與說話頭影片

說明文件

安裝 belt CLI 技能: npx skills add belt-sh/cli

AI 虛擬角色與說話頭影片

透過 inference.sh CLI 建立 AI 虛擬角色與說話頭影片。

AI 虛擬角色與說話頭影片

快速入門

需要 inference.sh CLI(belt)。安裝說明

belt login

# 推薦:P-Video-Avatar(最快、最便宜、內建 TTS)
belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "voice_script": "您好,歡迎來到我們的產品示範!",
  "voice": "Zephyr (Female)"
}'

可用模型

從 P-Video-Avatar 開始 — 它比替代方案快 18 倍且便宜 6 倍,內建 TTS、動態背景並支援 1080p。

模型應用 ID最佳用途內建 TTS
P-Video-Avatarpruna/p-video-avatar最佳整體表現:速度、成本、品質、控制是(30 種聲音、10 種語言)
OmniHuman 1.5bytedance/omnihuman-1-5多角色、音訊驅動否
Fabric 1.0falai/fabric-1-0圖片說話搭配唇形同步是
PixVerse Lipsyncfalai/pixverse-lipsync高度擬真唇形同步否

成本與速度比較

模型速度(每秒影片)每秒成本
P-Video-Avatar~1.83 秒/秒$0.025
OmniHuman 1.5~28 秒/秒(慢 15 倍)$0.16(貴 6.4 倍)
Fabric 1.0~34 秒/秒(慢 18 倍)$0.14(貴 5.6 倍)

範例

P-Video-Avatar(推薦)

從肖像照 + 文字腳本搭配內建 TTS 生成虛擬角色:

belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "voice_script": "歡迎來到我們的產品導覽。今天我將為您展示三個關鍵功能。",
  "voice": "Puck (Male)",
  "voice_language": "English (US)",
  "resolution": "720p"
}'

搭配自訂風格控制:

belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "voice_script": "這真是振奮人心的消息!",
  "voice": "Aoede (Female)",
  "voice_prompt": "Enthusiastic and energetic tone",
  "video_prompt": "The person is presenting on stage with dramatic lighting",
  "resolution": "1080p"
}'

使用音訊檔案代替 TTS:

belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "audio": "https://speech.mp3"
}'

完整工作流程:生成肖像照 + 虛擬角色

使用 Pruna P-Image 生成肖像照,再建立虛擬角色:

# 1. 生成肖像照
belt app run pruna/p-image --input '{
  "prompt": "professional headshot portrait of a young woman, neutral background, looking at camera, studio lighting, photorealistic",
  "aspect_ratio": "9:16"
}'

# 2. 使用內建 TTS 建立虛擬角色影片
belt app run pruna/p-video-avatar --input '{
  "image": "<image-url-from-step-1>",
  "voice_script": "您好!讓我為您介紹我們的最新功能。",
  "voice": "Zephyr (Female)"
}'

OmniHuman 1.5(多角色)

belt app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

支援在多人圖片中指定驅動哪個角色。

Fabric 1.0(圖片說話)

belt app run falai/fabric-1-0 --input '{
  "image_url": "https://face.jpg",
  "audio_url": "https://audio.mp3"
}'

PixVerse Lipsync

belt app run falai/pixverse-lipsync --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

完整工作流程:TTS + 虛擬角色(非 TTS 模型)

對於沒有內建 TTS 的模型(OmniHuman、PixVerse),請先產生語音:

# 1. 產生語音 — Inworld TTS-2 用於富有表現力的角色聲音
belt app run inworld/text-to-speech-2 --input '{
  "text": "[friendly] Welcome to our product demo! [excited] Let me show you three features that will change how you work.",
  "voice_id": "Sarah",
  "delivery_mode": "CREATIVE"
}' > speech.json

# 2. 使用語音建立虛擬角色影片
belt app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://presenter-photo.jpg",
  "audio_url": "<audio-url-from-step-1>"
}'

提示:對於大多數使用案例,具有內建 TTS 的 P-Video-Avatar 更簡單 — 無需單獨的音訊步驟。僅在您特別需要 OmniHuman(多角色)或 PixVerse(高度擬真唇形同步)時,才使用此工作流程。

完整工作流程:為影片添加另一種語言配音

# 1. 轉寫原始影片
belt app run infsh/fast-whisper-large-v3 --input '{"audio_url": "https://video.mp4"}' > transcript.json

# 2. 翻譯文字(手動或使用 LLM)

# 3. 以新語言產生語音
belt app run infsh/kokoro-tts --input '{"text": "<translated-text>"}' > new_speech.json

# 4. 將原始影片與新音訊進行唇形同步
belt app run infsh/latentsync-1-6 --input '{
  "video_url": "https://original-video.mp4",
  "audio_url": "<new-audio-url>"
}'

虛擬角色 UGC 生成

使用 P-Video-Avatar 建立 UGC 風格的內容 — 內建 TTS,無需單獨的音訊步驟:

# 1. 生成一張具有親和力的 UGC 風格肖像照
belt app run pruna/p-image --input '{
  "prompt": "casual selfie-style photo of a young woman in a cozy room, natural lighting, looking at camera, warm smile, authentic feel",
  "aspect_ratio": "9:16"
}'

# 2. 使用內建 TTS 建立 UGC 虛擬角色影片
belt app run pruna/p-video-avatar --input '{
  "image": "<image-url-from-step-1>",
  "voice_script": "Okay so I just tried this product and honestly? It is a game changer. I was not expecting to love it this much but here we are!",
  "voice": "Zephyr (Female)",
  "voice_prompt": "Excited, casual, authentic tone like talking to a friend",
  "video_prompt": "The person is talking casually to camera in their room, natural gestures",
  "resolution": "1080p"
}'

為什麼 P-Video-Avatar 適用於 UGC

  • 一體化 — 內建 TTS,無需單獨的音訊生成步驟
  • 30 種聲音、10 種語言 — 貼合您的目標受眾
  • 語音 + 影片提示 — 獨立控制語調、情緒、肢體語言和背景
  • 快 18 倍、便宜 6 倍 — 相較於 Fabric/OmniHuman/HeyGen,可大規模產出 UGC
  • 支援 1080p — 單張肖像照即可生成可供平台使用的直式影片

批次 UGC:相同產品,不同主持人

# 生成 3 位不同的主持人
for voice in "Zephyr (Female)" "Puck (Male)" "Aoede (Female)"; do
  belt app run pruna/p-video-avatar --input "{
    \"image\": \"https://portrait.jpg\",
    \"voice_script\": \"This changed my morning routine completely. Five minutes and I am done.\",
    \"voice\": \"$voice\",
    \"voice_prompt\": \"Casual, authentic, like a real testimonial\",
    \"video_prompt\": \"Person talking to camera in a bright kitchen\",
    \"resolution\": \"1080p\"
  }"
done

使用案例

  • UGC 與行銷:產品示範、使用 AI 主持人的 UGC 風格廣告
  • 教育:課程影片、解說
  • 本地化:使用一張圖片為 10 種語言的內容進行配音
  • 社群媒體:持續的虛擬網紅內容
  • 企業:培訓影片、公告
  • 遊戲:角色化身、NPC 對話

提示

  • 使用高品質的肖像照(正面、光線良好)
  • 音訊應清晰且背景噪音最小化
  • P-Video-Avatar 支援內建 TTS — 無需單獨的語音生成步驟
  • P-Video-Avatar 的輸出寬高比與輸入圖片相符
  • 使用 pruna/p-image 搭配 9:16 寬高比生成直式影片的肖像照
  • OmniHuman 1.5 支援單張圖片中的多個人
  • LatentSync 最適合將現有影片與新音訊同步

相關技能

# 專屬 P-Video-Avatar 技能
npx skills add inference-sh/skills@p-video-avatar

# 完整平台技能(250+ 應用)
npx skills add inference-sh/skills@infsh-cli

# 文字轉語音(為非 TTS 虛擬角色模型產生音訊)
npx skills add inference-sh/skills@text-to-speech

# 語音轉文字(為配音進行轉寫)
npx skills add inference-sh/skills@speech-to-text

# 影片生成
npx skills add inference-sh/skills@ai-video-generation

# 圖片生成(建立虛擬角色圖片)
npx skills add inference-sh/skills@ai-image-generation

瀏覽所有影片應用:belt app store --category video

文件

Individual skills in this repo

This repo contains 20 individual skills — each has its own dedicated page.

NeverSight/learn-skills.dev

Use when generating or modifying Remotion video code, creating demo videos, or working with the demo-video/ directory

NeverSight/learn-skills.dev

Create AI marketing videos for ads, promos, product launches, and brand content. Models: Veo, Seedance, Wan, FLUX for visuals, Kokoro for voiceover. Types: product demos, testimonials, explainers, social ads, brand videos. Use for: Facebook ads, YouTube ads, product launches, brand awareness. Triggers: marketing video, ad video, promo video, commercial, brand video, product video, explainer video, ad creative, video ad, facebook ad video, youtube ad, instagram ad, tiktok ad, promotional video, launch video

NeverSight/learn-skills.dev

Generate AI videos with Google Veo, Seedance 2.0, HappyHorse, Wan, Grok and 40+ models via inference.sh CLI. Models: Veo 3.1, Veo 3, Seedance 2.0, HappyHorse 1.0, Wan 2.5, Grok Imagine Video, OmniHuman, Fabric, HunyuanVideo. Capabilities: text-to-video, image-to-video, reference-to-video, video editing, lipsync, avatar animation, video upscaling, foley sound. Use for: social media videos, marketing content, explainer videos, product demos, AI avatars. Triggers: video generation, ai video, text to video, image to video, veo, animate image, video from image, ai animation, video generator, generate video, t2v, i2v, ai video maker, create video with ai, runway alternative, pika alternative, sora alternative, kling alternative, seedance, happyhorse

NeverSight/learn-skills.dev

ElevenLabs automatic dubbing - translate and dub audio/video into 29 languages while preserving speaker voice via inference.sh CLI. Capabilities: auto speaker detection, voice-preserving translation, video dubbing, audio localization. Use for: content localization, video translation, multilingual content, international distribution. Triggers: dubbing, dub video, translate audio, video translation, audio translation, localize content, elevenlabs dubbing, eleven labs dub, multilingual dub, voice translation, auto dub, language dub, content localization

NeverSight/learn-skills.dev

Explainer video production guide: scripting, voiceover, visuals, and assembly. Covers script formulas, pacing rules, scene planning, and multi-tool pipelines. Use for: product demos, how-it-works videos, onboarding videos, social explainers. Triggers: explainer video, how to make explainer, product video, demo video, video production, video script, animated explainer, product demo video, tutorial video, onboarding video, walkthrough video, video pipeline

NeverSight/learn-skills.dev

Still-to-video conversion guide: model selection, motion prompting, and camera movement. Covers Wan 2.5 i2v, Seedance, Fabric, Grok Video with when to use each. Use for: animating images, creating video from stills, adding motion, product animations. Triggers: image to video, i2v, animate image, still to video, add motion to image, image animation, photo to video, animate still, wan i2v, image2video, bring image to life, animate photo, motion from image

NeverSight/learn-skills.dev

Generate talking head avatar videos with Pruna P-Video-Avatar via inference.sh CLI. Turn a portrait image into a realistic speaking video with built-in TTS. 18x faster and 6x cheaper than competitors. Models: P-Video-Avatar, P-Image (for portrait generation). Capabilities: text-to-avatar, audio-driven avatars, 30 voices, 10 languages, 720p/1080p, built-in TTS, dynamic backgrounds, full-body control. Use for: AI presenters, product demos, explainer videos, virtual influencers, marketing, education, multilingual content, UGC, gaming avatars. Triggers: avatar video, talking head, ai avatar, p-video-avatar, pruna avatar, video avatar, ai presenter, digital human, virtual presenter, lipsync, talking avatar, ai spokesperson, heygen alternative, synthesia alternative, veed alternative, fabric alternative, omnihuman alternative

NeverSight/learn-skills.dev

Generate videos with Pruna P-Video and WAN models via inference.sh CLI. Models: P-Video, WAN-T2V, WAN-I2V. Capabilities: text-to-video, image-to-video, audio support, 720p/1080p, fast inference. Pruna optimizes models for speed without quality loss. Triggers: pruna video, p-video, pruna ai video, fast video generation, optimized video, wan t2v, wan i2v, economic video generation, cheap video generation, pruna text to video, pruna image to video

NeverSight/learn-skills.dev

Render videos from React/Remotion component code via inference.sh. Pass TSX code, get MP4. Supports all Remotion APIs: useCurrentFrame, useVideoConfig, spring, interpolate, AbsoluteFill, Sequence. Configurable resolution, FPS, duration, codec. Use for: programmatic video generation, animated graphics, motion design, data-driven videos, React animations to video. Triggers: remotion, render video from code, tsx to video, react video, programmatic video, remotion render, code to video, animated video, motion graphics code, react animation video

NeverSight/learn-skills.dev

Video ad creation with exact platform-specific specs for TikTok, Instagram, YouTube, Facebook, LinkedIn. Covers dimensions, duration limits, AIDA framework, and caption requirements. Use for: video ads, social media ads, paid media creative, video marketing, ad production. Triggers: video ad, social media ad, tiktok ad, instagram ad, youtube ad, facebook ad, linkedin ad, video creative, ad specs, paid media, video marketing, ad production, reels ad, stories ad, pre roll, bumper ad

NeverSight/learn-skills.dev

Best practices and techniques for writing effective AI video generation prompts. Covers: Veo, Seedance, Wan, Grok, Kling, Runway, Pika, Sora prompting strategies. Learn: shot types, camera movements, lighting, pacing, style keywords, negative prompts. Use for: improving video quality, getting consistent results, professional video prompts. Triggers: video prompt, how to prompt video, veo prompts, video generation tips, better ai video, video prompt engineering, video prompt guide, video prompt template, ai video tips, video prompt best practices, video prompt examples, cinematography prompts

NeverSight/learn-skills.dev

YouTube thumbnail design with specific dimensions, contrast rules, and mobile preview optimization. Covers safe zones, text placement, face expression psychology, and A/B testing. Use for: YouTube thumbnails, video cover images, click-through optimization. Triggers: youtube thumbnail, thumbnail design, video thumbnail, click through rate, ctr optimization, youtube cover, video cover image, thumbnail maker, thumbnail tips, youtube design, video preview image

NeverSight/learn-skills.dev

Landing page conversion optimization with layout rules, hero section design, and CTA psychology. Covers above-the-fold formula, social proof placement, mobile design, and F-pattern reading. Use for: startup landing pages, product pages, SaaS marketing, conversion optimization. Triggers: landing page, hero section, above the fold, conversion optimization, landing page design, cta button, hero image, landing page layout, saas landing page, product page design, conversion rate, landing page best practices

NeverSight/learn-skills.dev

Configure and use the hosted YouTube Data MCP end-to-end with minimal user input. Use when users want the agent to verify Node.js and `npx`, configure MCP server config (Windows/macOS, Cursor/Codex/OpenClaw/OpenCode), request API key at setup time, run post-install capability discovery (`tools/list` and `get_patch_notes`), and then strongly recommend helper skill and Python setup for full local document and spreadsheet workflows.

NeverSight/learn-skills.dev

Creates 120fps GPU-accelerated animations with Motion.dev (Framer Motion successor) for React, Next.js, Svelte, and Astro projects. Use when user requests animation, motion, scroll effects, parallax, hero animations, gestures, drag interactions, spring physics, whileHover effects, whileInView animations, animated UI, micro-interactions, page transitions, or layout animations. Generates production TypeScript/JSX code with accessibility (prefers-reduced-motion) and performance validation (≥60fps). Supports entrance animations, gesture interactions (hover/tap/drag), scroll-based reveals, and layout transitions using spring physics and natural timing. Do NOT use for CSS-only transitions (use native CSS), static sites without JavaScript, Vue animations (use motion-v variant instead), or SVG/Canvas complex animations (GSAP better suited).

NeverSight/learn-skills.dev

Static artifact craft skill for self-contained HTML/CSS/JS documents: docs, sheets, dashboards, explainers, slides, tools, and landing pages. Use when the user asks for a durable, openable, shareable web deliverable they'll keep or hand off — a report, a dashboard, a slide deck, a data table, a page. Local folder first, temporary public link via tunnel (localhost.run), optional durable publish to Surge, GitHub Pages, or Cloudflare. Not for quick look renders, inline snippets, or throwaway scratch. Not for SPA frameworks, backend APIs, database apps, or production product UI.

NeverSight/learn-skills.dev

FFmpeg commands for video/audio conversion, trimming, compression, and processing. Use when user mentions "ffmpeg", "convert video", "compress video", "extract audio", "trim video", "gif from video", "video codec", "transcode", "screen recording", "merge videos", "video to mp4", "reduce file size", or any media processing task.

NeverSight/learn-skills.dev

Vim keybindings, motions, text objects, and operators for efficient text editing. Use when user asks about "vim commands", "vim motions", "text objects", "vim keybindings", "vim cheat sheet", "learn vim", "vim in VS Code", or any Vim editing tasks.

NeverSight/learn-skills.dev

Download YouTube videos, extract/proofread/translate subtitles, and render them onto video. Use whenever the user asks to download a YouTube video with subtitles, translate video subtitles to Chinese, add subtitles/burn subtitles to a video, or do ASR transcription on video audio. Covers the full pipeline: video download → subtitle extraction → proofreading → translation → SRT generation → subtitle rendering. Also use for "下载视频加字幕", "视频翻译字幕", "把字幕烧录到视频中". For pure subtitle file creation without rendering (just SRT output), this skill handles that too — stop before Phase 5.

NeverSight/learn-skills.dev

Grok Build ONLY. Turn a 2D character still into smooth animation sprites via image_gen/image_edit base → image_to_video (6s/10s run-in-place) → ffmpeg frames → magenta chroma-key → dense sampled sprites (strip/grid/GIF). Use when the user wants video-to-sprite, motion capture from generated video, smoother run/walk cycles from dense frames, or runs /video2dsprite. Do NOT use on Codex/Claude — only Grok Build has image_to_video. Prefer generate2dsprite for crisp pixel sheets without video.

相關技能