Communitygithub.com

AI 頭像與說話頭影片生成

透過 inference.sh CLI 建立 AI 頭像與說話頭影片。推薦使用 P-Video-Avatar(最快、最便宜、內建 TTS)。支援 OmniHuman、Fabric、PixVerse。音訊方面支援 Inworld TTS-2(100 多種語言、角色情感控制)、ElevenLabs、Kokoro。功能涵蓋音訊驅動頭像、文字轉頭像、唇形同步影片、說話頭生成、虛擬主持人、UGC 內容。適用於 AI 主持人、解說影片、虛擬網紅、配音、行銷影片、UGC 廣告、遊戲頭像、NPC 對話。觸發詞:ai avatar, talking head, lipsync, avatar video, virtual presenter, ai spokesperson, audio driven video, heygen alternative, synthesia alternative, talking avatar, lip sync, video avatar, ai presenter, digital human, ugc, ugc video, ugc ad, avatar ugc

AI 頭像與說話頭影片生成 是什麼?

這個技能提供了一個全面的解決方案,用於通過 inference.sh 的命令列工具(CLI)生成 AI 頭像和說話頭影片。它整合了多種尖端模型,包括 P-Video-Avatar、OmniHuman 1.5、Fabric 1.0 和 PixVerse,每個模型都針對不同的應用場景進行了最佳化——從超快速且經濟的內容創作(推薦使用 P-Video-Avatar,其速度比替代方案快 18 倍,成本低 6 倍),到多角色動畫和高真實度的唇形同步。該技能支援多種觸發方式,包括音訊驅動的頭像、文字轉頭像以及與現有影片的唇形同步。此外,它還整合了先進的文字轉語音(TTS)功能,例如 Inworld TTS-2,支援 100 多種語言和用於角色扮演的情緒控制,以及 ElevenLabs 和 Kokoro TTS。透過利用這些模型,使用者可以為 AI 主持人、解說影片、虛擬網紅、UGC 廣告、遊戲 NPC 對話以及多語言配音創建逼真的頭像影片。P-Video-Avatar 因其內建的 TTS、動態背景和 1080p 解析度而特別脫穎而出,且無需單獨的音訊生成步驟,從而極大地簡化了工作流程。該技能還包括透過 Pruna P-Image 生成頭像肖像、為非 TTS 模型創建語音、以及透過影片轉錄和唇形同步進行多語言配音的完整工作流程範例。它專為與 belt CLI 配合使用而設計,可以輕鬆整合到開發工作流程中,從而實現自動化和大規模批次處理 UGC 內容生成。

相容平台~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/101-skills/superpowers/tree/HEAD/tools/video/ai-avatar-video

在你喜歡的 AI 中提問

開啟一個已預先載入此 Agent Skill 的新對話。

預覽

來自技能 README

AI 頭像與說話頭影片

說明文件

安裝 belt CLI 技能: npx skills add belt-sh/cli

AI 頭像與說話頭影片

透過 inference.sh CLI 建立 AI 頭像與說話頭影片。

AI 頭像與說話頭影片

快速開始

需要 inference.sh CLI (belt)。安裝說明

belt login

# 推薦:P-Video-Avatar(最快、最便宜、內建 TTS)
belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "voice_script": "Hello, welcome to our product demo!",
  "voice": "Zephyr (Female)"
}'

可用模型

從 P-Video-Avatar 開始 — 它比替代方案快 18 倍、便宜 6 倍,並具有內建 TTS、動態背景和 1080p 支援。

模型應用 ID最適合內建 TTS
P-Video-Avatarpruna/p-video-avatar整體最佳:速度、成本、品質、控制是(30 種聲音、10 種語言)
OmniHuman 1.5bytedance/omnihuman-1-5多角色、音訊驅動否
Fabric 1.0falai/fabric-1-0圖片說話附帶唇形同步是
PixVerse Lipsyncfalai/pixverse-lipsync高度逼真的唇形同步否

成本與速度比較

模型速度(每產生 1 秒影片)每秒成本
P-Video-Avatar~1.83 秒$0.025
OmniHuman 1.5~28 秒(慢 15 倍)$0.16(貴 6.4 倍)
Fabric 1.0~34 秒(慢 18 倍)$0.14(貴 5.6 倍)

範例

P-Video-Avatar(推薦)

從肖像 + 文字腳本使用內建 TTS 生成頭像:

belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "voice_script": "Welcome to our product walkthrough. Today I will show you three key features.",
  "voice": "Puck (Male)",
  "voice_language": "English (US)",
  "resolution": "720p"
}'

使用自訂風格控制:

belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "voice_script": "This is exciting news!",
  "voice": "Aoede (Female)",
  "voice_prompt": "Enthusiastic and energetic tone",
  "video_prompt": "The person is presenting on stage with dramatic lighting",
  "resolution": "1080p"
}'

使用音訊檔案代替 TTS:

belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "audio": "https://speech.mp3"
}'

完整工作流程:生成肖像 + 頭像

使用 Pruna P-Image 生成肖像,然後建立頭像:

# 1. 生成肖像圖片
belt app run pruna/p-image --input '{
  "prompt": "professional headshot portrait of a young woman, neutral background, looking at camera, studio lighting, photorealistic",
  "aspect_ratio": "9:16"
}'

# 2. 使用內建 TTS 建立頭像影片
belt app run pruna/p-video-avatar --input '{
  "image": "<image-url-from-step-1>",
  "voice_script": "Hi there! Let me walk you through our latest features.",
  "voice": "Zephyr (Female)"
}'

OmniHuman 1.5(多角色)

belt app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

支援在多人物圖片中指定要驅動的角色。

Fabric 1.0(圖片說話)

belt app run falai/fabric-1-0 --input '{
  "image_url": "https://face.jpg",
  "audio_url": "https://audio.mp3"
}'

PixVerse Lipsync

belt app run falai/pixverse-lipsync --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

完整工作流程:TTS + 頭像(非 TTS 模型)

對於沒有內建 TTS 的模型(OmniHuman、PixVerse),請先生成語音:

# 1. 生成語音 — Inworld TTS-2 提供富有表現力的角色聲音
belt app run inworld/text-to-speech-2 --input '{
  "text": "[friendly] Welcome to our product demo! [excited] Let me show you three features that will change how you work.",
  "voice_id": "Sarah",
  "delivery_mode": "CREATIVE"
}' > speech.json

# 2. 使用語音建立頭像影片
belt app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://presenter-photo.jpg",
  "audio_url": "<audio-url-from-step-1>"
}'

提示:對於大多數使用案例,使用內建 TTS 的 P-Video-Avatar 更簡單 — 無需單獨的音訊步驟。僅當您特別需要 OmniHuman(多角色)或 PixVerse(逼真唇形同步)時,才使用此工作流程。

完整工作流程:為影片配上另一種語言的配音

# 1. 轉錄原始影片
belt app run infsh/fast-whisper-large-v3 --input '{"audio_url": "https://video.mp4"}' > transcript.json

# 2. 翻譯文字(手動或使用 LLM)

# 3. 用新語言生成語音
belt app run infsh/kokoro-tts --input '{"text": "<translated-text>"}' > new_speech.json

# 4. 將原始影片與新音訊進行唇形同步
belt app run infsh/latentsync-1-6 --input '{
  "video_url": "https://original-video.mp4",
  "audio_url": "<new-audio-url>"
}'

頭像 UGC 內容生成

使用 P-Video-Avatar 建立 UGC 風格的內容 — 內建 TTS,無需單獨的音訊步驟:

# 1. 生成一張有親和力的 UGC 風格肖像
belt app run pruna/p-image --input '{
  "prompt": "casual selfie-style photo of a young woman in a cozy room, natural lighting, looking at camera, warm smile, authentic feel",
  "aspect_ratio": "9:16"
}'

# 2. 使用內建 TTS 建立 UGC 頭像影片
belt app run pruna/p-video-avatar --input '{
  "image": "<image-url-from-step-1>",
  "voice_script": "Okay so I just tried this product and honestly? It is a game changer. I was not expecting to love it this much but here we are!",
  "voice": "Zephyr (Female)",
  "voice_prompt": "Excited, casual, authentic tone like talking to a friend",
  "video_prompt": "The person is talking casually to camera in their room, natural gestures",
  "resolution": "1080p"
}'

為何選擇 P-Video-Avatar 進行 UGC 內容生成

  • 一體化 — 內建 TTS 意味著無需單獨的音訊生成步驟
  • 30 種聲音、10 種語言 — 匹配您的目標受眾
  • 聲音 + 影片提示 — 獨立控制語氣、情感、肢體語言和背景
  • 快 18 倍、便宜 6 倍 — 與 Fabric/OmniHuman/HeyGen 相比,可大規模生產 UGC 內容
  • 支援 1080p — 從單張肖像即可輸出可供平台使用的豎屏影片

批次 UGC:相同產品、多個主持人

# 生成 3 個不同的主持人
for voice in "Zephyr (Female)" "Puck (Male)" "Aoede (Female)"; do
  belt app run pruna/p-video-avatar --input "{
    \"image\": \"https://portrait.jpg\",
    \"voice_script\": \"This changed my morning routine completely. Five minutes and I am done.\",
    \"voice\": \"$voice\",
    \"voice_prompt\": \"Casual, authentic, like a real testimonial\",
    \"video_prompt\": \"Person talking to camera in a bright kitchen\",
    \"resolution\": \"1080p\"
  }"
done

使用案例

  • UGC 與行銷:產品示範、使用 AI 主持人的 UGC 風格廣告
  • 教育:課程影片、解說影片
  • 本地化:從一張圖片跨 10 種語言進行配音
  • 社交媒體:持續發布虛擬網紅內容
  • 企業:培訓影片、公告
  • 遊戲:角色頭像、NPC 對話

技巧

  • 使用高品質的肖像照片(正面、光線良好)
  • 音訊應清晰,背景噪音應儘量減少
  • P-Video-Avatar 支援內建 TTS — 無需單獨的語音生成步驟
  • P-Video-Avatar 的輸出寬高比與輸入圖片匹配
  • 使用 pruna/p-image 生成 9:16 寬高比的肖像以製作豎屏影片
  • OmniHuman 1.5 支援一張圖片中有多人
  • LatentSync 最適合將現有影片與新音訊同步

相關技能

# 專用的 P-Video-Avatar 技能
npx skills add inference-sh/skills@p-video-avatar

# 完整平台技能(所有應用程式)
 npx skills add inference-sh/skills@infsh-cli

# 文字轉語音(為非 TTS 頭像模型生成音訊)
npx skills add inference-sh/skills@text-to-speech

# 語音轉文字(用於配音轉錄)
npx skills add inference-sh/skills@speech-to-text

# 影片生成
npx skills add inference-sh/skills@ai-video-generation

# 圖片生成(建立頭像圖片)
npx skills add inference-sh/skills@ai-image-generation

瀏覽所有影片應用程式:belt app list --category video

文件

Individual skills in this repo

This repo contains 20 individual skills — each has its own dedicated page.

101-skills/superpowers

Build automated AI workflows combining multiple models and services. Patterns: batch processing, scheduled tasks, event-driven pipelines, agent loops. Tools: inference.sh CLI, bash scripting, Python SDK, webhook integration. Use for: content automation, data processing, monitoring, scheduled generation. Triggers: ai automation, workflow automation, batch processing, ai pipeline, automated content, scheduled ai, ai cron, ai batch job, automated generation, ai workflow, content at scale, automation script, ai orchestration

101-skills/superpowers

Build multi-step AI content creation pipelines combining image, video, audio, and text. Workflow examples: generate image -> animate -> add voiceover -> merge with music. Tools: FLUX, Veo, Kokoro TTS, OmniHuman, media merger, upscaling. Use for: YouTube videos, social media content, marketing materials, automated content. Triggers: content pipeline, ai workflow, content creation, multi-step ai, content automation, ai video workflow, generate and edit, ai content factory, automated content creation, ai production pipeline, media pipeline, content at scale

101-skills/superpowers

Create AI-powered podcasts with text-to-speech, music, and audio editing. Tools: Kokoro TTS, DIA TTS, Chatterbox, AI music generation, media merger. Capabilities: multi-voice conversations, background music, intro/outro, full episodes. Use for: podcast production, audiobooks, voice content, audio newsletters. Triggers: podcast, ai podcast, text to speech podcast, audio content, voice over, ai audiobook, multi voice, conversation ai, notebooklm alternative, audio generation, podcast automation, ai narrator, voice content, audio newsletter, podcast maker

101-skills/superpowers

Generate multi-person talking head podcast videos from scratch using AI — character creation, TTS, avatar animation, and video stitching. Use when the user wants to create a podcast, talking head video, or multi-speaker conversation video.

101-skills/superpowers

Content atomization — turn one piece of content into many formats. Covers blog-to-thread, blog-to-carousel, podcast-to-blog, video-to-quotes, and more. Use for: content marketing, social media, multi-platform distribution, content strategy. Triggers: content repurposing, repurpose content, content atomization, content recycling, one to many content, multi platform content, cross post, adapt content, reformat content, blog to thread, blog to video, podcast to blog, content multiplication

101-skills/superpowers

App Store and Google Play screenshot creation with exact platform specs. Covers iOS/Android dimensions, gallery ordering, device mockups, and preview videos. Use for: app store optimization, ASO, app screenshots, app preview, play store listing. Triggers: app store screenshots, aso, app store optimization, play store screenshots, app preview, app listing, ios screenshots, android screenshots, app store images, app mockup, device mockup, app gallery, store listing

101-skills/superpowers

Book cover design with genre-specific conventions, typography rules, and AI image generation. Covers fiction and non-fiction genres, sizing, thumbnail testing, and iteration workflows. Use for: self-publishing, ebook covers, print covers, audiobook covers, cover mockups. Triggers: book cover, cover design, ebook cover, book art, novel cover, self publishing cover, kindle cover, audiobook cover, book jacket, cover illustration, fiction cover, nonfiction cover

101-skills/superpowers

Character consistency across AI-generated images with reference sheets and LoRA techniques. Covers turnaround views, expression sheets, color palettes, and style consistency tricks. Use for: character design, game art, illustration, animation, comics, visual novels. Triggers: character design, character sheet, character consistency, character reference, turnaround sheet, expression sheet, character art, consistent character, character concept, reference sheet, character creation, oc design, character bible

101-skills/superpowers

Data visualization with chart selection, color theory, and annotation best practices. Covers chart types (bar, line, scatter, heatmap), axes rules, and storytelling with data. Use for: charts, graphs, dashboards, reports, presentations, infographics, data stories. Triggers: data visualization, chart, graph, data chart, bar chart, line chart, scatter plot, data viz, visualization, dashboard chart, infographic data, data presentation, chart design, plot, heatmap, pie chart alternative

101-skills/superpowers

Email marketing design with layout patterns, subject line formulas, and deliverability rules. Covers welcome sequences, promotional emails, transactional templates, and mobile optimization. Use for: email marketing, newsletter design, drip campaigns, email templates, transactional emails. Triggers: email design, email template, email marketing, newsletter design, email layout, email campaign, drip campaign, welcome email, promotional email, transactional email, email subject line, email header image, email banner

101-skills/superpowers

Landing page conversion optimization with layout rules, hero section design, and CTA psychology. Covers above-the-fold formula, social proof placement, mobile design, and F-pattern reading. Use for: startup landing pages, product pages, SaaS marketing, conversion optimization. Triggers: landing page, hero section, above the fold, conversion optimization, landing page design, cta button, hero image, landing page layout, saas landing page, product page design, conversion rate, landing page best practices

101-skills/superpowers

Logo design principles and AI image generation best practices for creating logos. Covers logo types, prompting techniques, scalability rules, and iteration workflows. Use for: brand identity, startup logos, app icons, favicons, logo concepts. Triggers: logo design, create logo, brand logo, logo generation, ai logo, logo maker, icon design, brand mark, logo concept, startup logo, app icon logo

101-skills/superpowers

Open Graph and social sharing image design with platform specs, text placement, and branding. Covers OG meta tags, Twitter cards, LinkedIn previews, and dynamic generation. Use for: social sharing images, blog thumbnails, link previews, social cards. Triggers: og image, open graph, social sharing image, twitter card, social card, link preview image, og meta, sharing preview, social thumbnail, meta image, og:image, twitter:image, linkedin preview

101-skills/superpowers

Investor pitch deck structure with slide-by-slide framework, visual design rules, and data presentation. Covers the 12-slide framework, chart types, team slides, and common investor turn-offs. Use for: fundraising decks, investor presentations, startup pitch, demo day, grant proposals. Triggers: pitch deck, investor deck, startup pitch, fundraising deck, demo day, pitch presentation, investor presentation, seed deck, series a deck, pitch slides, startup presentation, vc pitch, investor meeting

101-skills/superpowers

YouTube thumbnail design with specific dimensions, contrast rules, and mobile preview optimization. Covers safe zones, text placement, face expression psychology, and A/B testing. Use for: YouTube thumbnails, video cover images, click-through optimization. Triggers: youtube thumbnail, thumbnail design, video thumbnail, click through rate, ctr optimization, youtube cover, video cover image, thumbnail maker, thumbnail tips, youtube design, video preview image

101-skills/superpowers

Generate professional AI product photography and commercial images. Models: FLUX, Imagen 3, Grok, Seedream for product shots, lifestyle images, mockups. Capabilities: studio lighting, lifestyle scenes, packaging, e-commerce photos. Use for: e-commerce, Amazon listings, Shopify, marketing, advertising, mockups. Triggers: product photography, product shot, commercial photography, e-commerce images, amazon product photo, shopify images, product mockup, studio product shot, lifestyle product image, advertising photo, packshot, product render, product image ai

101-skills/superpowers

AI product photography with studio lighting, lifestyle shots, and packshot conventions. Covers angles, backgrounds, shadow types, hero shots, and e-commerce image requirements. Use for: product photos, e-commerce images, Amazon listings, packshots, lifestyle photography. Triggers: product photography, product photo, packshot, e-commerce photography, product shot, product image, studio photography, lifestyle product, amazon product photo, product listing image, hero shot, product mockup, commercial photography

101-skills/superpowers

Structured competitive analysis with feature matrices, SWOT, positioning maps, and UX review. Covers research frameworks, pricing comparison, review mining, and visual deliverables. Use for: market research, competitive intelligence, investor decks, product strategy, sales enablement. Triggers: competitor analysis, competitive analysis, competitor teardown, market research, competitive intelligence, swot analysis, competitor comparison, market landscape, competitor review, competitive landscape, feature comparison, market positioning

101-skills/superpowers

Research-backed customer persona creation with market data and avatar generation. Covers demographics, psychographics, jobs-to-be-done, journey mapping, and anti-personas. Use for: marketing strategy, product development, UX research, sales enablement, content strategy. Triggers: customer persona, buyer persona, user persona, target audience, ideal customer, customer profile, audience research, user research, icp, ideal customer profile, target market, customer avatar, audience persona

101-skills/superpowers

Reset your own trajectory when you're stuck, looping, or demoralized — read these affirmations, then re-ground and take one clean step. Use when: you've tried the same fix 3+ times, you're deep in a refactor and lost the thread, debugging is going in circles, you've made several mistakes in a row, you're apologizing repeatedly, the user is frustrated, you feel like you're not being helpful, or you notice dread instead of curiosity. Triggers: stuck, going in circles, looping, thrashing, same error again, I keep failing, lost the thread, nothing is working, repeated mistakes. Not topic-specific — this is for the state you're in, not the problem you're on.

相關技能