Communitygithub.com

AI 頭像與說話頭影片生成

透過 inference.sh CLI 使用 OmniHuman、Fabric、PixVerse 等模型建立 AI 頭像和說話頭影片。

AI 頭像與說話頭影片生成 是什麼?

這項技能讓開發者能夠透過命令行介面 (CLI) 快速生成 AI 頭像和說話頭影片,非常適合用於 AI 主播、解說影片、虛擬網紅、配音與行銷影片等場景。技能支援多種先進模型,包括 ByteDance 的 OmniHuman 1.5(多角色、高品質)、OmniHuman 1.0(單角色)、Fabric 1.0(圖像說話)以及 PixVerse Lipsync(高真實度唇形同步)。使用者只需提供一張肖像圖片與一段音訊,即可產生頭像影片;此外還可與文字轉語音 (TTS) 和語音轉文字 (STT) 技能整合,實現從文字到影片的完整工作流程。該技能依賴 inference.sh CLI 工具,適合在自動化腳本或 CI/CD 流程中使用。

相容平台✓Claude Code~Codex CLI~Cursor
npx skills add https://github.com/AngelescuCiprian/claude-skills/tree/HEAD/.agents/skills/ai-avatar-video

在你喜歡的 AI 中提問

開啟一個已預先載入此 Agent Skill 的新對話。

預覽

來自技能 README

AI 頭像與說話頭影片

說明文件

AI 頭像與說話頭影片

透過 inference.sh CLI 建立 AI 頭像和說話頭影片。

AI 頭像與說話頭影片

快速開始

需要 inference.sh CLI (infsh)。安裝說明

infsh login

# 從圖片 + 音訊建立頭像影片
infsh app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

可用模型

模型應用 ID最佳用途
OmniHuman 1.5bytedance/omnihuman-1-5多角色、最佳品質
OmniHuman 1.0bytedance/omnihuman-1-0單一角色
Fabric 1.0falai/fabric-1-0圖像說話(唇形同步)
PixVerse Lipsyncfalai/pixverse-lipsync高度真實的唇形同步

搜尋頭像應用

infsh app list --search "omnihuman"
infsh app list --search "lipsync"
infsh app list --search "fabric"

範例

OmniHuman 1.5(多角色)

infsh app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

支援在多人物圖片中指定要驅動的角色。

Fabric 1.0(圖像說話)

infsh app run falai/fabric-1-0 --input '{
  "image_url": "https://face.jpg",
  "audio_url": "https://audio.mp3"
}'

PixVerse Lipsync

infsh app run falai/pixverse-lipsync --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

從任何音訊生成高度真實的唇形同步。

完整工作流程:TTS + 頭像

# 1. 從文字生成語音
infsh app run infsh/kokoro-tts --input '{
  "prompt": "歡迎來到我們的產品示範。今天我將向您展示..."
}' > speech.json

# 2. 利用該語音建立頭像影片
infsh app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://presenter-photo.jpg",
  "audio_url": "<audio-url-from-step-1>"
}'

完整工作流程:以另一種語言配音影片

# 1. 轉錄原始影片
infsh app run infsh/fast-whisper-large-v3 --input '{"audio_url": "https://video.mp4"}' > transcript.json

# 2. 翻譯文字(手動或使用 LLM)

# 3. 以新語言生成語音
infsh app run infsh/kokoro-tts --input '{"text": "<translated-text>"}' > new_speech.json

# 4. 將原始影片與新音訊進行唇形同步
infsh app run infsh/latentsync-1-6 --input '{
  "video_url": "https://original-video.mp4",
  "audio_url": "<new-audio-url>"
}'

使用案例

  • 行銷:使用 AI 主播的產品示範影片
  • 教育:課程影片、解說影片
  • 本地化:以多種語言配音內容
  • 社群媒體:一致的虛擬網紅
  • 企業:培訓影片、公告

提示

  • 使用高品質的肖像照片(正面、光線良好)
  • 音訊應清晰,背景噪音盡量低
  • OmniHuman 1.5 支援一張圖片中有多人
  • LatentSync 最適合將現有影片同步到新音訊

相關技能

# 完整平台技能(150+ 個應用)
npx skills add inference-sh/skills@infsh-cli

# 文字轉語音(為頭像生成音訊)
npx skills add inference-sh/skills@text-to-speech

# 語音轉文字(為配音轉錄)
npx skills add inference-sh/skills@speech-to-text

# 影片生成
npx skills add inference-sh/skills@ai-video-generation

# 圖片生成(建立頭像圖片)
npx skills add inference-sh/skills@ai-image-generation

瀏覽所有影片應用:infsh app list --category video

文件

Individual skills in this repo

This repo contains 12 individual skills — each has its own dedicated page.

AngelescuCiprian/claude-skills

Create AI marketing videos for ads, promos, product launches, and brand content. Models: Veo, Seedance, Wan, FLUX for visuals, Kokoro for voiceover. Types: product demos, testimonials, explainers, social ads, brand videos. Use for: Facebook ads, YouTube ads, product launches, brand awareness. Triggers: marketing video, ad video, promo video, commercial, brand video, product video, explainer video, ad creative, video ad, facebook ad video, youtube ad, instagram ad, tiktok ad, promotional video, launch video

AngelescuCiprian/claude-skills

Generate AI videos with Google Veo, Seedance, Wan, Grok and 40+ models via inference.sh CLI. Models: Veo 3.1, Veo 3, Seedance 1.5 Pro, Wan 2.5, Grok Imagine Video, OmniHuman, Fabric, HunyuanVideo. Capabilities: text-to-video, image-to-video, lipsync, avatar animation, video upscaling, foley sound. Use for: social media videos, marketing content, explainer videos, product demos, AI avatars. Triggers: video generation, ai video, text to video, image to video, veo, animate image, video from image, ai animation, video generator, generate video, t2v, i2v, ai video maker, create video with ai, runway alternative, pika alternative, sora alternative, kling alternative

AngelescuCiprian/claude-skills

ElevenLabs text-to-speech with 22+ premium voices, multilingual support, and voice tuning via inference.sh CLI. Models: eleven_multilingual_v2 (highest quality), eleven_turbo_v2_5 (low latency), eleven_flash_v2_5 (ultra-fast). Capabilities: text-to-speech, voice selection, stability/style control, 32 languages. Use for: voiceovers, audiobooks, video narration, podcasts, accessibility, IVR. Triggers: elevenlabs, eleven labs, elevenlabs tts, premium tts, professional voice, ai voice, high quality tts, multilingual tts, eleven labs voice, voice generation, natural speech, realistic voice, voice over, speech synthesis

AngelescuCiprian/claude-skills

Explainer video production guide: scripting, voiceover, visuals, and assembly. Covers script formulas, pacing rules, scene planning, and multi-tool pipelines. Use for: product demos, how-it-works videos, onboarding videos, social explainers. Triggers: explainer video, how to make explainer, product video, demo video, video production, video script, animated explainer, product demo video, tutorial video, onboarding video, walkthrough video, video pipeline

AngelescuCiprian/claude-skills

Still-to-video conversion guide: model selection, motion prompting, and camera movement. Covers Wan 2.5 i2v, Seedance, Fabric, Grok Video with when to use each. Use for: animating images, creating video from stills, adding motion, product animations. Triggers: image to video, i2v, animate image, still to video, add motion to image, image animation, photo to video, animate still, wan i2v, image2video, bring image to life, animate photo, motion from image

AngelescuCiprian/claude-skills

Landing page conversion optimization with layout rules, hero section design, and CTA psychology. Covers above-the-fold formula, social proof placement, mobile design, and F-pattern reading. Use for: startup landing pages, product pages, SaaS marketing, conversion optimization. Triggers: landing page, hero section, above the fold, conversion optimization, landing page design, cta button, hero image, landing page layout, saas landing page, product page design, conversion rate, landing page best practices

AngelescuCiprian/claude-skills

Generate videos with Pruna P-Video and WAN models via inference.sh CLI. Models: P-Video, WAN-T2V, WAN-I2V. Capabilities: text-to-video, image-to-video, audio support, 720p/1080p, fast inference. Pruna optimizes models for speed without quality loss. Triggers: pruna video, p-video, pruna ai video, fast video generation, optimized video, wan t2v, wan i2v, economic video generation, cheap video generation, pruna text to video, pruna image to video

AngelescuCiprian/claude-skills

Best practices for Remotion - Video creation in React

AngelescuCiprian/claude-skills

Render videos from React/Remotion component code via inference.sh. Pass TSX code, get MP4. Supports all Remotion APIs: useCurrentFrame, useVideoConfig, spring, interpolate, AbsoluteFill, Sequence. Configurable resolution, FPS, duration, codec. Use for: programmatic video generation, animated graphics, motion design, data-driven videos, React animations to video. Triggers: remotion, render video from code, tsx to video, react video, programmatic video, remotion render, code to video, animated video, motion graphics code, react animation video

AngelescuCiprian/claude-skills

Video ad creation with exact platform-specific specs for TikTok, Instagram, YouTube, Facebook, LinkedIn. Covers dimensions, duration limits, AIDA framework, and caption requirements. Use for: video ads, social media ads, paid media creative, video marketing, ad production. Triggers: video ad, social media ad, tiktok ad, instagram ad, youtube ad, facebook ad, linkedin ad, video creative, ad specs, paid media, video marketing, ad production, reels ad, stories ad, pre roll, bumper ad

AngelescuCiprian/claude-skills

Best practices and techniques for writing effective AI video generation prompts. Covers: Veo, Seedance, Wan, Grok, Kling, Runway, Pika, Sora prompting strategies. Learn: shot types, camera movements, lighting, pacing, style keywords, negative prompts. Use for: improving video quality, getting consistent results, professional video prompts. Triggers: video prompt, how to prompt video, veo prompts, video generation tips, better ai video, video prompt engineering, video prompt guide, video prompt template, ai video tips, video prompt best practices, video prompt examples, cinematography prompts

AngelescuCiprian/claude-skills

YouTube thumbnail design with specific dimensions, contrast rules, and mobile preview optimization. Covers safe zones, text placement, face expression psychology, and A/B testing. Use for: YouTube thumbnails, video cover images, click-through optimization. Triggers: youtube thumbnail, thumbnail design, video thumbnail, click through rate, ctr optimization, youtube cover, video cover image, thumbnail maker, thumbnail tips, youtube design, video preview image

相關技能