Communitygithub.com

Aadi-110i/PEP-PROJECT

透過 inference.sh CLI 建立 AI 虛擬人物與說話頭影片。推薦使用 P-Video-Avatar(最快、最便宜、內建 TTS)。其他選項:OmniHuman、Fabric、PixVerse。功能包含:音訊驅動虛擬人物、文字轉虛擬人物、嘴型同步影片、說話頭生成、虛擬主持人。用途:AI 主持人、解說影片、虛擬網紅、配音、行銷影片。觸發詞:ai avatar、talking head、lipsync、avatar video、virtual presenter、ai spokesperson、audio driven video、heygen alternative、synthesia alternative、talking avatar、lip sync、video avatar、ai presenter、digital human。

PEP-PROJECT 是什麼?

此技能透過 inference.sh CLI 提供多種 AI 虛擬人物與說話頭影片生成模型,讓開發者能快速建立具備嘴型同步、音訊驅動或文字驅動的虛擬人物影片。技能推薦使用 P-Video-Avatar 模型,因其速度最快(比替代方案快 18 倍)、成本最低(便宜 6 倍),且內建 TTS,支援 30 種語音和 10 種語言。此外也整合 OmniHuman 1.5、Fabric 1.0 和 PixVerse Lipsync 等模型,滿足多角色、高真實度嘴型同步等不同需求。技能涵蓋完整工作流程:從人像生成、語音合成、文字轉語音,到最終的虛擬人物影片輸出,甚至支援多語言配音。支援 CLI 操作,適合用於行銷、教育、在地化、社群媒體、企業訓練及遊戲等場景。

相容平台~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/Aadi-110i/PEP-PROJECT/tree/HEAD/skills/ai-avatar-video

在你喜歡的 AI 中提問

開啟一個已預先載入此 Agent Skill 的新對話。

預覽

來自技能 README

AI 虛擬人物與說話頭影片

說明文件

AI 虛擬人物與說話頭影片

透過 inference.sh CLI 建立 AI 虛擬人物和說話頭影片。

AI 虛擬人物與說話頭影片

快速開始

需要 inference.sh CLI(belt)。安裝說明

belt login

# 推薦:P-Video-Avatar(最快、最便宜、內建 TTS)
belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "voice_script": "您好,歡迎來到我們的產品示範!",
  "voice": "Zephyr (Female)"
}'

可用模型

從 P-Video-Avatar 開始——它比替代方案快 18 倍、便宜 6 倍,內建 TTS、動態背景,支援 1080p。

模型App ID最佳用途內建 TTS
P-Video-Avatarpruna/p-video-avatar最佳整體表現:速度、成本、品質、控制是(30 種語音、10 種語言)
OmniHuman 1.5bytedance/omnihuman-1-5多角色、音訊驅動否
Fabric 1.0falai/fabric-1-0圖片說話搭配嘴型同步是
PixVerse Lipsyncfalai/pixverse-lipsync高度真實的嘴型同步否

成本與速度比較

模型速度(每秒影片)每秒成本
P-Video-Avatar~1.83s/s$0.025
OmniHuman 1.5~28s/s(慢 15 倍)$0.16(貴 6.4 倍)
Fabric 1.0~34s/s(慢 18 倍)$0.14(貴 5.6 倍)

範例

P-Video-Avatar(推薦)

從人像照片搭配文字腳本,使用內建 TTS 生成虛擬人物:

belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "voice_script": "歡迎來到我們的產品導覽。今天我將向您展示三個關鍵功能。",
  "voice": "Puck (Male)",
  "voice_language": "English (US)",
  "resolution": "720p"
}'

搭配自訂風格控制:

belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "voice_script": "這是個令人興奮的消息!",
  "voice": "Aoede (Female)",
  "voice_prompt": "熱情且充滿活力的語氣",
  "video_prompt": "這個人在舞台上,搭配戲劇性燈光進行簡報",
  "resolution": "1080p"
}'

使用音訊檔案而非 TTS:

belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "audio": "https://speech.mp3"
}'

完整工作流程:產生人像 + 虛擬人物

使用 Pruna P-Image 產生人像,再建立虛擬人物:

# 1. 產生人像圖片
belt app run pruna/p-image --input '{
  "prompt": "專業女性半身照,中性背景,直視鏡頭,棚拍燈光,擬真風格",
  "aspect_ratio": "9:16"
}'

# 2. 使用內建 TTS 建立虛擬人物影片
belt app run pruna/p-video-avatar --input '{
  "image": "<第一步驟產生的圖片網址>",
  "voice_script": "嗨!讓我為您介紹我們的最新功能。",
  "voice": "Zephyr (Female)"
}'

OmniHuman 1.5(多角色)

belt app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

支援在多人物圖片中指定要驅動的角色。

Fabric 1.0(圖片說話)

belt app run falai/fabric-1-0 --input '{
  "image_url": "https://face.jpg",
  "audio_url": "https://audio.mp3"
}'

PixVerse Lipsync

belt app run falai/pixverse-lipsync --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

完整工作流程:TTS + 虛擬人物(非 TTS 模型)

對於沒有內建 TTS 的模型,先產生語音:

# 1. 從文字產生語音
belt app run infsh/kokoro-tts --input '{
  "prompt": "歡迎來到我們的產品示範。今天我將向您展示..."
}' > speech.json

# 2. 使用語音建立虛擬人物影片
belt app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://presenter-photo.jpg",
  "audio_url": "<第一步驟產生的音訊網址>"
}'

完整工作流程:將影片配音成另一種語言

# 1. 轉錄原始影片
belt app run infsh/fast-whisper-large-v3 --input '{"audio_url": "https://video.mp4"}' > transcript.json

# 2. 翻譯文字(手動或使用 LLM)

# 3. 以新語言產生語音
belt app run infsh/kokoro-tts --input '{"text": "<翻譯後的文字>"}' > new_speech.json

# 4. 將原始影片與新音訊進行嘴型同步
belt app run infsh/latentsync-1-6 --input '{
  "video_url": "https://original-video.mp4",
  "audio_url": "<新音訊網址>"
}'

使用案例

  • 行銷:以 AI 主持人進行產品示範
  • 教育:課程影片、解說影片
  • 在地化:以多種語言配音內容
  • 社群媒體:一致的虛擬網紅
  • 企業:訓練影片、公告
  • 遊戲:角色虛擬人物、NPC 對話

提示

  • 使用高品質的人像照片(正面、光線充足)
  • 音訊應清晰,背景噪音要少
  • P-Video-Avatar 支援內建 TTS——無需另外進行語音產生步驟
  • P-Video-Avatar 的輸出畫面比例與輸入圖片一致
  • 使用 pruna/p-image 產生人像時,採用 9:16 的畫面比例以製作垂直影片
  • OmniHuman 1.5 支援同一張圖片中的多人物
  • LatentSync 最適合將現有影片與新音訊進行同步

相關技能

# 專用 P-Video-Avatar 技能
npx skills add inference-sh/skills@p-video-avatar

# 完整平台技能(超過 250 個應用程式)
npx skills add inference-sh/skills@infsh-cli

# 文字轉語音(為無 TTS 的虛擬人物模型產生音訊)
npx skills add inference-sh/skills@text-to-speech

# 語音轉文字(為配音進行轉錄)
npx skills add inference-sh/skills@speech-to-text

# 影片生成
npx skills add inference-sh/skills@ai-video-generation

# 圖片生成(建立虛擬人物圖片)
npx skills add inference-sh/skills@ai-image-generation

瀏覽所有影片應用程式:belt app list --category video

文件

Individual skills in this repo

This repo contains 13 individual skills — each has its own dedicated page.

Aadi-110i/PEP-PROJECT

Create AI marketing videos for ads, promos, product launches, and brand content. Models: Veo, Seedance, Wan, FLUX for visuals, Kokoro for voiceover. Types: product demos, testimonials, explainers, social ads, brand videos. Use for: Facebook ads, YouTube ads, product launches, brand awareness. Triggers: marketing video, ad video, promo video, commercial, brand video, product video, explainer video, ad creative, video ad, facebook ad video, youtube ad, instagram ad, tiktok ad, promotional video, launch video

Aadi-110i/PEP-PROJECT

Generate AI videos with Google Veo, Seedance 2.0, HappyHorse, Wan, Grok and 40+ models via inference.sh CLI. Models: Veo 3.1, Veo 3, Seedance 2.0, HappyHorse 1.0, Wan 2.5, Grok Imagine Video, OmniHuman, Fabric, HunyuanVideo. Capabilities: text-to-video, image-to-video, reference-to-video, video editing, lipsync, avatar animation, video upscaling, foley sound. Use for: social media videos, marketing content, explainer videos, product demos, AI avatars. Triggers: video generation, ai video, text to video, image to video, veo, animate image, video from image, ai animation, video generator, generate video, t2v, i2v, ai video maker, create video with ai, runway alternative, pika alternative, sora alternative, kling alternative, seedance, happyhorse

Aadi-110i/PEP-PROJECT

ElevenLabs text-to-speech with 22+ premium voices, multilingual support, and voice tuning via inference.sh CLI. Models: eleven_multilingual_v2 (highest quality), eleven_turbo_v2_5 (low latency), eleven_flash_v2_5 (ultra-fast). Capabilities: text-to-speech, voice selection, stability/style control, 32 languages. Use for: voiceovers, audiobooks, video narration, podcasts, accessibility, IVR. Triggers: elevenlabs, eleven labs, elevenlabs tts, premium tts, professional voice, ai voice, high quality tts, multilingual tts, eleven labs voice, voice generation, natural speech, realistic voice, voice over, speech synthesis

Aadi-110i/PEP-PROJECT

Explainer video production guide: scripting, voiceover, visuals, and assembly. Covers script formulas, pacing rules, scene planning, and multi-tool pipelines. Use for: product demos, how-it-works videos, onboarding videos, social explainers. Triggers: explainer video, how to make explainer, product video, demo video, video production, video script, animated explainer, product demo video, tutorial video, onboarding video, walkthrough video, video pipeline

Aadi-110i/PEP-PROJECT

Still-to-video conversion guide: model selection, motion prompting, and camera movement. Covers Wan 2.5 i2v, Seedance, Fabric, Grok Video with when to use each. Use for: animating images, creating video from stills, adding motion, product animations. Triggers: image to video, i2v, animate image, still to video, add motion to image, image animation, photo to video, animate still, wan i2v, image2video, bring image to life, animate photo, motion from image

Aadi-110i/PEP-PROJECT

Landing page conversion optimization with layout rules, hero section design, and CTA psychology. Covers above-the-fold formula, social proof placement, mobile design, and F-pattern reading. Use for: startup landing pages, product pages, SaaS marketing, conversion optimization. Triggers: landing page, hero section, above the fold, conversion optimization, landing page design, cta button, hero image, landing page layout, saas landing page, product page design, conversion rate, landing page best practices

Aadi-110i/PEP-PROJECT

Generate talking head avatar videos with Pruna P-Video-Avatar via inference.sh CLI. Turn a portrait image into a realistic speaking video with built-in TTS. 18x faster and 6x cheaper than competitors. Models: P-Video-Avatar, P-Image (for portrait generation). Capabilities: text-to-avatar, audio-driven avatars, 30 voices, 10 languages, 720p/1080p, built-in TTS, dynamic backgrounds, full-body control. Use for: AI presenters, product demos, explainer videos, virtual influencers, marketing, education, multilingual content, UGC, gaming avatars. Triggers: avatar video, talking head, ai avatar, p-video-avatar, pruna avatar, video avatar, ai presenter, digital human, virtual presenter, lipsync, talking avatar, ai spokesperson, heygen alternative, synthesia alternative, veed alternative, fabric alternative, omnihuman alternative

Aadi-110i/PEP-PROJECT

Generate videos with Pruna P-Video and WAN models via inference.sh CLI. Models: P-Video, WAN-T2V, WAN-I2V. Capabilities: text-to-video, image-to-video, audio support, 720p/1080p, fast inference. Pruna optimizes models for speed without quality loss. Triggers: pruna video, p-video, pruna ai video, fast video generation, optimized video, wan t2v, wan i2v, economic video generation, cheap video generation, pruna text to video, pruna image to video

Aadi-110i/PEP-PROJECT

Render videos from React/Remotion component code via inference.sh. Pass TSX code, get MP4. Supports all Remotion APIs: useCurrentFrame, useVideoConfig, spring, interpolate, AbsoluteFill, Sequence. Configurable resolution, FPS, duration, codec. Use for: programmatic video generation, animated graphics, motion design, data-driven videos, React animations to video. Triggers: remotion, render video from code, tsx to video, react video, programmatic video, remotion render, code to video, animated video, motion graphics code, react animation video

Aadi-110i/PEP-PROJECT

Three.js animation - keyframe animation, skeletal animation, morph targets, animation mixing. Use when animating objects, playing GLTF animations, creating procedural motion, or blending animations.

Aadi-110i/PEP-PROJECT

Video ad creation with exact platform-specific specs for TikTok, Instagram, YouTube, Facebook, LinkedIn. Covers dimensions, duration limits, AIDA framework, and caption requirements. Use for: video ads, social media ads, paid media creative, video marketing, ad production. Triggers: video ad, social media ad, tiktok ad, instagram ad, youtube ad, facebook ad, linkedin ad, video creative, ad specs, paid media, video marketing, ad production, reels ad, stories ad, pre roll, bumper ad

Aadi-110i/PEP-PROJECT

Best practices and techniques for writing effective AI video generation prompts. Covers: Veo, Seedance, Wan, Grok, Kling, Runway, Pika, Sora prompting strategies. Learn: shot types, camera movements, lighting, pacing, style keywords, negative prompts. Use for: improving video quality, getting consistent results, professional video prompts. Triggers: video prompt, how to prompt video, veo prompts, video generation tips, better ai video, video prompt engineering, video prompt guide, video prompt template, ai video tips, video prompt best practices, video prompt examples, cinematography prompts

Aadi-110i/PEP-PROJECT

YouTube thumbnail design with specific dimensions, contrast rules, and mobile preview optimization. Covers safe zones, text placement, face expression psychology, and A/B testing. Use for: YouTube thumbnails, video cover images, click-through optimization. Triggers: youtube thumbnail, thumbnail design, video thumbnail, click through rate, ctr optimization, youtube cover, video cover image, thumbnail maker, thumbnail tips, youtube design, video preview image

相關技能