Communitygithub.com

Aadi-110i/PEP-PROJECT

通过 inference.sh CLI 创建 AI 虚拟形象和说话头像视频。推荐使用 P-Video-Avatar(最快、最便宜、内置 TTS),也支持 OmniHuman、Fabric、PixVerse 等模型。

PEP-PROJECT 是什么?

该技能利用 inference.sh CLI 创建高质量的 AI 虚拟形象和说话头像视频,适用于 AI 主持人、讲解视频、虚拟网红、配音和营销材料制作。它集成了多种先进模型:P-Video-Avatar(推荐,速度提升 18 倍,成本降低 6 倍,内置 30 种语音和 10 种语言的 TTS)、OmniHuman 1.5(支持多人物和音频驱动)、Fabric 1.0(图像说话及唇同步)以及 PixVerse Lipsync(高度逼真的唇同步)。用户可通过简单的 CLI 命令输入图像、文本脚本或音频文件来生成虚拟人视频,并自定义语音、风格、分辨率等参数。该技能还支持完整的工作流:从生成肖像、文字转语音、配音翻译到最终视频的唇同步,覆盖从图像生成到多语言配音的全流程。所有操作均通过 `belt` CLI 在 inference.sh 平台上完成,适合开发者快速集成到自动化内容生产管线中。

兼容平台~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/Aadi-110i/PEP-PROJECT/tree/HEAD/skills/ai-avatar-video

在你喜欢的 AI 中提问

打开一个已预加载此 Agent Skill 的新对话。

预览

来自技能 README

AI 虚拟形象与说话头像视频

文档

AI 虚拟形象与说话头像视频

通过 inference.sh CLI 创建 AI 虚拟形象和说话头像视频。

AI 虚拟形象与说话头像视频

快速开始

需要 inference.sh CLI(belt)。安装说明

belt login

# 推荐:P-Video-Avatar(最快、最便宜、内置 TTS)
belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "voice_script": "你好,欢迎来到我们的产品演示!",
  "voice": "Zephyr (Female)"
}'

可用模型

从 P-Video-Avatar 开始——它比替代方案快 18 倍、便宜 6 倍,内置 TTS、动态背景和 1080p 支持。

模型应用 ID最佳用途内置 TTS
P-Video-Avatarpruna/p-video-avatar最佳整体:速度、成本、质量、控制是(30 种语音,10 种语言)
OmniHuman 1.5bytedance/omnihuman-1-5多人物、音频驱动否
Fabric 1.0falai/fabric-1-0图像说话及唇同步是
PixVerse Lipsyncfalai/pixverse-lipsync高度逼真的唇同步否

成本与速度对比

模型速度(每秒钟视频)每秒成本
P-Video-Avatar~1.83 秒/秒$0.025
OmniHuman 1.5~28 秒/秒(慢 15 倍)$0.16(贵 6.4 倍)
Fabric 1.0~34 秒/秒(慢 18 倍)$0.14(贵 5.6 倍)

示例

P-Video-Avatar(推荐)

通过肖像 + 文本脚本使用内置 TTS 生成虚拟形象:

belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "voice_script": "欢迎来到我们的产品演示。今天我将向您展示三个关键功能。",
  "voice": "Puck (Male)",
  "voice_language": "English (US)",
  "resolution": "720p"
}'

带自定义风格控制:

belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "voice_script": "这是个令人兴奋的消息!",
  "voice": "Aoede (Female)",
  "voice_prompt": "热情洋溢、充满活力的语气",
  "video_prompt": "该人物正在聚光灯下于舞台上进行演示",
  "resolution": "1080p"
}'

使用音频文件代替 TTS:

belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "audio": "https://speech.mp3"
}'

完整工作流:生成肖像 + 虚拟形象

使用 Pruna P-Image 生成肖像,然后创建虚拟形象:

# 1. 生成肖像图像
belt app run pruna/p-image --input '{
  "prompt": "professional headshot portrait of a young woman, neutral background, looking at camera, studio lighting, photorealistic",
  "aspect_ratio": "9:16"
}'

# 2. 使用内置 TTS 创建虚拟形象视频
belt app run pruna/p-video-avatar --input '{
  "image": "<image-url-from-step-1>",
  "voice_script": "你好!让我带你了解我们最新的功能。",
  "voice": "Zephyr (Female)"
}'

OmniHuman 1.5(多人物)

belt app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

支持指定多人物图像中要驱动的人物。

Fabric 1.0(图像说话)

belt app run falai/fabric-1-0 --input '{
  "image_url": "https://face.jpg",
  "audio_url": "https://audio.mp3"
}'

PixVerse Lipsync

belt app run falai/pixverse-lipsync --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

完整工作流:TTS + 虚拟形象(非 TTS 模型)

对于没有内置 TTS 的模型,先生成语音:

# 1. 从文本生成语音
belt app run infsh/kokoro-tts --input '{
  "prompt": "欢迎来到我们的产品演示。今天我将向您展示..."
}' > speech.json

# 2. 使用生成的语音创建虚拟形象视频
belt app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://presenter-photo.jpg",
  "audio_url": "<audio-url-from-step-1>"
}'

完整工作流:用另一种语言配音视频

# 1. 转录原始视频
belt app run infsh/fast-whisper-large-v3 --input '{"audio_url": "https://video.mp4"}' > transcript.json

# 2. 翻译文本(手动或使用 LLM)

# 3. 用新语言生成语音
belt app run infsh/kokoro-tts --input '{"text": "<translated-text>"}' > new_speech.json

# 4. 将原始视频与新的音频进行唇同步
belt app run infsh/latentsync-1-6 --input '{
  "video_url": "https://original-video.mp4",
  "audio_url": "<new-audio-url>"
}'

使用场景

  • 营销:使用 AI 主持人的产品演示
  • 教育:课程视频、讲解视频
  • 本地化:多种语言的内容配音
  • 社交媒体:统一的虚拟网红
  • 企业:培训视频、公告
  • 游戏:角色虚拟形象、NPC 对话

提示

  • 使用高质量的正面肖像照片(正面朝向、光线良好)
  • 音频应清晰,背景噪音尽量少
  • P-Video-Avatar 支持内置 TTS,无需单独的语音生成步骤
  • P-Video-Avatar 输出的宽高比与输入图像一致
  • 使用 pruna/p-image 生成肖像时,竖版视频建议使用 9:16 的宽高比
  • OmniHuman 1.5 支持一张图像中的多个人物
  • LatentSync 最适合将现有视频与新音频同步

相关技能

# 专用 P-Video-Avatar 技能
npx skills add inference-sh/skills@p-video-avatar

# 完整平台技能(全部 250+ 应用)
npx skills add inference-sh/skills@infsh-cli

# 文本转语音(为无 TTS 的虚拟形象模型生成音频)
npx skills add inference-sh/skills@text-to-speech

# 语音转文本(为配音进行转录)
npx skills add inference-sh/skills@speech-to-text

# 视频生成
npx skills add inference-sh/skills@ai-video-generation

# 图像生成(创建虚拟形象图像)
npx skills add inference-sh/skills@ai-image-generation

浏览所有视频应用:belt app list --category video

文档

Individual skills in this repo

This repo contains 13 individual skills — each has its own dedicated page.

Aadi-110i/PEP-PROJECT

Create AI marketing videos for ads, promos, product launches, and brand content. Models: Veo, Seedance, Wan, FLUX for visuals, Kokoro for voiceover. Types: product demos, testimonials, explainers, social ads, brand videos. Use for: Facebook ads, YouTube ads, product launches, brand awareness. Triggers: marketing video, ad video, promo video, commercial, brand video, product video, explainer video, ad creative, video ad, facebook ad video, youtube ad, instagram ad, tiktok ad, promotional video, launch video

Aadi-110i/PEP-PROJECT

Generate AI videos with Google Veo, Seedance 2.0, HappyHorse, Wan, Grok and 40+ models via inference.sh CLI. Models: Veo 3.1, Veo 3, Seedance 2.0, HappyHorse 1.0, Wan 2.5, Grok Imagine Video, OmniHuman, Fabric, HunyuanVideo. Capabilities: text-to-video, image-to-video, reference-to-video, video editing, lipsync, avatar animation, video upscaling, foley sound. Use for: social media videos, marketing content, explainer videos, product demos, AI avatars. Triggers: video generation, ai video, text to video, image to video, veo, animate image, video from image, ai animation, video generator, generate video, t2v, i2v, ai video maker, create video with ai, runway alternative, pika alternative, sora alternative, kling alternative, seedance, happyhorse

Aadi-110i/PEP-PROJECT

ElevenLabs text-to-speech with 22+ premium voices, multilingual support, and voice tuning via inference.sh CLI. Models: eleven_multilingual_v2 (highest quality), eleven_turbo_v2_5 (low latency), eleven_flash_v2_5 (ultra-fast). Capabilities: text-to-speech, voice selection, stability/style control, 32 languages. Use for: voiceovers, audiobooks, video narration, podcasts, accessibility, IVR. Triggers: elevenlabs, eleven labs, elevenlabs tts, premium tts, professional voice, ai voice, high quality tts, multilingual tts, eleven labs voice, voice generation, natural speech, realistic voice, voice over, speech synthesis

Aadi-110i/PEP-PROJECT

Explainer video production guide: scripting, voiceover, visuals, and assembly. Covers script formulas, pacing rules, scene planning, and multi-tool pipelines. Use for: product demos, how-it-works videos, onboarding videos, social explainers. Triggers: explainer video, how to make explainer, product video, demo video, video production, video script, animated explainer, product demo video, tutorial video, onboarding video, walkthrough video, video pipeline

Aadi-110i/PEP-PROJECT

Still-to-video conversion guide: model selection, motion prompting, and camera movement. Covers Wan 2.5 i2v, Seedance, Fabric, Grok Video with when to use each. Use for: animating images, creating video from stills, adding motion, product animations. Triggers: image to video, i2v, animate image, still to video, add motion to image, image animation, photo to video, animate still, wan i2v, image2video, bring image to life, animate photo, motion from image

Aadi-110i/PEP-PROJECT

Landing page conversion optimization with layout rules, hero section design, and CTA psychology. Covers above-the-fold formula, social proof placement, mobile design, and F-pattern reading. Use for: startup landing pages, product pages, SaaS marketing, conversion optimization. Triggers: landing page, hero section, above the fold, conversion optimization, landing page design, cta button, hero image, landing page layout, saas landing page, product page design, conversion rate, landing page best practices

Aadi-110i/PEP-PROJECT

Generate talking head avatar videos with Pruna P-Video-Avatar via inference.sh CLI. Turn a portrait image into a realistic speaking video with built-in TTS. 18x faster and 6x cheaper than competitors. Models: P-Video-Avatar, P-Image (for portrait generation). Capabilities: text-to-avatar, audio-driven avatars, 30 voices, 10 languages, 720p/1080p, built-in TTS, dynamic backgrounds, full-body control. Use for: AI presenters, product demos, explainer videos, virtual influencers, marketing, education, multilingual content, UGC, gaming avatars. Triggers: avatar video, talking head, ai avatar, p-video-avatar, pruna avatar, video avatar, ai presenter, digital human, virtual presenter, lipsync, talking avatar, ai spokesperson, heygen alternative, synthesia alternative, veed alternative, fabric alternative, omnihuman alternative

Aadi-110i/PEP-PROJECT

Generate videos with Pruna P-Video and WAN models via inference.sh CLI. Models: P-Video, WAN-T2V, WAN-I2V. Capabilities: text-to-video, image-to-video, audio support, 720p/1080p, fast inference. Pruna optimizes models for speed without quality loss. Triggers: pruna video, p-video, pruna ai video, fast video generation, optimized video, wan t2v, wan i2v, economic video generation, cheap video generation, pruna text to video, pruna image to video

Aadi-110i/PEP-PROJECT

Render videos from React/Remotion component code via inference.sh. Pass TSX code, get MP4. Supports all Remotion APIs: useCurrentFrame, useVideoConfig, spring, interpolate, AbsoluteFill, Sequence. Configurable resolution, FPS, duration, codec. Use for: programmatic video generation, animated graphics, motion design, data-driven videos, React animations to video. Triggers: remotion, render video from code, tsx to video, react video, programmatic video, remotion render, code to video, animated video, motion graphics code, react animation video

Aadi-110i/PEP-PROJECT

Three.js animation - keyframe animation, skeletal animation, morph targets, animation mixing. Use when animating objects, playing GLTF animations, creating procedural motion, or blending animations.

Aadi-110i/PEP-PROJECT

Video ad creation with exact platform-specific specs for TikTok, Instagram, YouTube, Facebook, LinkedIn. Covers dimensions, duration limits, AIDA framework, and caption requirements. Use for: video ads, social media ads, paid media creative, video marketing, ad production. Triggers: video ad, social media ad, tiktok ad, instagram ad, youtube ad, facebook ad, linkedin ad, video creative, ad specs, paid media, video marketing, ad production, reels ad, stories ad, pre roll, bumper ad

Aadi-110i/PEP-PROJECT

Best practices and techniques for writing effective AI video generation prompts. Covers: Veo, Seedance, Wan, Grok, Kling, Runway, Pika, Sora prompting strategies. Learn: shot types, camera movements, lighting, pacing, style keywords, negative prompts. Use for: improving video quality, getting consistent results, professional video prompts. Triggers: video prompt, how to prompt video, veo prompts, video generation tips, better ai video, video prompt engineering, video prompt guide, video prompt template, ai video tips, video prompt best practices, video prompt examples, cinematography prompts

Aadi-110i/PEP-PROJECT

YouTube thumbnail design with specific dimensions, contrast rules, and mobile preview optimization. Covers safe zones, text placement, face expression psychology, and A/B testing. Use for: YouTube thumbnails, video cover images, click-through optimization. Triggers: youtube thumbnail, thumbnail design, video thumbnail, click through rate, ctr optimization, youtube cover, video cover image, thumbnail maker, thumbnail tips, youtube design, video preview image

相关技能