Communitygithub.com

AI 虚拟形象与有声视频生成

通过 inference.sh CLI 使用 OmniHuman、Fabric、PixVerse 等模型,创建 AI 虚拟形象和有声视频。

AI 虚拟形象与有声视频生成 是什么?

这是一个基于 inference.sh CLI 的 AI 技能,专注于生成 AI 虚拟形象(Avatar)和有声视频(Talking Head)。它整合了多个先进模型,包括 OmniHuman 1.5(多人物、高质量)、OmniHuman 1.0(单人物)、Fabric 1.0(图像说话、唇形同步)和 PixVerse Lipsync(高保真唇形同步)。用户只需提供一张人物肖像图片和一段音频文件,即可驱动虚拟角色说话、做出表情或唇形同步。该技能还支持完整的工作流,例如先通过文本转语音(TTS)生成配音,再合成虚拟人视频,或对现有视频进行翻译配音。该技能适用于 AI 主播、产品演示、教学视频、虚拟网红、市场营销以及多语言本地化等场景,可以作为 HeyGen 或 Synthesia 等商业平台的免费开源替代方案。支持所有 inference.sh CLI 可用的平台,并可通过 `infsh app run` 命令轻松触发。

兼容平台✓Claude Code~Codex CLI~Cursor
npx skills add https://github.com/AngelescuCiprian/claude-skills/tree/HEAD/.agents/skills/ai-avatar-video

在你喜欢的 AI 中提问

打开一个已预加载此 Agent Skill 的新对话。

预览

来自技能 README

AI 虚拟形象与有声视频

文档

AI 虚拟形象与有声视频生成 是做什么的?

通过 inference.sh CLI 创建 AI 虚拟形象和有声视频。

AI 虚拟形象与有声视频

快速开始

需要 inference.sh CLI (infsh)。安装说明

infsh login

# 通过图片 + 音频创建虚拟形象视频
infsh app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

可用模型

模型应用 ID最佳用途
OmniHuman 1.5bytedance/omnihuman-1-5多人物,最佳质量
OmniHuman 1.0bytedance/omnihuman-1-0单人物
Fabric 1.0falai/fabric-1-0图像说话,带唇形同步
PixVerse Lipsyncfalai/pixverse-lipsync极高保真度

搜索虚拟形象应用

infsh app list --search "omnihuman"
infsh app list --search "lipsync"
infsh app list --search "fabric"

示例

OmniHuman 1.5(多人物)

infsh app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

支持在多人物图片中指定驱动哪个角色。

Fabric 1.0(图像说话)

infsh app run falai/fabric-1-0 --input '{
  "image_url": "https://face.jpg",
  "audio_url": "https://audio.mp3"
}'

PixVerse Lipsync

infsh app run falai/pixverse-lipsync --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

从任意音频生成高度逼真的唇形同步。

完整工作流:文字转语音 + 虚拟形象

# 1. 从文本生成语音
infsh app run infsh/kokoro-tts --input '{
  "prompt": "欢迎观看我们的产品演示。今天我将为您展示…"
}' > speech.json

# 2. 使用该语音创建虚拟形象视频
infsh app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://presenter-photo.jpg",
  "audio_url": "<步骤1输出的音频URL>"
}'

完整工作流:视频配音(另一种语言)

# 1. 转录原始视频
infsh app run infsh/fast-whisper-large-v3 --input '{"audio_url": "https://video.mp4"}' > transcript.json

# 2. 翻译文本(手动或使用大语言模型)

# 3. 以新语言生成语音
infsh app run infsh/kokoro-tts --input '{"text": "<翻译后的文本>"}' > new_speech.json

# 4. 使用新音频对原始视频进行唇形同步
infsh app run infsh/latentsync-1-6 --input '{
  "video_url": "https://original-video.mp4",
  "audio_url": "<新音频URL>"
}'

使用场景

  • 市场营销:使用 AI 主持人进行产品演示
  • 教育:课程视频、讲解视频
  • 本地化:以多种语言为视频配音
  • 社交媒体:一致的虚拟网红
  • 企业:培训视频、公告

小贴士

  • 使用高质量的正面肖像照片(正面拍摄、光线良好)
  • 音频应清晰,背景噪音尽可能小
  • OmniHuman 1.5 支持同一张图片中的多个人物
  • LatentSync 最适合将现有视频与新的音频同步

相关技能

# 完整平台技能(150+ 应用)
npx skills add inference-sh/skills@infsh-cli

# 文本转语音(为虚拟形象生成音频)
npx skills add inference-sh/skills@text-to-speech

# 语音转文本(为配音转录)
npx skills add inference-sh/skills@speech-to-text

# 视频生成
npx skills add inference-sh/skills@ai-video-generation

# 图像生成(创建虚拟形象图片)
npx skills add inference-sh/skills@ai-image-generation

浏览所有视频应用:infsh app list --category video

文档

Individual skills in this repo

This repo contains 12 individual skills — each has its own dedicated page.

AngelescuCiprian/claude-skills

Create AI marketing videos for ads, promos, product launches, and brand content. Models: Veo, Seedance, Wan, FLUX for visuals, Kokoro for voiceover. Types: product demos, testimonials, explainers, social ads, brand videos. Use for: Facebook ads, YouTube ads, product launches, brand awareness. Triggers: marketing video, ad video, promo video, commercial, brand video, product video, explainer video, ad creative, video ad, facebook ad video, youtube ad, instagram ad, tiktok ad, promotional video, launch video

AngelescuCiprian/claude-skills

Generate AI videos with Google Veo, Seedance, Wan, Grok and 40+ models via inference.sh CLI. Models: Veo 3.1, Veo 3, Seedance 1.5 Pro, Wan 2.5, Grok Imagine Video, OmniHuman, Fabric, HunyuanVideo. Capabilities: text-to-video, image-to-video, lipsync, avatar animation, video upscaling, foley sound. Use for: social media videos, marketing content, explainer videos, product demos, AI avatars. Triggers: video generation, ai video, text to video, image to video, veo, animate image, video from image, ai animation, video generator, generate video, t2v, i2v, ai video maker, create video with ai, runway alternative, pika alternative, sora alternative, kling alternative

AngelescuCiprian/claude-skills

ElevenLabs text-to-speech with 22+ premium voices, multilingual support, and voice tuning via inference.sh CLI. Models: eleven_multilingual_v2 (highest quality), eleven_turbo_v2_5 (low latency), eleven_flash_v2_5 (ultra-fast). Capabilities: text-to-speech, voice selection, stability/style control, 32 languages. Use for: voiceovers, audiobooks, video narration, podcasts, accessibility, IVR. Triggers: elevenlabs, eleven labs, elevenlabs tts, premium tts, professional voice, ai voice, high quality tts, multilingual tts, eleven labs voice, voice generation, natural speech, realistic voice, voice over, speech synthesis

AngelescuCiprian/claude-skills

Explainer video production guide: scripting, voiceover, visuals, and assembly. Covers script formulas, pacing rules, scene planning, and multi-tool pipelines. Use for: product demos, how-it-works videos, onboarding videos, social explainers. Triggers: explainer video, how to make explainer, product video, demo video, video production, video script, animated explainer, product demo video, tutorial video, onboarding video, walkthrough video, video pipeline

AngelescuCiprian/claude-skills

Still-to-video conversion guide: model selection, motion prompting, and camera movement. Covers Wan 2.5 i2v, Seedance, Fabric, Grok Video with when to use each. Use for: animating images, creating video from stills, adding motion, product animations. Triggers: image to video, i2v, animate image, still to video, add motion to image, image animation, photo to video, animate still, wan i2v, image2video, bring image to life, animate photo, motion from image

AngelescuCiprian/claude-skills

Landing page conversion optimization with layout rules, hero section design, and CTA psychology. Covers above-the-fold formula, social proof placement, mobile design, and F-pattern reading. Use for: startup landing pages, product pages, SaaS marketing, conversion optimization. Triggers: landing page, hero section, above the fold, conversion optimization, landing page design, cta button, hero image, landing page layout, saas landing page, product page design, conversion rate, landing page best practices

AngelescuCiprian/claude-skills

Generate videos with Pruna P-Video and WAN models via inference.sh CLI. Models: P-Video, WAN-T2V, WAN-I2V. Capabilities: text-to-video, image-to-video, audio support, 720p/1080p, fast inference. Pruna optimizes models for speed without quality loss. Triggers: pruna video, p-video, pruna ai video, fast video generation, optimized video, wan t2v, wan i2v, economic video generation, cheap video generation, pruna text to video, pruna image to video

AngelescuCiprian/claude-skills

Best practices for Remotion - Video creation in React

AngelescuCiprian/claude-skills

Render videos from React/Remotion component code via inference.sh. Pass TSX code, get MP4. Supports all Remotion APIs: useCurrentFrame, useVideoConfig, spring, interpolate, AbsoluteFill, Sequence. Configurable resolution, FPS, duration, codec. Use for: programmatic video generation, animated graphics, motion design, data-driven videos, React animations to video. Triggers: remotion, render video from code, tsx to video, react video, programmatic video, remotion render, code to video, animated video, motion graphics code, react animation video

AngelescuCiprian/claude-skills

Video ad creation with exact platform-specific specs for TikTok, Instagram, YouTube, Facebook, LinkedIn. Covers dimensions, duration limits, AIDA framework, and caption requirements. Use for: video ads, social media ads, paid media creative, video marketing, ad production. Triggers: video ad, social media ad, tiktok ad, instagram ad, youtube ad, facebook ad, linkedin ad, video creative, ad specs, paid media, video marketing, ad production, reels ad, stories ad, pre roll, bumper ad

AngelescuCiprian/claude-skills

Best practices and techniques for writing effective AI video generation prompts. Covers: Veo, Seedance, Wan, Grok, Kling, Runway, Pika, Sora prompting strategies. Learn: shot types, camera movements, lighting, pacing, style keywords, negative prompts. Use for: improving video quality, getting consistent results, professional video prompts. Triggers: video prompt, how to prompt video, veo prompts, video generation tips, better ai video, video prompt engineering, video prompt guide, video prompt template, ai video tips, video prompt best practices, video prompt examples, cinematography prompts

AngelescuCiprian/claude-skills

YouTube thumbnail design with specific dimensions, contrast rules, and mobile preview optimization. Covers safe zones, text placement, face expression psychology, and A/B testing. Use for: YouTube thumbnails, video cover images, click-through optimization. Triggers: youtube thumbnail, thumbnail design, video thumbnail, click through rate, ctr optimization, youtube cover, video cover image, thumbnail maker, thumbnail tips, youtube design, video preview image

相关技能