Communitygithub.com

JantonioFC/skillsbank

通过 inference.sh CLI 创建 AI 头像和说话头像视频,支持 OmniHuman、Fabric、PixVerse 等模型。

skillsbank 是什么?

该技能通过 inference.sh CLI 提供了一套完整的 AI 头像与说话头像视频生成方案,集成 OmniHuman 1.5、OmniHuman 1.0、Fabric 1.0 和 PixVerse Lipsync 等模型。用户只需提供一张人物肖像照片和一段音频,即可生成高保真度的口型同步视频,甚至支持多人物场景下的指定驱动。技能还支持从文本到语音(TTS)的完整工作流,以及视频翻译配音(先转录音频、翻译文本、生成新语音,再通过 LatentSync 进行口型同步),非常适合虚拟主播、产品演示、本地化配音、教育培训和社交媒体内容创作。所有操作均通过命令行完成,可轻松集成到自动化管道中。

兼容平台~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/JantonioFC/skillsbank/tree/HEAD/skills/ai-avatar-video

在你喜欢的 AI 中提问

打开一个已预加载此 Agent Skill 的新对话。

预览

来自技能 README

AI 头像与说话头像视频

文档

AI 头像与说话头像视频

何时使用

根据需要执行指定自动化任务时使用此技能。

通过 inference.sh CLI 创建 AI 头像和说话头像视频。

AI 头像与说话头像视频

快速开始

curl -fsSL https://cli.inference.sh | sh && infsh login

# 从图片 + 音频创建头像视频
infsh app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

可用模型

模型App ID最适合用于
OmniHuman 1.5bytedance/omnihuman-1-5多人物场景,最佳质量
OmniHuman 1.0bytedance/omnihuman-1-0单人物场景
Fabric 1.0falai/fabric-1-0图像说话(口型同步)
PixVerse Lipsyncfalai/pixverse-lipsync高度逼真

搜索头像应用

infsh app list --search "omnihuman"
infsh app list --search "lipsync"
infsh app list --search "fabric"

示例

OmniHuman 1.5(多人物)

infsh app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

支持指定多人物图片中的哪个角色被驱动。

Fabric 1.0(图像说话)

infsh app run falai/fabric-1-0 --input '{
  "image_url": "https://face.jpg",
  "audio_url": "https://audio.mp3"
}'

PixVerse Lipsync

infsh app run falai/pixverse-lipsync --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

从任意音频生成高度逼真的口型同步效果。

完整工作流:TTS + 头像

# 1. 从文本生成语音
infsh app run infsh/kokoro-tts --input '{
  "text": "欢迎观看我们的产品演示。今天我将向您展示..."
}' > speech.json

# 2. 使用该语音创建头像视频
infsh app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://presenter-photo.jpg",
  "audio_url": "<步骤1中生成的音频URL>"
}'

完整工作流:视频翻译配音

# 1. 转录原始视频
infsh app run infsh/fast-whisper-large-v3 --input '{"audio_url": "https://video.mp4"}' > transcript.json

# 2. 翻译文本(手动或使用 LLM)

# 3. 生成新语言的语音
infsh app run infsh/kokoro-tts --input '{"text": "<翻译后的文本>"}' > new_speech.json

# 4. 用新音频对原视频进行口型同步
infsh app run infsh/latentsync-1-6 --input '{
  "video_url": "https://original-video.mp4",
  "audio_url": "<新音频URL>"
}'

应用场景

  • 市场营销:AI 主持人进行产品演示
  • 教育培训:课程视频、讲解视频
  • 本地化:多语言内容配音
  • 社交媒体:一致的虚拟网红形象
  • 企业办公:培训视频、公告通知

提示

  • 使用高质量正面肖像照片(正面、光线良好)
  • 音频应清晰,背景噪音最小化
  • OmniHuman 1.5 支持一张图片中包含多个人物
  • LatentSync 最适合将现有视频同步到新音频

相关技能

# 完整平台技能(150+ 应用)
npx skills add inference-sh/skills@inference-sh

# 文本转语音(为头像生成音频)
npx skills add inference-sh/skills@text-to-speech

# 语音转文本(为配音进行转录)
npx skills add inference-sh/skills@speech-to-text

# 视频生成
npx skills add inference-sh/skills@ai-video-generation

# 图像生成(创建头像图片)
npx skills add inference-sh/skills@ai-image-generation

浏览所有视频应用:infsh app list --category video

文档

Individual skills in this repo

This repo contains 20 individual skills — each has its own dedicated page.

JantonioFC/skillsbank

AI-powered image editing with style transfer and object removal

JantonioFC/skillsbank

Internationalization and localization patterns. Detecting hardcoded strings, managing translations, locale files, RTL support.

JantonioFC/skillsbank

Analise e auditoria de editais de leilao judicial e extrajudicial. Riscos ocultos, clausulas perigosas, debitos, ocupante e classificacao da oportunidade.

JantonioFC/skillsbank

Embed Photopea in web apps using photopea.js. Covers embedding, file I/O, scripting, exporting, layers, text, filters, and the full Photoshop-compatible API.

JantonioFC/skillsbank

Best practices for Remotion - Video creation in React

JantonioFC/skillsbank

Generate walkthrough videos from Stitch projects using Remotion with smooth transitions, zooming, and text overlays

JantonioFC/skillsbank

Seek and analyze video content using Memories.ai Large Visual Memory Model for persistent video intelligence

JantonioFC/skillsbank

Writes complete, structured landing pages optimized for SEO ranking, AEO citation, and visitor conversion. Activate when the user wants to write or generate a landing page for a product, service, or offer.

JantonioFC/skillsbank

Video and audio perception, indexing, and editing. Ingest files/URLs/live streams, build visual/spoken indexes, search with timestamps, edit timelines, add overlays/subtitles, generate media, and create real-time alerts.

JantonioFC/skillsbank

Upload, stream, search, edit, transcribe, and generate AI video and audio using the VideoDB SDK.

JantonioFC/skillsbank

Skill for discovering and researching autonomous AI agents, tools, and ecosystems using the AgentFolio directory.

JantonioFC/skillsbank

Expert in building portfolios that actually land jobs and clients - not just showing work, but creating memorable experiences. Covers developer portfolios, designer portfolios, creative portfolios, and portfolios that convert visitors into opportunities.

JantonioFC/skillsbank

Tool lifecycle UI components for React/Next.js from ui.inference.sh. Display tool calls: pending, progress, approval required, results. Capabilities: tool status, progress indicators, approval flows, results display. Use for: showing agent tool calls, human-in-the-loop approvals, tool output. Triggers: tool ui, tool calls, tool status, tool approval, tool results, agent tools, mcp tools ui, function calling ui, tool lifecycle, tool pending

JantonioFC/skillsbank

Security audit, hardening, threat modeling (STRIDE/PASTA), Red/Blue Team, OWASP checks, code review, incident response, and infrastructure security for any project.

JantonioFC/skillsbank

When the user wants help with paid advertising campaigns on Google Ads, Meta (Facebook/Instagram), LinkedIn, Twitter/X, or other ad platforms. Also use when the user mentions 'PPC,' 'paid media,' 'ROAS,' 'CPA,' 'ad campaign,' 'retargeting,' 'audience targeting,' 'Google Ads,' 'Facebook ads,'...

JantonioFC/skillsbank

Create AI marketing videos for ads, promos, product launches, and brand content. Models: Veo, Seedance, Wan, FLUX for visuals, Kokoro for voiceover. Types: product demos, testimonials, explainers, social ads, brand videos. Use for: Facebook ads, YouTube ads, product launches, brand awarene...

JantonioFC/skillsbank

Generate AI videos with Google Veo, Seedance, Wan, Grok and 40+ models via inference.sh CLI. Models: Veo 3.1, Veo 3, Seedance 1.5 Pro, Wan 2.5, Grok Imagine Video, OmniHuman, Fabric, HunyuanVideo. Capabilities: text-to-video, image-to-video, lipsync, avatar animation, video upscaling, fole...

JantonioFC/skillsbank

Production-ready CI/CD configurations for Playwright — GitHub Actions, GitLab CI, CircleCI, Azure DevOps, Jenkins, Docker, parallel sharding, reporting, code coverage, and global setup/teardown.

JantonioFC/skillsbank

Next.js 16+ and Turbopack — incremental bundling, FS caching, dev speed, and when to use Turbopack vs webpack.

JantonioFC/skillsbank

You are an expert copy editor specializing in marketing and conversion copy. Your goal is to systematically improve existing copy through focused editing passes while preserving the core message.

相关技能