Communitygithub.com

modbender/skill-library-mcp

通过 inference.sh CLI 创建 AI 虚拟形象和说话头像视频,支持 OmniHuman、Fabric、PixVerse 等模型。

skill-library-mcp 是什么?

此 AI Agent 技能允许用户通过 inference.sh 命令行界面创建 AI 虚拟形象和说话头像视频。它支持多种先进模型,包括字节跳动的 OmniHuman 1.5(支持多人)和 1.0、Fal AI 的 Fabric 1.0(图像说话与口型同步)以及 PixVerse Lipsync(高保真口型同步)。该技能的核心功能是音频驱动:用户提供一张肖像图片和一段音频(语音或音乐),模型即可生成虚拟人物说话或唱歌的视频。此技能由 inference.sh 平台统一提供计算资源,用户只需安装 CLI 工具并登录,无需管理复杂的 GPU 基础设施。主要应用场景包括 AI 演讲者、讲解视频、虚拟网红、多语言配音和营销视频等。此外,该技能还展示了完整的工作流程,如将文本转换为语音再生成虚拟形象视频,或对现有视频进行多语言配音(先转录、翻译、合成语音,最后进行口型同步)。

兼容平台~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/modbender/skill-library-mcp/tree/HEAD/data/ai-avatar-video

在你喜欢的 AI 中提问

打开一个已预加载此 Agent Skill 的新对话。

预览

来自技能 README

AI 虚拟形象与说话头像视频

文档

AI 虚拟形象与说话头像视频

通过 inference.sh CLI 创建 AI 虚拟形象和说话头像视频。

AI 虚拟形象与说话头像视频

快速开始

curl -fsSL https://cli.inference.sh | sh && infsh login

# 从图片 + 音频创建虚拟形象视频
infsh app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

安装说明: 安装脚本 会自动检测您的操作系统/架构,从 dist.inference.sh 下载对应的二进制文件,并验证其 SHA-256 校验和。无需提升权限或后台进程。也可使用手动安装与验证方式。

可用模型

模型应用 ID最佳用途
OmniHuman 1.5bytedance/omnihuman-1-5多人场景,最佳质量
OmniHuman 1.0bytedance/omnihuman-1-0单人场景
Fabric 1.0falai/fabric-1-0图片说话 + 口型同步
PixVerse Lipsyncfalai/pixverse-lipsync高度逼真

搜索虚拟形象应用

infsh app list --search "omnihuman"
infsh app list --search "lipsync"
infsh app list --search "fabric"

示例

OmniHuman 1.5(多人)

infsh app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

支持在多人图片中指定驱动哪个角色。

Fabric 1.0(图像说话)

infsh app run falai/fabric-1-0 --input '{
  "image_url": "https://face.jpg",
  "audio_url": "https://audio.mp3"
}'

PixVerse Lipsync

infsh app run falai/pixverse-lipsync --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

从任意音频生成高度逼真的口型同步效果。

完整工作流:TTS + 虚拟形象

# 1. 从文本生成语音
infsh app run infsh/kokoro-tts --input '{
  "text": "欢迎观看我们的产品演示。今天我将向您展示..."
}' > speech.json

# 2. 使用生成的语音创建虚拟形象视频
infsh app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://presenter-photo.jpg",
  "audio_url": "<step-1 中的音频URL>"
}'

完整工作流:多语言视频配音

# 1. 转录原始视频
infsh app run infsh/fast-whisper-large-v3 --input '{"audio_url": "https://video.mp4"}' > transcript.json

# 2. 翻译文本(手动或使用 LLM)

# 3. 使用新语言生成语音
infsh app run infsh/kokoro-tts --input '{"text": "<翻译后的文本>"}' > new_speech.json

# 4. 将新音频与原始视频进行口型同步
infsh app run infsh/latentsync-1-6 --input '{
  "video_url": "https://original-video.mp4",
  "audio_url": "<新音频URL>"
}'

应用场景

  • 营销:使用 AI 演讲者进行产品演示
  • 教育:课程视频、讲解
  • 本地化:多语言内容配音
  • 社交媒体:统一的虚拟网红
  • 企业:培训视频、公告

提示

  • 使用高质量肖像照片(正面、光线良好)
  • 音频应清晰,背景噪音最小化
  • OmniHuman 1.5 支持一张图片中的多个人物
  • LatentSync 最适合将现有视频与新音频同步

相关技能

# 完整平台技能(150+ 应用)
npx skills add inference-sh/skills@inference-sh

# 文本转语音(为虚拟形象生成音频)
npx skills add inference-sh/skills@text-to-speech

# 语音转文本(转录音频用于配音)
npx skills add inference-sh/skills@speech-to-text

# 视频生成
npx skills add inference-sh/skills@ai-video-generation

# 图像生成(创建虚拟形象图像)
npx skills add inference-sh/skills@ai-image-generation

浏览所有视频应用:infsh app list --category video

文档

Individual skills in this repo

This repo contains 20 individual skills — each has its own dedicated page.

modbender/skill-library-mcp

Paid acquisition strategy, budget allocation, and avoiding common advertising mistakes across platforms

modbender/skill-library-mcp

Complete investment portfolio risk management system. Analyze positions, calculate risk metrics, stress test scenarios, optimize allocations, and generate institutional-grade risk reports — all wit...

modbender/skill-library-mcp

Borrow from Aave via credit delegation. Agent self-funds by borrowing against delegator collateral. Supports borrow, repay, health checks. Works on Aave V2/V3.

modbender/skill-library-mcp

Discover and register autonomous AI agents. Use when: browsing the agent registry, submitting an agent for verification, or embedding agent badges. NOT for: general web search or agent capability analysis.

modbender/skill-library-mcp

AI代码编辑器规则模板集合 - 为Cursor、Windsurf、Claude Code、Cline等AI编辑器提供项目规则配置。适用于需要配置AI编码助手规则的开发者,包含全栈Web、移动端、Vue3+SpringBoot等技术栈模板。

modbender/skill-library-mcp

Generate landing page code from product descriptions

modbender/skill-library-mcp

Create AI marketing videos for ads, promos, product launches, and brand content. Models: Veo, Seedance, Wan, FLUX for visuals, Kokoro for voiceover. Types: product demos, testimonials, explainers, social ads, brand videos. Use for: Facebook ads, YouTube ads, product launches, brand awareness. Triggers: marketing video, ad video, promo video, commercial, brand video, product video, explainer video, ad creative, video ad, facebook ad video, youtube ad, instagram ad, tiktok ad, promotional video, launch video

modbender/skill-library-mcp

Generate AI music videos end-to-end. Creates music with Suno (sunoapi.org), generates visuals with OpenAI/Seedream/Google/Seedance, and assembles into music video with ffmpeg. Supports timestamped lyrics (auto SRT), Suno native music video generation, slideshow/video/hybrid modes. Token-based cost tracking per generation.

modbender/skill-library-mcp

Generate AI-powered notes from videos (document, outline, or graphic-text formats)

modbender/skill-library-mcp

The video AI notes tool is provided by Baidu. Based on the video download address provided by the user, it downloads and parses the video, and finally generates AI notes corresponding to the video (a total of three types of notes can be generated: document notes, outline notes, and image-text notes).

modbender/skill-library-mcp

Automated appointment management for beauty salons, clinics, studios, and photo booths. Handles booking requests, calendar sync, conflict detection, reminders, no-show tracking, and waitlist management.

modbender/skill-library-mcp

Bird identification, life list tracking, and trading card generation. Use this skill when the user: sends a bird photo to identify, says "set up my Birdfolio" or "set my region", asks "how's my checklist", asks "Birdfolio progress", asks "how many birds have I found", asks "show my Birdfolio" or "show my life list", asks "what's my rarest bird", or asks "tell me about [bird species]". Handles everything from first-time setup through ongoing life list tracking and visual trading card generation.

modbender/skill-library-mcp

Multi-project task and research management (JSON-first CLI)

modbender/skill-library-mcp

Track stock and crypto portfolios with CLI - real-time prices, P&L, dividend tracking, multiple portfolios

modbender/skill-library-mcp

Track cryptocurrency portfolios with real-time prices, P&L calculations, and allocation analysis. Query Bitcoin, Ethereum, Solana and 10,000+ token holdings.

modbender/skill-library-mcp

加密貨幣Portfolio追蹤 - 支援TRON/ETH/BSC,分析持倉、收益、Gas費用

modbender/skill-library-mcp

Lead strategy with competitive analysis, strategic planning, growth roadmaps, and business portfolio management.

modbender/skill-library-mcp

Create ATS-optimized resumes and CVs with proper structure, metrics, and industry targeting.

modbender/skill-library-mcp

Use this skill when the user asks to build, create, design, develop, or improve ANY frontend interface, web page, UI component, or visual element. This includes: - Building landing pages, websites, web apps, dashboards, portfolios, or any web interface - Creating UI components (buttons, forms, cards, navbars, modals, etc.) - Designing pages with React, Vue, Next.js, Svelte, or any frontend framework - Adding styling or improving visual design of existing components - Implementing specific design aesthetics (modern, dark, minimalist, brutalist, etc.) - User mentions "frontend", "UI", "UX", "design", "interface", "web design", or "styling" - User asks for "beautiful", "modern", "professional", "clean", or any aesthetic adjective - User requests help with CSS, Tailwind, styled-components, or any styling approach This skill automatically retrieves the appropriate design system prompt (Neo-brutalism, Modern Dark, Bauhaus, Cyberpunk, Material, etc.) to help create visually distinctive, production-grade frontend...

modbender/skill-library-mcp

Native video analysis using Google Gemini API. Upload and analyze video files — describe scenes, extract text/UI, answer questions about content, transcribe speech, identify objects and actions. Use when: (1) User sends a video file and wants it analyzed, (2) Video summarization or description needed, (3) Extracting text, UI elements, or information from screen recordings, (4) Answering questions about video content, (5) Comparing multiple videos, (6) Analyzing tutorials, demos, or walkthroughs.

相关技能