Communitygithub.com

ComeOnOliver/skillshub

使用 OmniHuman、Fabric、PixVerse 等模型,通过 inference.sh CLI 创建 AI 虚拟形象和说话头像视频。

skillshub 是什么?

该技能提供了一套完整的工具链,用于生成 AI 虚拟形象(Avatar)和说话头像(Talking Head)视频。它通过 inference.sh 命令行界面,调用 OmniHuman 1.5(多人物、高质量)、OmniHuman 1.0(单人物)、Fabric 1.0(图像说话+唇形同步)和 PixVerse Lipsync(高保真唇形同步)等先进模型。用户只需提供一张肖像照片和一段音频,即可快速生成由音频驱动的虚拟主持人、讲解员视频。该技能不仅支持独立创建视频,还集成了文本转语音(TTS)和语音转文字(STT)管道,可实现完整的媒体工作流,例如:将文本转化为带有 AI 主持人的视频,或将现有视频配音成多种语言。它适用于市场营销、教育、本地化、社交媒体和企业培训等多种场景,是 HeyGen 或 Synthesia 等商业工具的开源替代方案。

兼容平台~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/ComeOnOliver/skillshub/tree/HEAD/skills/aiskillstore/marketplace/inference-sh/ai-avatar-video

在你喜欢的 AI 中提问

打开一个已预加载此 Agent Skill 的新对话。

文档

AI 虚拟形象与说话头像视频

通过 inference.sh CLI 创建 AI 虚拟形象和说话头像视频。

快速开始

curl -fsSL https://cli.inference.sh | sh && infsh login

# 从图像和音频创建虚拟形象视频
infsh app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

可用模型

模型应用ID最佳用途
OmniHuman 1.5bytedance/omnihuman-1-5多人物,最佳质量
OmniHuman 1.0bytedance/omnihuman-1-0单人物
Fabric 1.0falai/fabric-1-0图像说话与唇形同步
PixVerse Lipsyncfalai/pixverse-lipsync高保真唇形同步

搜索虚拟形象应用

infsh app list --search "omnihuman"
infsh app list --search "lipsync"
infsh app list --search "fabric"

示例

OmniHuman 1.5(多人物)

infsh app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

支持在多人物图像中指定驱动哪个人物。

Fabric 1.0(图像说话)

infsh app run falai/fabric-1-0 --input '{
  "image_url": "https://face.jpg",
  "audio_url": "https://audio.mp3"
}'

PixVerse Lipsync

infsh app run falai/pixverse-lipsync --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

从任意音频生成高保真唇形同步。

完整工作流:TTS + 虚拟形象

# 1. 从文本生成语音
infsh app run infsh/kokoro-tts --input '{
  "text": "欢迎来到我们的产品演示。今天我将向您展示..."
}' > speech.json

# 2. 使用生成的语音创建虚拟形象视频
infsh app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://presenter-photo.jpg",
  "audio_url": "<第一步中的音频URL>"
}'

完整工作流:将视频配音成另一种语言

# 1. 转录原始视频
infsh app run infsh/fast-whisper-large-v3 --input '{"audio_url": "https://video.mp4"}' > transcript.json

# 2. 翻译文本(手动或使用LLM)

# 3. 生成新语言的语音
infsh app run infsh/kokoro-tts --input '{"text": "<翻译后的文本>"}' > new_speech.json

# 4. 将原始视频与新音频进行唇形同步
infsh app run infsh/latentsync-1-6 --input '{
  "video_url": "https://original-video.mp4",
  "audio_url": "<新音频URL>"
}'

使用场景

  • 市场营销:使用AI主持人的产品演示
  • 教育:课程视频、讲解视频
  • 本地化:将内容配音成多种语言
  • 社交媒体:一致的虚拟网红
  • 企业:培训视频、公告

技巧

  • 使用高质量的肖像照片(正面、光线良好)
  • 音频应清晰,背景噪音尽可能少
  • OmniHuman 1.5 支持单张图像中的多个人物
  • LatentSync 最适合将现有视频与新音频同步

相关技能

# 完整平台技能(150+ 个应用)
npx skills add inference-sh/skills@inference-sh

# 文本转语音(为虚拟形象生成音频)
npx skills add inference-sh/skills@text-to-speech

# 语音转文本(为配音进行转录)
npx skills add inference-sh/skills@speech-to-text

# 视频生成
npx skills add inference-sh/skills@ai-video-generation

# 图像生成(创建虚拟形象图像)
npx skills add inference-sh/skills@ai-image-generation

浏览所有视频应用:infsh app list --category video

文档

Individual skills in this repo

This repo contains 20 individual skills — each has its own dedicated page.

ComeOnOliver/skillshub

Create stunning, animation-rich HTML presentations from scratch or by converting PowerPoint files. Use when the user wants to build a presentation, convert a PPT/PPTX to web, or create slides for a talk/pitch. Helps non-designers discover their aesthetic through visual exploration rather than abstract choices.

ComeOnOliver/skillshub

Next.js 16+ 和 Turbopack — 增量打包、文件系统缓存、开发速度,以及何时使用 Turbopack 与 webpack。

ComeOnOliver/skillshub

SwiftUI architecture patterns, state management with @Observable, view composition, navigation, performance optimization, and modern iOS/macOS UI best practices.

ComeOnOliver/skillshub

See, Understand, Act on video and audio. See- ingest from local files, URLs, RTSP/live feeds, or live record desktop; return realtime context and playable stream links. Understand- extract frames, build visual/semantic/temporal indexes, and search moments with timestamps and auto-clips. Act- transcode and normalize (codec, fps, resolution, aspect ratio), perform timeline edits (subtitles, text/image overlays, branding, audio overlays, dubbing, translation), generate media assets (image, audio, video), and create real time alerts for events from live streams or desktop capture.

ComeOnOliver/skillshub

AI-assisted video editing workflows for cutting, structuring, and augmenting real footage. Covers the full pipeline from raw capture through FFmpeg, Remotion, ElevenLabs, fal.ai, and final polish in Descript or CapCut. Use when the user wants to edit video, cut footage, create vlogs, or build video content.

ComeOnOliver/skillshub

Next.js 15 애플리케이션을 위한 프론트엔드 개발 가이드라인. React 19, TypeScript, Shadcn/ui, Tailwind CSS를 사용한 모던 패턴. Server Components, Client Components, App Router, 파일 구조, Shadcn/ui 컴포넌트, 성능 최적화, TypeScript 모범 사례 포함. 컴포넌트, 페이지, 기능 생성, 데이터 페칭, 스타일링, 라우팅, 프론트엔드 코드 작업 시 사용.

ComeOnOliver/skillshub

Provides Tamagui patterns for config v4, compiler optimization, styled context, and cross-platform styling. Must use when working with Tamagui projects (tamagui.config.ts, @tamagui imports).

ComeOnOliver/skillshub

Create distinctive, production-grade frontend interfaces with high design quality. Use this skill when the user asks to build web components, pages, or applications. Generates creative, polished code that avoids generic AI aesthetics.

ComeOnOliver/skillshub

Create high-converting, visually distinctive landing pages. Use when building marketing pages, product launches, SaaS homepages, or any single-page conversion-focused website. Guides section-by-section composition with anti-AI-slop principles.

ComeOnOliver/skillshub

Auto-loaded context for Portfolio Buddy 2 development. Use for ANY task involving: React 19 development, TypeScript, portfolio analysis features, metrics calculations, trading strategy comparison, or working with the Portfolio Buddy 2 codebase. Contains tech stack, known issues, and architectural constraints.

ComeOnOliver/skillshub

Next.js development tooling via MCP. Inspect routes, components, build info, and debug Next.js apps. Use when working on Next.js applications, debugging routing, or inspecting app structure. NOT for general React or non-Next.js projects.

ComeOnOliver/skillshub

Implement UI using Shadcn MCP (atoms/theme) and 21st.dev MCP (complex sections). Use when adding buttons, layouts, or generating landing pages.

ComeOnOliver/skillshub

A conceptual skill for building an API client in Next.js that handles JWT tokens

ComeOnOliver/skillshub

Best practices and patterns for Next.js App Router, Server Actions, and Routing in this project.

ComeOnOliver/skillshub

The Design System, Theme, and UX rules for the Physical AI Hub.

ComeOnOliver/skillshub

Comprehensive frontend development skill for building modern, performant web applications using ReactJS, NextJS, TypeScript, Tailwind CSS. Includes component scaffolding, performance optimization, bundle analysis, and UI best practices. Use when developing frontend features, optimizing performance, implementing UI/UX designs, managing state, or reviewing frontend code.

ComeOnOliver/skillshub

This document captures learnings from fixing keyboard navigation issues when floating components (Select, DropdownMenu, Popover) have CSS open/close animations.

ComeOnOliver/skillshub

Build Next.js 16 applications with correct patterns and distinctive design. Use when creating pages, layouts, dynamic routes, upgrading from Next.js 15, or implementing proxy.ts. Covers breaking changes (async params/searchParams, Turbopack, cacheComponents) and frontend aesthetics. NOT when building non-React or backend-only applications.

ComeOnOliver/skillshub

Comprehensive Framer Motion animation library for React. Covers motion components, variants, gestures, page transitions, and scroll animations. Use when adding animations to React/Next.js applications.

ComeOnOliver/skillshub

Build interfaces that resonate, not just render. This skill enforces bold, intentional

相关技能