Communitygithub.com

AI 阿凡達與對嘴影片

透過 inference.sh CLI 創建 AI 阿凡達和對嘴說話頭像影片,支援 OmniHuman、Fabric、PixVerse 等多種模型。

AI 阿凡達與對嘴影片 是什麼?

此技能提供一個完整的解決方案,用於創建 AI 阿凡達和對嘴說話頭像影片,所有操作均透過 inference.sh 命令行介面完成。它整合了多種頂尖模型,包括 ByteDance 的 OmniHuman 1.5(支援多人影像、最佳品質)、OmniHuman 1.0(單人影像)、Fabric 1.0(圖片說話+對嘴)以及 PixVerse Lipsync(高擬真度)。開發者可以透過簡單的 CLI 命令,將圖片與音訊結合,生成栩栩如生的虛擬主播。此技能尤其適合需要快速生成行銷影片、教育內容、虛擬網紅或進行多語言配音的場景。它支援完整的媒體工作流程,例如先使用 TTS 生成語音,再將其應用於阿凡達,或透過語音轉文字、翻譯、再生成語音的方式為現有影片進行多語言配音。平台支援方面,此技能專為 inference.sh 生態系設計,所有操作皆透過其 CLI 工具 `infsh` 執行,無需複雜的程式碼或後端設置。

相容平台~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/modbender/skill-library-mcp/tree/HEAD/data/ai-avatar-video

在你喜歡的 AI 中提問

開啟一個已預先載入此 Agent Skill 的新對話。

預覽

來自技能 README

AI 阿凡達與對嘴影片

說明文件

AI 阿凡達與對嘴影片 是做什麼的?

透過 inference.sh CLI 創建 AI 阿凡達和對嘴說話頭像影片。

AI 阿凡達與對嘴影片

快速開始

curl -fsSL https://cli.inference.sh | sh && infsh login

# 從圖片 + 音訊創建阿凡達影片
infsh app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

安裝說明: 安裝腳本會自動偵測您的作業系統與架構,從 dist.inference.sh 下載相符的二進位檔,並驗證其 SHA-256 校驗碼。無需提升權限或常駐背景程序。也提供手動安裝與驗證方式。

可用模型

模型應用程式 ID最佳用途
OmniHuman 1.5bytedance/omnihuman-1-5多人角色,最佳品質
OmniHuman 1.0bytedance/omnihuman-1-0單人角色
Fabric 1.0falai/fabric-1-0圖片說話 + 對嘴
PixVerse Lipsyncfalai/pixverse-lipsync高擬真度

搜尋阿凡達應用程式

infsh app list --search "omnihuman"
infsh app list --search "lipsync"
infsh app list --search "fabric"

範例

OmniHuman 1.5 (多人角色)

infsh app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

支援在多人圖片中指定要驅動的角色。

Fabric 1.0 (圖片說話)

infsh app run falai/fabric-1-0 --input '{
  "image_url": "https://face.jpg",
  "audio_url": "https://audio.mp3"
}'

PixVerse Lipsync

infsh app run falai/pixverse-lipsync --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

從任何音訊生成高擬真度的對嘴影片。

完整工作流程:TTS + 阿凡達

# 1. 從文字生成語音
infsh app run infsh/kokoro-tts --input '{
  "text": "歡迎來到我們的產品展示。今天我將向您展示..."
}' > speech.json

# 2. 使用生成的語音創建阿凡達影片
infsh app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://presenter-photo.jpg",
  "audio_url": "<step-1-audio-url>"
}'

完整工作流程:替影片進行多語言配音

# 1. 轉錄原始影片
infsh app run infsh/fast-whisper-large-v3 --input '{"audio_url": "https://video.mp4"}' > transcript.json

# 2. 翻譯文字(手動或使用 LLM)

# 3. 以新語言生成語音
infsh app run infsh/kokoro-tts --input '{"text": "<translated-text>"}' > new_speech.json

# 4. 將原始影片與新音訊進行對嘴同步
infsh app run infsh/latentsync-1-6 --input '{
  "video_url": "https://original-video.mp4",
  "audio_url": "<new-audio-url>"
}'

使用案例

  • 行銷:使用 AI 主播進行產品展示
  • 教育:課程影片、解說
  • 本地化:將內容配音成多種語言
  • 社交媒體:一致的虛擬網紅
  • 企業:培訓影片、公告

提示

  • 使用高品質的半身照(正面、光線良好)
  • 音訊應清晰且背景雜訊最小
  • OmniHuman 1.5 支援單張圖片中的多人
  • LatentSync 最適合將現有影片與新音訊同步

相關技能

# 完整平台技能(150+ 個應用程式)
npx skills add inference-sh/skills@inference-sh

# 文字轉語音(為阿凡達生成音訊)
npx skills add inference-sh/skills@text-to-speech

# 語音轉文字(為配音進行轉錄)
npx skills add inference-sh/skills@speech-to-text

# 影片生成
npx skills add inference-sh/skills@ai-video-generation

# 圖片生成(創建阿凡達圖片)
npx skills add inference-sh/skills@ai-image-generation

瀏覽所有影片應用程式:infsh app list --category video

文件

Individual skills in this repo

This repo contains 20 individual skills — each has its own dedicated page.

modbender/skill-library-mcp

Paid acquisition strategy, budget allocation, and avoiding common advertising mistakes across platforms

modbender/skill-library-mcp

Complete investment portfolio risk management system. Analyze positions, calculate risk metrics, stress test scenarios, optimize allocations, and generate institutional-grade risk reports — all wit...

modbender/skill-library-mcp

Borrow from Aave via credit delegation. Agent self-funds by borrowing against delegator collateral. Supports borrow, repay, health checks. Works on Aave V2/V3.

modbender/skill-library-mcp

Discover and register autonomous AI agents. Use when: browsing the agent registry, submitting an agent for verification, or embedding agent badges. NOT for: general web search or agent capability analysis.

modbender/skill-library-mcp

AI代码编辑器规则模板集合 - 为Cursor、Windsurf、Claude Code、Cline等AI编辑器提供项目规则配置。适用于需要配置AI编码助手规则的开发者,包含全栈Web、移动端、Vue3+SpringBoot等技术栈模板。

modbender/skill-library-mcp

Generate landing page code from product descriptions

modbender/skill-library-mcp

Create AI marketing videos for ads, promos, product launches, and brand content. Models: Veo, Seedance, Wan, FLUX for visuals, Kokoro for voiceover. Types: product demos, testimonials, explainers, social ads, brand videos. Use for: Facebook ads, YouTube ads, product launches, brand awareness. Triggers: marketing video, ad video, promo video, commercial, brand video, product video, explainer video, ad creative, video ad, facebook ad video, youtube ad, instagram ad, tiktok ad, promotional video, launch video

modbender/skill-library-mcp

Generate AI music videos end-to-end. Creates music with Suno (sunoapi.org), generates visuals with OpenAI/Seedream/Google/Seedance, and assembles into music video with ffmpeg. Supports timestamped lyrics (auto SRT), Suno native music video generation, slideshow/video/hybrid modes. Token-based cost tracking per generation.

modbender/skill-library-mcp

Generate AI-powered notes from videos (document, outline, or graphic-text formats)

modbender/skill-library-mcp

The video AI notes tool is provided by Baidu. Based on the video download address provided by the user, it downloads and parses the video, and finally generates AI notes corresponding to the video (a total of three types of notes can be generated: document notes, outline notes, and image-text notes).

modbender/skill-library-mcp

Automated appointment management for beauty salons, clinics, studios, and photo booths. Handles booking requests, calendar sync, conflict detection, reminders, no-show tracking, and waitlist management.

modbender/skill-library-mcp

Bird identification, life list tracking, and trading card generation. Use this skill when the user: sends a bird photo to identify, says "set up my Birdfolio" or "set my region", asks "how's my checklist", asks "Birdfolio progress", asks "how many birds have I found", asks "show my Birdfolio" or "show my life list", asks "what's my rarest bird", or asks "tell me about [bird species]". Handles everything from first-time setup through ongoing life list tracking and visual trading card generation.

modbender/skill-library-mcp

Multi-project task and research management (JSON-first CLI)

modbender/skill-library-mcp

Track stock and crypto portfolios with CLI - real-time prices, P&L, dividend tracking, multiple portfolios

modbender/skill-library-mcp

Track cryptocurrency portfolios with real-time prices, P&L calculations, and allocation analysis. Query Bitcoin, Ethereum, Solana and 10,000+ token holdings.

modbender/skill-library-mcp

加密貨幣Portfolio追蹤 - 支援TRON/ETH/BSC,分析持倉、收益、Gas費用

modbender/skill-library-mcp

Lead strategy with competitive analysis, strategic planning, growth roadmaps, and business portfolio management.

modbender/skill-library-mcp

Create ATS-optimized resumes and CVs with proper structure, metrics, and industry targeting.

modbender/skill-library-mcp

Use this skill when the user asks to build, create, design, develop, or improve ANY frontend interface, web page, UI component, or visual element. This includes: - Building landing pages, websites, web apps, dashboards, portfolios, or any web interface - Creating UI components (buttons, forms, cards, navbars, modals, etc.) - Designing pages with React, Vue, Next.js, Svelte, or any frontend framework - Adding styling or improving visual design of existing components - Implementing specific design aesthetics (modern, dark, minimalist, brutalist, etc.) - User mentions "frontend", "UI", "UX", "design", "interface", "web design", or "styling" - User asks for "beautiful", "modern", "professional", "clean", or any aesthetic adjective - User requests help with CSS, Tailwind, styled-components, or any styling approach This skill automatically retrieves the appropriate design system prompt (Neo-brutalism, Modern Dark, Bauhaus, Cyberpunk, Material, etc.) to help create visually distinctive, production-grade frontend...

modbender/skill-library-mcp

Native video analysis using Google Gemini API. Upload and analyze video files — describe scenes, extract text/UI, answer questions about content, transcribe speech, identify objects and actions. Use when: (1) User sends a video file and wants it analyzed, (2) Video summarization or description needed, (3) Extracting text, UI elements, or information from screen recordings, (4) Answering questions about video content, (5) Comparing multiple videos, (6) Analyzing tutorials, demos, or walkthroughs.

相關技能