Communitygithub.com

JantonioFC/skillsbank

透過 inference.sh CLI 使用 OmniHuman、Fabric、PixVerse 建立 AI 頭像和說話頭影片。模型:OmniHuman 1.5、OmniHuman 1.0、Fabric 1.0、PixVerse Lipsync。功能:音訊驅動頭像、嘴型同步影片、說話頭生成、虛擬主講人。適用:AI 主講人、解釋影片……

skillsbank 是什麼?

此技能讓開發者能透過 inference.sh CLI,一鍵生成 AI 頭像與說話頭影片。它整合了多個頂尖模型:OmniHuman 1.5 與 1.0 支援單圖或多人物頭像驅動、Fabric 1.0 實現圖片對話並嘴型同步、PixVerse Lipsync 提供高擬真唇音匹配。技能支援完整的媒體工作流程,例如先以 TTS 將文字轉為語音,再餵入頭像模型生成影片;或者進行語言配音:先轉錄原始影片、翻譯文字、生成新語音,再透過 LatentSync 調整影片嘴型。使用方式非常直觀:安裝 CLI 後透過 `infsh app run` 指令呼叫各模型,並以 JSON 格式傳入圖片與音訊網址。這項技能特別適合行銷自製產品展示、教育講解、多語言在地化、社群虛擬網紅與企業訓練影片等場景。開發者也可以搭配其他 inference.sh 技能(如文字轉語音、語音轉文字、影片生成)建構更複雜的媒體管道。

相容平台~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/JantonioFC/skillsbank/tree/HEAD/skills/ai-avatar-video

在你喜歡的 AI 中提問

開啟一個已預先載入此 Agent Skill 的新對話。

預覽

來自技能 README

AI 頭像與說話頭影片

說明文件

AI 頭像與說話頭影片

使用時機

依需要執行指定的自動化作業時,可運用此技能。

透過 inference.sh CLI 建立 AI 頭像與說話頭影片。

AI 頭像與說話頭影片

快速開始

curl -fsSL https://cli.inference.sh | sh && infsh login

# 從圖片 + 音訊建立頭像影片
infsh app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

可用模型

模型App ID最佳用途
OmniHuman 1.5bytedance/omnihuman-1-5多角色,最佳品質
OmniHuman 1.0bytedance/omnihuman-1-0單一角色
Fabric 1.0falai/fabric-1-0圖片說話並嘴型同步
PixVerse Lipsyncfalai/pixverse-lipsync高度逼真

搜尋頭像應用

infsh app list --search "omnihuman"
infsh app list --search "lipsync"
infsh app list --search "fabric"

範例

OmniHuman 1.5(多角色)

infsh app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

支援在多人圖片中指定要驅動的角色。

Fabric 1.0(圖片說話)

infsh app run falai/fabric-1-0 --input '{
  "image_url": "https://face.jpg",
  "audio_url": "https://audio.mp3"
}'

PixVerse Lipsync

infsh app run falai/pixverse-lipsync --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

從任何音訊產生高度逼真的嘴型同步。

完整工作流程:TTS + 頭像

# 1. 從文字生成語音
infsh app run infsh/kokoro-tts --input '{
  "text": "歡迎觀看我們的產品展示。今天我將向您介紹……"
}' > speech.json

# 2. 用生成的語音建立頭像影片
infsh app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://presenter-photo.jpg",
  "audio_url": "<步驟1的音訊網址>"
}'

完整工作流程:為影片配音到另一語言

# 1. 轉錄原始影片
infsh app run infsh/fast-whisper-large-v3 --input '{"audio_url": "https://video.mp4"}' > transcript.json

# 2. 手動或使用 LLM 翻譯文字

# 3. 用新語言生成語音
infsh app run infsh/kokoro-tts --input '{"text": "<翻譯後文字>"}' > new_speech.json

# 4. 用新音訊對原始影片進行嘴型同步
infsh app run infsh/latentsync-1-6 --input '{
  "video_url": "https://original-video.mp4",
  "audio_url": "<新音訊網址>"
}'

使用案例

  • 行銷:利用 AI 主講人進行產品展示
  • 教育:課程影片、解說影片
  • 在地化:以多種語言配音內容
  • 社群媒體:一致的虛擬網紅
  • 企業:訓練影片、公告

提示

  • 使用高品質正面肖像照(正面、光線良好)
  • 音訊應清晰,背景噪音最小化
  • OmniHuman 1.5 支援單張圖片中的多人
  • LatentSync 最適合將現有影片與新音訊同步

相關技能

# 完整平台技能(所有 150 多個應用)
npx skills add inference-sh/skills@inference-sh

# 文字轉語音(為頭像生成音訊)
npx skills add inference-sh/skills@text-to-speech

# 語音轉文字(為配音轉錄)
npx skills add inference-sh/skills@speech-to-text

# 影片生成
npx skills add inference-sh/skills@ai-video-generation

# 圖片生成(建立頭像圖片)
npx skills add inference-sh/skills@ai-image-generation

瀏覽所有影片應用:infsh app list --category video

文件

Individual skills in this repo

This repo contains 20 individual skills — each has its own dedicated page.

JantonioFC/skillsbank

AI-powered image editing with style transfer and object removal

JantonioFC/skillsbank

Internationalization and localization patterns. Detecting hardcoded strings, managing translations, locale files, RTL support.

JantonioFC/skillsbank

Analise e auditoria de editais de leilao judicial e extrajudicial. Riscos ocultos, clausulas perigosas, debitos, ocupante e classificacao da oportunidade.

JantonioFC/skillsbank

Embed Photopea in web apps using photopea.js. Covers embedding, file I/O, scripting, exporting, layers, text, filters, and the full Photoshop-compatible API.

JantonioFC/skillsbank

Best practices for Remotion - Video creation in React

JantonioFC/skillsbank

Generate walkthrough videos from Stitch projects using Remotion with smooth transitions, zooming, and text overlays

JantonioFC/skillsbank

Seek and analyze video content using Memories.ai Large Visual Memory Model for persistent video intelligence

JantonioFC/skillsbank

Writes complete, structured landing pages optimized for SEO ranking, AEO citation, and visitor conversion. Activate when the user wants to write or generate a landing page for a product, service, or offer.

JantonioFC/skillsbank

Video and audio perception, indexing, and editing. Ingest files/URLs/live streams, build visual/spoken indexes, search with timestamps, edit timelines, add overlays/subtitles, generate media, and create real-time alerts.

JantonioFC/skillsbank

Upload, stream, search, edit, transcribe, and generate AI video and audio using the VideoDB SDK.

JantonioFC/skillsbank

Skill for discovering and researching autonomous AI agents, tools, and ecosystems using the AgentFolio directory.

JantonioFC/skillsbank

Expert in building portfolios that actually land jobs and clients - not just showing work, but creating memorable experiences. Covers developer portfolios, designer portfolios, creative portfolios, and portfolios that convert visitors into opportunities.

JantonioFC/skillsbank

Tool lifecycle UI components for React/Next.js from ui.inference.sh. Display tool calls: pending, progress, approval required, results. Capabilities: tool status, progress indicators, approval flows, results display. Use for: showing agent tool calls, human-in-the-loop approvals, tool output. Triggers: tool ui, tool calls, tool status, tool approval, tool results, agent tools, mcp tools ui, function calling ui, tool lifecycle, tool pending

JantonioFC/skillsbank

Security audit, hardening, threat modeling (STRIDE/PASTA), Red/Blue Team, OWASP checks, code review, incident response, and infrastructure security for any project.

JantonioFC/skillsbank

When the user wants help with paid advertising campaigns on Google Ads, Meta (Facebook/Instagram), LinkedIn, Twitter/X, or other ad platforms. Also use when the user mentions 'PPC,' 'paid media,' 'ROAS,' 'CPA,' 'ad campaign,' 'retargeting,' 'audience targeting,' 'Google Ads,' 'Facebook ads,'...

JantonioFC/skillsbank

Create AI marketing videos for ads, promos, product launches, and brand content. Models: Veo, Seedance, Wan, FLUX for visuals, Kokoro for voiceover. Types: product demos, testimonials, explainers, social ads, brand videos. Use for: Facebook ads, YouTube ads, product launches, brand awarene...

JantonioFC/skillsbank

Generate AI videos with Google Veo, Seedance, Wan, Grok and 40+ models via inference.sh CLI. Models: Veo 3.1, Veo 3, Seedance 1.5 Pro, Wan 2.5, Grok Imagine Video, OmniHuman, Fabric, HunyuanVideo. Capabilities: text-to-video, image-to-video, lipsync, avatar animation, video upscaling, fole...

JantonioFC/skillsbank

Production-ready CI/CD configurations for Playwright — GitHub Actions, GitLab CI, CircleCI, Azure DevOps, Jenkins, Docker, parallel sharding, reporting, code coverage, and global setup/teardown.

JantonioFC/skillsbank

Next.js 16+ and Turbopack — incremental bundling, FS caching, dev speed, and when to use Turbopack vs webpack.

JantonioFC/skillsbank

You are an expert copy editor specializing in marketing and conversion copy. Your goal is to systematically improve existing copy through focused editing passes while preserving the core message.

相關技能