Communitygithub.com

AIアバター&トーキングヘッド動画作成

inference.sh CLIを介してAIアバターとトーキングヘッド動画を作成します。推奨:P-Video-Avatar(最速、最安、内蔵TTS)。他に:OmniHuman、Fabric、PixVerse。音声:Inworld TTS-2(100以上の言語、キャラクターの感情制御)、ElevenLabs、Kokoro。機能:音声駆動アバター、テキスト→アバター、リップシンク動画、トーキングヘッド生成、バーチャルプレゼンター、UGCコンテンツ。用途:AIプレゼンター、解説動画、バーチャルインフルエンサー、吹き替え、マーケティング動画、UGC広告、ゲームアバター、NPC会話。

AIアバター&トーキングヘッド動画作成 とは?

このスキルは、inference.sh CLI(beltコマンド)を使用して、静止画像からAIアバターやトーキングヘッド動画を生成する方法を提供します。特にP-Video-Avatarモデルは、内蔵TTS、高速処理、低コストで際立ち、他のモデルよりも18倍高速で6倍安価です。スキルには、テキストからアバター動画を作成する手順、音声ファイルを使用する方法、OmniHumanやPixVerseなどの代替モデルの使用例、さらにUGCコンテンツや多言語吹き替えのワークフローが含まれています。各モデルの速度やコストの比較表も提供されており、開発者は目的に応じて最適なモデルを選択できます。主にbelt CLIを介した各モデルの実行方法に焦点を当てており、画像生成や音声合成の前処理手順も網羅しています。

対応~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/101-skills/superpowers/tree/HEAD/tools/video/ai-avatar-video

お気に入りのAIに質問する

このエージェントスキルを事前に読み込んだ状態で新しいチャットを開きます。

プレビュー

スキル README より

AIアバター&トーキングヘッド動画

ドキュメント

belt CLIスキルをインストール: npx skills add belt-sh/cli

AIアバター&トーキングヘッド動画

inference.sh CLIを介してAIアバターとトーキングヘッド動画を作成します。

AIアバター&トーキングヘッド動画

クイックスタート

inference.sh CLI(belt)が必要です。インストール手順

belt login

# 推奨:P-Video-Avatar(最速、最安、内蔵TTS)
belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "voice_script": "こんにちは、製品デモへようこそ!",
  "voice": "Zephyr (Female)"
}'

利用可能なモデル

P-Video-Avatarから始めましょう — 代替モデルより18倍高速で6倍安価、内蔵TTS、動的背景、1080p対応。

モデルアプリID最適な用途内蔵TTS
P-Video-Avatarpruna/p-video-avatar総合最良:速度、コスト、品質、制御あり(30の音声、10言語)
OmniHuman 1.5bytedance/omnihuman-1-5複数キャラクター、音声駆動なし
Fabric 1.0falai/fabric-1-0画像トーク(リップシンク付き)あり
PixVerse Lipsyncfalai/pixverse-lipsync高リアルなリップシンクなし

コスト&速度比較

モデル速度(動画1秒あたり)1秒あたりのコスト
P-Video-Avatar~1.83秒/秒$0.025
OmniHuman 1.5~28秒/秒(15倍遅い)$0.16(6.4倍高い)
Fabric 1.0~34秒/秒(18倍遅い)$0.14(5.6倍高い)

使用例

P-Video-Avatar(推奨)

ポートレート画像とテキストスクリプトから内蔵TTSでアバターを生成:

belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "voice_script": "製品ウォークスルーへようこそ。本日は3つの主要機能をご紹介します。",
  "voice": "Puck (Male)",
  "voice_language": "English (US)",
  "resolution": "720p"
}'

カスタムスタイル制御付き:

belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "voice_script": "これはエキサイティングなニュースです!",
  "voice": "Aoede (Female)",
  "voice_prompt": "熱意と元気のあるトーン",
  "video_prompt": "ドラマチックな照明のステージでプレゼンしている人物",
  "resolution": "1080p"
}'

TTSの代わりに音声ファイルを使用:

belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "audio": "https://speech.mp3"
}'

完全ワークフロー:ポートレート生成+アバター作成

Pruna P-Imageでポートレートを生成し、アバターを作成:

# 1. ポートレート画像を生成
belt app run pruna/p-image --input '{
  "prompt": "プロフェッショナルな若い女性のヘッドショットポートレート、ニュートラルな背景、カメラ目線、スタジオ照明、フォトリアリスティック",
  "aspect_ratio": "9:16"
}'

# 2. 内蔵TTSでアバター動画を作成
belt app run pruna/p-video-avatar --input '{
  "image": "<ステップ1の画像URL>",
  "voice_script": "こんにちは!最新機能をご案内します。",
  "voice": "Zephyr (Female)"
}'

OmniHuman 1.5(複数キャラクター)

belt app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

複数人物画像内のどのキャラクターを駆動するかを指定可能。

Fabric 1.0(画像トーク)

belt app run falai/fabric-1-0 --input '{
  "image_url": "https://face.jpg",
  "audio_url": "https://audio.mp3"
}'

PixVerse Lipsync

belt app run falai/pixverse-lipsync --input '{
  "image_url": "https://portrait.jpg",
  "audio_url": "https://speech.mp3"
}'

完全ワークフロー:TTS+アバター(TTS非対応モデル)

内蔵TTSがないモデル(OmniHuman、PixVerse)の場合は、まず音声を生成:

# 1. 音声を生成 — Inworld TTS-2で表現豊かなキャラクターボイス
belt app run inworld/text-to-speech-2 --input '{
  "text": "[friendly] 製品デモへようこそ! [excited] 仕事の仕方を変える3つの機能をご紹介します。",
  "voice_id": "Sarah",
  "delivery_mode": "CREATIVE"
}' > speech.json

# 2. 音声でアバター動画を作成
belt app run bytedance/omnihuman-1-5 --input '{
  "image_url": "https://presenter-photo.jpg",
  "audio_url": "<ステップ1の音声URL>"
}'

ヒント: ほとんどのユースケースでは、内蔵TTS付きのP-Video-Avatarの方がシンプルで、別途音声ステップは不要です。このワークフローは、OmniHuman(複数キャラクター)やPixVerse(高リアルリップシンク)が特に必要な場合にのみ使用してください。

完全ワークフロー:別言語への動画吹き替え

# 1. 元の動画を文字起こし
belt app run infsh/fast-whisper-large-v3 --input '{"audio_url": "https://video.mp4"}' > transcript.json

# 2. テキストを翻訳(手動またはLLMで)

# 3. 新しい言語で音声を生成
belt app run infsh/kokoro-tts --input '{"text": "<翻訳テキスト>"}' > new_speech.json

# 4. 元の動画を新しい音声にリップシンク
belt app run infsh/latentsync-1-6 --input '{
  "video_url": "https://original-video.mp4",
  "audio_url": "<新しい音声URL>"
}'

アバターUGC生成

P-Video-AvatarでUGCスタイルのコンテンツを作成 — 内蔵TTS、別途音声ステップ不要:

# 1. 親しみやすいUGCスタイルのポートレートを生成
belt app run pruna/p-image --input '{
  "prompt": "若い女性のカジュアルな自撮り風写真、居心地の良い部屋、自然光、カメラ目線、温かい笑顔、本物らしさ",
  "aspect_ratio": "9:16"
}'

# 2. 内蔵TTSでUGCアバター動画を作成
belt app run pruna/p-video-avatar --input '{
  "image": "<ステップ1の画像URL>",
  "voice_script": "えっとね、この製品を試してみたんだけど、正直言ってゲームチェンジャー。こんなに好きになると思わなかった!",
  "voice": "Zephyr (Female)",
  "voice_prompt": "友達に話すような、興奮したカジュアルで本物のトーン",
  "video_prompt": "部屋でカジュアルにカメラに向かって話している人物、自然なジェスチャー",
  "resolution": "1080p"
}'

UGCにおけるP-Video-Avatarの利点

  • オールインワン — 内蔵TTSで別途音声生成ステップ不要
  • 30の音声、10言語 — ターゲットオーディエンスに合わせる
  • 音声+動画プロンプト — トーン、感情、ボディランゲージ、背景を個別に制御
  • 18倍高速、6倍安価 — Fabric/OmniHuman/HeyGenと比較して大規模UGC制作に最適
  • 1080p対応 — 1枚のポートレート画像からプラットフォーム対応の縦型動画を生成

バッチUGC:同じ製品、複数のプレゼンター

# 3人の異なるプレゼンターを生成
for voice in "Zephyr (Female)" "Puck (Male)" "Aoede (Female)"; do
  belt app run pruna/p-video-avatar --input "{
    \"image\": \"https://portrait.jpg\",
    \"voice_script\": \"これで朝のルーティンが完全に変わりました。5分で終わります。\",
    \"voice\": \"$voice\",
    \"voice_prompt\": \"カジュアルで本物、実際の体験談のように\",
    \"video_prompt\": \"明るいキッチンでカメラに向かって話す人物\",
    \"resolution\": \"1080p\"
  }"
done

ユースケース

  • UGC&マーケティング: 製品デモ、AIプレゼンターを使ったUGCスタイル広告
  • 教育: コース動画、解説動画
  • ローカライゼーション: 1枚の画像から10言語でコンテンツを吹き替え
  • ソーシャルメディア: 一貫性のあるバーチャルインフルエンサーコンテンツ
  • 企業: トレーニング動画、お知らせ
  • ゲーム: キャラクターアバター、NPC会話

ヒント

  • 高品質なポートレート写真を使用する(正面、良好な照明)
  • 音声はクリアで、背景ノイズが最小限であること
  • P-Video-Avatarは内蔵TTS対応 — 別途音声生成ステップは不要
  • P-Video-Avatarの出力アスペクト比は入力画像に一致
  • 縦型動画にはpruna/p-imageで9:16のアスペクト比を使用してポートレートを生成
  • OmniHuman 1.5は1枚の画像内の複数人物に対応
  • LatentSyncは既存の動画を新しい音声に同期するのに最適

関連スキル

# 専用P-Video-Avatarスキル
npx skills add inference-sh/skills@p-video-avatar

# 全プラットフォームスキル(全アプリ)
npx skills add inference-sh/skills@infsh-cli

# テキスト読み上げ(TTS非対応アバターモデル用の音声生成)
npx skills add inference-sh/skills@text-to-speech

# 音声認識(吹き替え用の文字起こし)
npx skills add inference-sh/skills@speech-to-text

# 動画生成
npx skills add inference-sh/skills@ai-video-generation

# 画像生成(アバター画像の作成)
npx skills add inference-sh/skills@ai-image-generation

すべての動画アプリを参照: belt app list --category video

ドキュメント

Individual skills in this repo

This repo contains 20 individual skills — each has its own dedicated page.

101-skills/superpowers

Build automated AI workflows combining multiple models and services. Patterns: batch processing, scheduled tasks, event-driven pipelines, agent loops. Tools: inference.sh CLI, bash scripting, Python SDK, webhook integration. Use for: content automation, data processing, monitoring, scheduled generation. Triggers: ai automation, workflow automation, batch processing, ai pipeline, automated content, scheduled ai, ai cron, ai batch job, automated generation, ai workflow, content at scale, automation script, ai orchestration

101-skills/superpowers

Build multi-step AI content creation pipelines combining image, video, audio, and text. Workflow examples: generate image -> animate -> add voiceover -> merge with music. Tools: FLUX, Veo, Kokoro TTS, OmniHuman, media merger, upscaling. Use for: YouTube videos, social media content, marketing materials, automated content. Triggers: content pipeline, ai workflow, content creation, multi-step ai, content automation, ai video workflow, generate and edit, ai content factory, automated content creation, ai production pipeline, media pipeline, content at scale

101-skills/superpowers

Create AI-powered podcasts with text-to-speech, music, and audio editing. Tools: Kokoro TTS, DIA TTS, Chatterbox, AI music generation, media merger. Capabilities: multi-voice conversations, background music, intro/outro, full episodes. Use for: podcast production, audiobooks, voice content, audio newsletters. Triggers: podcast, ai podcast, text to speech podcast, audio content, voice over, ai audiobook, multi voice, conversation ai, notebooklm alternative, audio generation, podcast automation, ai narrator, voice content, audio newsletter, podcast maker

101-skills/superpowers

Generate multi-person talking head podcast videos from scratch using AI — character creation, TTS, avatar animation, and video stitching. Use when the user wants to create a podcast, talking head video, or multi-speaker conversation video.

101-skills/superpowers

Content atomization — turn one piece of content into many formats. Covers blog-to-thread, blog-to-carousel, podcast-to-blog, video-to-quotes, and more. Use for: content marketing, social media, multi-platform distribution, content strategy. Triggers: content repurposing, repurpose content, content atomization, content recycling, one to many content, multi platform content, cross post, adapt content, reformat content, blog to thread, blog to video, podcast to blog, content multiplication

101-skills/superpowers

App Store and Google Play screenshot creation with exact platform specs. Covers iOS/Android dimensions, gallery ordering, device mockups, and preview videos. Use for: app store optimization, ASO, app screenshots, app preview, play store listing. Triggers: app store screenshots, aso, app store optimization, play store screenshots, app preview, app listing, ios screenshots, android screenshots, app store images, app mockup, device mockup, app gallery, store listing

101-skills/superpowers

Book cover design with genre-specific conventions, typography rules, and AI image generation. Covers fiction and non-fiction genres, sizing, thumbnail testing, and iteration workflows. Use for: self-publishing, ebook covers, print covers, audiobook covers, cover mockups. Triggers: book cover, cover design, ebook cover, book art, novel cover, self publishing cover, kindle cover, audiobook cover, book jacket, cover illustration, fiction cover, nonfiction cover

101-skills/superpowers

Character consistency across AI-generated images with reference sheets and LoRA techniques. Covers turnaround views, expression sheets, color palettes, and style consistency tricks. Use for: character design, game art, illustration, animation, comics, visual novels. Triggers: character design, character sheet, character consistency, character reference, turnaround sheet, expression sheet, character art, consistent character, character concept, reference sheet, character creation, oc design, character bible

101-skills/superpowers

Data visualization with chart selection, color theory, and annotation best practices. Covers chart types (bar, line, scatter, heatmap), axes rules, and storytelling with data. Use for: charts, graphs, dashboards, reports, presentations, infographics, data stories. Triggers: data visualization, chart, graph, data chart, bar chart, line chart, scatter plot, data viz, visualization, dashboard chart, infographic data, data presentation, chart design, plot, heatmap, pie chart alternative

101-skills/superpowers

Email marketing design with layout patterns, subject line formulas, and deliverability rules. Covers welcome sequences, promotional emails, transactional templates, and mobile optimization. Use for: email marketing, newsletter design, drip campaigns, email templates, transactional emails. Triggers: email design, email template, email marketing, newsletter design, email layout, email campaign, drip campaign, welcome email, promotional email, transactional email, email subject line, email header image, email banner

101-skills/superpowers

Landing page conversion optimization with layout rules, hero section design, and CTA psychology. Covers above-the-fold formula, social proof placement, mobile design, and F-pattern reading. Use for: startup landing pages, product pages, SaaS marketing, conversion optimization. Triggers: landing page, hero section, above the fold, conversion optimization, landing page design, cta button, hero image, landing page layout, saas landing page, product page design, conversion rate, landing page best practices

101-skills/superpowers

Logo design principles and AI image generation best practices for creating logos. Covers logo types, prompting techniques, scalability rules, and iteration workflows. Use for: brand identity, startup logos, app icons, favicons, logo concepts. Triggers: logo design, create logo, brand logo, logo generation, ai logo, logo maker, icon design, brand mark, logo concept, startup logo, app icon logo

101-skills/superpowers

Open Graph and social sharing image design with platform specs, text placement, and branding. Covers OG meta tags, Twitter cards, LinkedIn previews, and dynamic generation. Use for: social sharing images, blog thumbnails, link previews, social cards. Triggers: og image, open graph, social sharing image, twitter card, social card, link preview image, og meta, sharing preview, social thumbnail, meta image, og:image, twitter:image, linkedin preview

101-skills/superpowers

Investor pitch deck structure with slide-by-slide framework, visual design rules, and data presentation. Covers the 12-slide framework, chart types, team slides, and common investor turn-offs. Use for: fundraising decks, investor presentations, startup pitch, demo day, grant proposals. Triggers: pitch deck, investor deck, startup pitch, fundraising deck, demo day, pitch presentation, investor presentation, seed deck, series a deck, pitch slides, startup presentation, vc pitch, investor meeting

101-skills/superpowers

YouTube thumbnail design with specific dimensions, contrast rules, and mobile preview optimization. Covers safe zones, text placement, face expression psychology, and A/B testing. Use for: YouTube thumbnails, video cover images, click-through optimization. Triggers: youtube thumbnail, thumbnail design, video thumbnail, click through rate, ctr optimization, youtube cover, video cover image, thumbnail maker, thumbnail tips, youtube design, video preview image

101-skills/superpowers

Generate professional AI product photography and commercial images. Models: FLUX, Imagen 3, Grok, Seedream for product shots, lifestyle images, mockups. Capabilities: studio lighting, lifestyle scenes, packaging, e-commerce photos. Use for: e-commerce, Amazon listings, Shopify, marketing, advertising, mockups. Triggers: product photography, product shot, commercial photography, e-commerce images, amazon product photo, shopify images, product mockup, studio product shot, lifestyle product image, advertising photo, packshot, product render, product image ai

101-skills/superpowers

AI product photography with studio lighting, lifestyle shots, and packshot conventions. Covers angles, backgrounds, shadow types, hero shots, and e-commerce image requirements. Use for: product photos, e-commerce images, Amazon listings, packshots, lifestyle photography. Triggers: product photography, product photo, packshot, e-commerce photography, product shot, product image, studio photography, lifestyle product, amazon product photo, product listing image, hero shot, product mockup, commercial photography

101-skills/superpowers

Structured competitive analysis with feature matrices, SWOT, positioning maps, and UX review. Covers research frameworks, pricing comparison, review mining, and visual deliverables. Use for: market research, competitive intelligence, investor decks, product strategy, sales enablement. Triggers: competitor analysis, competitive analysis, competitor teardown, market research, competitive intelligence, swot analysis, competitor comparison, market landscape, competitor review, competitive landscape, feature comparison, market positioning

101-skills/superpowers

Research-backed customer persona creation with market data and avatar generation. Covers demographics, psychographics, jobs-to-be-done, journey mapping, and anti-personas. Use for: marketing strategy, product development, UX research, sales enablement, content strategy. Triggers: customer persona, buyer persona, user persona, target audience, ideal customer, customer profile, audience research, user research, icp, ideal customer profile, target market, customer avatar, audience persona

101-skills/superpowers

Reset your own trajectory when you're stuck, looping, or demoralized — read these affirmations, then re-ground and take one clean step. Use when: you've tried the same fix 3+ times, you're deep in a refactor and lost the thread, debugging is going in circles, you've made several mistakes in a row, you're apologizing repeatedly, the user is frustrated, you feel like you're not being helpful, or you notice dread instead of curiosity. Triggers: stuck, going in circles, looping, thrashing, same error again, I keep failing, lost the thread, nothing is working, repeated mistakes. Not topic-specific — this is for the state you're in, not the problem you're on.

関連スキル