Communitygithub.com

oyi77/1ai-skills

将音乐曲目转换为节拍同步的 HyperFrames 视频——歌词、幻灯片或动态宣传片。当用户提供音频文件、要提取音频的视频或用于生成音乐的情绪简介时使用。音乐驱动节奏。

1ai-skills 是什么?

此技能利用 HyperFrames 合成引擎,从音频文件中生成一个将音频视觉化的视频——波形或节拍同步元素。当需要为曲目创建配套视觉内容而无需手动编辑时,即可使用该技能。它支持三种音频输入路径:用户直接提供音频文件、从视频中提取音频,或根据情绪简介(如“为产品发布准备的欢快低保真音乐”)生成音乐。工作流包括:使用 ffprobe 探测音频时长和 BPM,编写节拍映射(如 intro、verse、chorus、outro 等部分),为每个音乐部分规划视觉处理方案,并将动画起始时间锚定到节拍映射上。最后通过 `npx hyperframes render` 命令渲染为 MP4 文件。该技能适用于歌词视频、节拍同步幻灯片和动态宣传片,但不适用于产品发布视频、人物口播视频或配音解说场景。

兼容平台~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/oyi77/1ai-skills/tree/HEAD/content/hyperframes-music-to-video

在你喜欢的 AI 中提问

打开一个已预加载此 Agent Skill 的新对话。

文档

概述

此技能使用 HyperFrames 合成引擎,从音乐文件生成一个将音频视觉化的视频——波形或节拍同步元素。当需要为曲目创建配套视觉内容而无需手动编辑时使用。它会从合成中渲染最终的 MP4。

HyperFrames — 音乐转视频

一个音乐曲目 → 一个节拍同步的视频。歌词、幻灯片或动态宣传片。音乐驱动节奏。

何时使用

  • 用户提供一个 音频文件 并希望为其制作视频
  • 用户提供一个 要从中提取音频的视频(音乐提取)
  • 用户提供一个 情绪简介(“为产品发布准备的欢快低保真音乐”)
  • 用户想要一个 歌词视频(歌词与声乐同步)
  • 用户想要一个 节拍同步的幻灯片(图片随节拍切换)
  • 用户想要一个 动态宣传片(字体随曲目脉动)

何时不使用

  • 用户想要一个从 URL 生成的产品发布视频(使用 hyperframes-product-launch-video)
  • 用户想要一个人物口播视频(使用 hyperframes-talking-head-recut)
  • 用户想要配音/画外音(使用 hyperframes-faceless-explainer)
  • 不涉及音乐(使用 hyperframes-motion-graphics)

工作流

1 · 解析音频

三种输入路径:

  • 提供了音频文件: 使用 ffprobe 探测时长、BPM(估算或检测)
  • 提供了视频: 使用 ffmpeg -i input.mp4 -vn -acodec libmp3lame audio.mp3 提取音频
  • 情绪简介: 通过 TTS/音乐模型生成,或从目录 BGM 中选择

2 · 映射节拍结构

聆听(或分析)各乐段:

  • 前奏(0-8s)→ 标题/建立氛围
  • 主歌 → 内容/幻灯片
  • 副歌/高潮 → 高潮/动态峰值
  • 尾声 → 行动号召/淡出

编写节拍映射:[{ time: 0, section: "intro" }, { time: 8, section: "verse" }, ...]

3 · 为各乐段规划场景

每个乐段获得一种视觉处理方案:

  • 前奏: 缓慢淡入,最小运动
  • 主歌: 稳定揭示,每 2-4 拍一个元素
  • 副歌: 最大能量——缩放爆发、颜色变化、快速切换
  • 桥段: 视觉喘息——静态保持或慢速平移
  • 尾声: 解析为结束卡

4 · 构建合成

将所有动画起始时间锚定到节拍映射。使用 CSS 关键帧或 GSAP,并设置与乐段边界匹配的绝对时间。

<div id="main" data-composition-id="music-video"
     data-start="0" data-duration="60" data-width="1080" data-height="1920" data-fps="30">
  <div class="clip chorus-hit" data-start="32" data-duration="8" data-track-index="1">
    <h1 class="lyric-line">副歌歌词在此</h1>
  </div>
  <audio data-start="0" data-duration="60" src="./track.mp3"></audio>
</div>

5 · 渲染

npx hyperframes render --output music-video.mp4

验证同步:在乐段边界处采样帧,确认视觉变化落在节拍上(±2 帧容差)。

反合理化表

合理化现实
“我会目测时间”先编写节拍映射——每个场景都锚定到乐段时间
“我会全程保持相同能量”副歌比主歌更有力——动态很重要
“我会跳过音频探测”时长/BPM 不匹配会破坏整个渲染
“我会按实时时钟进行动画”所有动画都支持跳转——合成中使用绝对时间

验证

  • 音频已解析(文件、提取或生成)
  • 节拍映射已编写,包含乐段边界
  • 每个乐段都有独特的视觉处理方案
  • 动画时间与节拍映射匹配(±2 帧)
  • 输出时长与音频时长匹配
  • 副歌/高潮在视觉上与主歌有明显区别

Individual skills in this repo

This repo contains 12 individual skills — each has its own dedicated page.

oyi77/1ai-skills

Turn a weekly changelog .md into a finished branded changelog video using HyperFrames. Use when the user provides a changelog/digest markdown and wants the weekly video, or says 'changelog video'. Self-contained — fonts, background, lexicon, and scripts ship in the skill. Produces square 1080, ~45-60s videos with animated brand mock-UIs.

oyi77/1ai-skills

The transition technique catalog for HyperFrames videos — five velocity-matched SEAMS (zoom-through, inverse zoom-through, cut-the-curve, waterfall cut, rack-focus blur-cut) plus in-scene techniques (waterfall entry, nudge curve). Covers partial-travel velocity matching, Z scale-sign rule, size-scaled blur, the 10/65/25 slide ratio, and the 2-3 transition budget. Read before authoring any transition, text-beat handoff, or kinetic text entry.

oyi77/1ai-skills

Add captions/subtitles to talking-head or launch videos using HyperFrames. Use when the user wants embedded captions, verbatim caption rails, or cinematic text behind the subject. Covers the drop/rail/embed caption model, the overlay law (captions are NOT a reserved band), matte occlusion for embedded climaxes, and word-timestamp alignment from TTS output.

oyi77/1ai-skills

Turn arbitrary text — an article, notes, a topic, a brief — into a faceless explainer video using HyperFrames. Use when the user wants a topic explainer, concept breakdown, how-to, or listicle with no product/website to capture. Every visual is invented per scene (typography, abstract graphics, diagrams, data-viz). Not a video built from a website (use hyperframes-product-launch-video).

oyi77/1ai-skills

The fallback HyperFrames workflow for anything that doesn't fit other skills — longer multi-scene pieces, brand/sizzle reels, title cards, static loops, freeform compositions. Input- and length-agnostic. Also the home of companion mode (co-create with the full toolbox). Use when no other HyperFrames skill matches, or when the user wants a freeform video.

oyi77/1ai-skills

Create short, unnarrated, design-led motion graphics (~under 10s) using HyperFrames. Use when the user wants kinetic type, stat/chart hits, logo stings, lower-thirds, animated tweets/headlines, or transparent overlay motion graphics. MP4 or transparent overlay output. Teaches seek-safe keyframe authoring and the 2-3 transition budget rule.

oyi77/1ai-skills

Create product launch videos from a URL, brief, or script using HyperFrames (HTML→MP4). Use when the user wants a product launch video, site tour, social clip featuring a product's own visuals, or marketing/promoting a product. Up to ~3 min (sweet spot 30-90s). Teaches the HyperFrames production loop: plan → write HTML → wire seekable animations → add media → lint → preview → render.

oyi77/1ai-skills

The Video Production Manager — manages ALL video production under 1ai-content. Delegates to HyperFrames, Remotion, AI video, and FFmpeg based on the task. Has memory via 1ai-hub brain, follows 1ai-rules, and reports to Content Director. Use when the user says 'make a video', 'create video', 'edit video', 'video strategy', or needs any video production work.

oyi77/1ai-skills

Agent skill at content/video/gen/SKILL.md

oyi77/1ai-skills

Use when track portfolio company KPIs, variances, returns analysis. Use when user says "monitor portfolio", "track KPIs", "portfolio returns".

oyi77/1ai-skills

Use when go-to-market planning — launch sequencing, channel strategy, audience building, PR outreach. Use when planning product launches, building launch checklists, or coordinating multi-channel campaigns.

oyi77/1ai-skills

Use when portfolio manager — capital allocation, risk management, and performance metrics tracking for trading strategies.

相关技能