Communitygithub.com

samyakiasonline-ctrl/hyperframe

当 HyperFrames 合成中的音频需要进行混合处理时使用:淡入/淡出、交叉淡化、音轨增益或音量、音量自动化、闪避、音乐背景对抗旁白(旁白雕刻)、音轨效果(均衡器、压缩器、限制器、门限、饱和器、延迟、混响、合唱、移相器、比特压缩器)、在音轨音量或任何效果参数上绘制的自动化包络,或一个 submix 总线承载一个效果链、一个推子和一个自动化时钟以同时处理多个音轨(`<hf-audio-group>`)。

hyperframe 是什么?

该技能专注于在 HyperFrames 环境中对已放置的音频进行后期混合和处理。它提供了一套完整的 Web Audio 工具,用于表达音轨之间的复杂关系,而不是简单地将独立处理的效果堆叠在一起。技能的核心在于通过 `data-fx-chain`、`data-automation` 和 `data-fx-carve` 等属性来定义效果链、自动化包络和语音雕刻。支持包括均衡器、压缩器、混响、延迟在内的多种效果家族,并提供了一个“语音雕刻”功能来解决音乐背景与旁白之间的频率冲突。它强调所有调整(预览和渲染)都基于同一个 Web Audio 图形实现,保证所见即所得,避免了重复调整。该技能适用于 Claude Code、Cursor 及类似 Agent。

兼容平台~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/samyakiasonline-ctrl/hyperframe/tree/HEAD/.claude/skills/hyperframes-audio

在你喜欢的 AI 中提问

打开一个已预加载此 Agent Skill 的新对话。

文档

插件安装: 在执行设置或刷新命令前,如果此技能位于 HyperFrames 插件内部,请遵循插件执行规则。独立安装则保留下面的更新说明。

HyperFrames 音频

混音是一组关系,而不是处理器的堆叠。两个单独听起来不错的音轨放在一起可能无法入耳,解决方案几乎从不是“把其中一个调小”——而是要找出它们在争夺什么,并将其交给需要它的那一个。这里的每个工具都用于表达其中一种关系。

效果作用于元素上,作为 data-fx-chain,预览和渲染运行相同的 Web Audio 图——在浏览器中,工作室以实时上下文运行,引擎以离线方式运行。每个效果只有一个实现,所以你在拖动时间线时听到的就是最终写入的内容。你永远不需要调整两次。

片段时间仍属于 /hyperframes-core:音频/视频修剪和源范围使用 data-start、data-duration 和 data-media-start,交叉淡化重叠不同音轨上的片段。此技能负责已放置轨道的淡入/淡出、交叉淡化包络、音轨增益/音量、音量和效果自动化、闪避/旁白雕刻以及效果链。/media-use 负责来源查找、生成和预处理。

常量 data-playback-rate(0.1..10)在匹配的音频/视频元素使用相同的时间、源偏移和速率时,对画面和保持音调的声音是渲染安全的。速度斜坡是 data-automation 中的一条 rate 通道(参见 docs/reference/speed-ramps);它优先于常量,并在预览和渲染中保持音调。HyperFrames 不提供自动波形同步或漂移修正。 对于可复制的剪切/交叉淡化/重定时配方,请使用 /hyperframes-core → references/creator-editing-recipes.md。

三个属性承载所有内容,位于音频/视频元素本身——或者,对于前两个,位于 <hf-audio-group> 总线上(参见“一个总线用于多个音轨”):

属性承载内容
data-fx-chain效果链,按信号顺序
data-automation此音轨音量或其效果参数的包络
data-fx-carve雕刻自身的设置,以便可以重新推导

附带的效果族有:增益、均衡器(高通、低通、峰值、搁架)、压缩器、限制器、门限、饱和器、延迟、混响、合唱、移相器和比特压缩器。

每个效果的精确 JSON,以及通道必须满足的规则:references/attributes.md。 每个效果及其参数、范围和单位:references/fx-registry.md。 如何处理听不到的文件并找出问题:references/diagnosis.md。 预设、命名任务和单旋钮配置文件,以及症状到修复的表格:references/presets.md——在手动构建效果链前请阅读此文件,因为通常其中一个预设或命名任务已经指出了问题。

整体工作原理

两个创作界面写入这些属性;两个运行时通过相同的构建器读取它们。这种共享的中间层是预览能预测渲染结果的原因。

flowchart TB
  voice["旁白音轨<br/>媒体文件"]
  bed["背景音乐音轨<br/>媒体文件"]

  subgraph AUTHOR["创作——唯一写入属性的地方"]
    panel["工作室<br/>旁白雕刻控制"]
    script["scripts/carve.mjs<br/>检测配对"]
    analysis["core/audioCarve.ts<br/>carveProfile · analyseCarveBands<br/>analyseCarveDuck · analyseCarveDynamics"]
    panel --> analysis
    script --> analysis
  end

  voice --> analysis
  bed --> analysis

  subgraph ATTRS["写入背景音乐元素"]
    carveAttr["data-fx-carve<br/>sources · strength"]
    chainAttr["data-fx-chain<br/>peaking xN + gain, tagged fromCarve"]
    autoAttr["data-automation<br/>每个雕刻参数一个通道"]
  end

  analysis --> carveAttr
  analysis --> chainAttr
  analysis --> autoAttr

  subgraph SHARED["一个实现,两者都能读取"]
    build["audioFxGraph.ts · buildFxChain"]
    sched["audioFxAutomation.ts · scheduleChainAutomation"]
  end

  chainAttr --> build
  autoAttr --> sched

  build --> preview["预览<br/>实时 AudioContext<br/>attachElementFxChain"]
  sched --> preview
  build --> render["渲染<br/>无头浏览器中的 OfflineAudioContext<br/>applyAudioFxChain"]
  sched --> render

  preview --> heard["拖动时间线时听到的内容"]
  render --> wav["处理后的 WAV<br/>+ chainTailSeconds 以确保混音允许尾音通过"]
  wav --> mix["引擎 · audioMixer<br/>音量通道已烘焙到 PCM 中,不在图形中"]
  mix --> out["最终混音"]

  edit["在播放中编辑属性"] -.->|MutationObserver| preview

雕刻自身的设置永远不会在播放时被读取——它产生的效果链和通道才是实际播放的内容。data-fx-carpe 的存在是为了可以在现有雕刻上更改强度,而无需从滤波器中反向猜测。

在已雕刻的背景音乐内部,信号首先通过衰减带,然后是电平匹配,最后是你自己构建的效果——这就是为什么你添加的限制器仍然充当最后一个天花板:

flowchart LR
  src["解码的背景音乐"] --> p1["峰值<br/>400 Hz"]
  p1 --> p2["峰值<br/>1 kHz"]
  p2 --> p3["峰值<br/>1.6 kHz"]
  p3 --> g["增益<br/>电平匹配"]
  g --> hand["你自己的效果<br/>例如限制器"]
  hand --> dest["音轨增益,然后输出"]

  l1["通道 fx.n1.gain"] -.->|"该频段中<br/>旁白电平的包络"| p1
  l4["通道 fx.n4.gain"] -.->|"背景音乐<br/>整体闪避程度"| g

首先,找出问题所在

下面的表格从“听起来低沉”开始——这假设已经有人听过并这么说了。如果拿到一个文件并要求“修复它”,你没有任何描述,也无法监听,所以你必须测量。一条规则适用于所有情况:

单个未知语音的绝对频谱无法诊断。 共振峰波动幅度为 ±10 dB,基频范围为 85–255 Hz,句子结尾会衰减 5–6 dB。 这些在单独看起来都像是缺陷,但每一个都是说话者本身造成的。

因此,要进行比较,并且与同一文件内部的对象进行比较:如果存在,则使用干净的原始文件;否则使用静音段落——无论什么在间隙中可闻,都是附加噪声,并且间隙的频谱是声道本身,而非语音。与发布的平均频谱或合成的控制语音进行比较是行不通的:两个说话者之间的差异超过了大多数缺陷,并且在这项指导背后的评估中,两个错误答案都源于此。

当没有原始文件也没有可用的静音时,一个静态的音调缺陷确实是欠定的。说明这一点,并提供适用于当前情况的读数,而不是选择一个并基于此构建效果链。

命令、陷阱和实际配方:references/diagnosis.md。在诊断一个无人描述的文件之前,请先阅读它。

从症状开始

一旦你知道了频段和类型,就说出音频的问题所在。大多数糟糕的音频都属于以下一两种类型,每种都有现成的解决方案:

听起来像使用
下面有嗡嗡声或重击声rumble-cut,或在 80 Hz 处使用 highpass
低沉、胸腔共鸣驯服低沉 任务(200 Hz)
闷闷的,像隔了纸板减少浑浊 任务(250 Hz)
听不清词增加清晰度 任务(3 kHz),或雕刻背景音乐
刺耳且让人疲惫柔化刺耳感 任务(3.2 kHz)
有些词比其他的响得多压缩器上的 均匀性,或 均匀化电平
句子间的房间环境声room-gate
人声和音乐互相干扰旁白雕刻——不是对其中任何一个使用均衡器
干燥,听起来像没在房间里录过room-tight 或 room-natural
就是“业余”的感觉voice-clean,按顺序包含上述四个

完整目录、每个预设包含的内容、频段词汇以及故意未涵盖的内容(去嘶声、降噪、音色匹配):references/presets.md。

在添加之前先减去,在滤波之后调整电平,在电平平衡之后处理关系,最后才是特性和上限。每一步都会改变下一步听到的内容——在高速滤波器之前设置的压缩器会把时间浪费在追逐隆隆声上。

根据问题选择效果族,而不是名字

滤波器(highpass、lowpass、peaking、lowshelf、highshelf)决定音轨允许占据哪些频率。当两个音源发生冲突时,这是首要工具,因为冲突发生在频带中:背景音乐和人声都想占据 1–3 kHz,从背景音乐那里拿走这个频段比将整个音量调低对混音的损害小得多。人声上的高通滤波器是消除隆隆声的标准方法;低通滤波器则是为了故意使声音变暗或变闷。

动态效果(gain、compressor、limiter、gate)决定音轨的电平随时间如何变化。压缩器缩小了响和轻之间的距离,使安静部分能够提升。限制器是一个天花板——它不塑造任何东西,它只是保证没有声音能超过它。门限滤除低于阈值的部分,这就是你如何在短语之间消除房间环境声的方法。gain 是一个简单的电平级,当音轨需要让路时,自动化通道就在它上面运行。

非线性效果(saturate、bitcrush)改变波形的形状,从而增加原来不存在的谐波。当音轨需要特性或质感而不是修正时使用它——记住,它是生成性的:它会加厚一个单薄的音源,而不是让它更干净。

时间效果(delay、reverb、chorus、phaser)将音轨置于一个空间中或赋予其宽度。这些效果最容易破坏混音,因为一个尾音或一个失谐的副本会占据人声所需的空间。将这些效果用在你希望位于其他声音后面的音轨上,并保持干湿比例低于单独听起来正确时的水平。

效果链是串行的:每个效果处理前一个效果产生的结果。因此,校正性滤波放在前面,特性放在中间,限制器放在最后,以便它真正起到天花板的作用。

旁白雕刻

它解决的问题。 背景音乐下的旁白使得旁白难以听清。本能的反应是让整个背景音乐闪避,这虽然有效,但却牺牲了背景音乐的所有存在感——音乐在整个旁白期间变得软弱无力。但旁白并不需要整个频谱。它只需要它实际占用的那少数几个频段。雕刻只拿走这些频段,背景音乐保留其低频和高频,因此它仍然是音乐,而旁白仍然清晰。

它是一种关系,而不是一个效果。 设置位于被处理的音轨——背景音乐上——它们指定要聆听的旁白,这与侧链压缩器的工作原理完全相同:你选择哪个音轨变低,并指定什么让它变低。永远不要将雕刻放在旁白音轨上。 将旁白雕刻到自己身上是一个错误,而不是微妙的混音选择。

每个旁白,而不是某一个。 sources 是一个列表,因为一个背景音乐通常贯穿整个序列——一个旁白、一个采访回答、第二个主持人。在测量任何内容之前,它们被按背景音乐自己的时钟求和(mixCarveSources),因此一个分析涵盖了所有旁白:频段来自于所有存在的语音,并且只要有任何语音发生,包络就会上升。在背景音乐播放期间从未播放的旁白会被排除在外;它们不能使其产生闪避。

针对多个片段 ID 的雕刻是错误的。将所有片段分组,并针对该组进行雕刻。 这是一个不变的规则,而不是一个提示。逐个命名片段必须完全正确,并且只在下一个编辑之前保持正确——稍后添加的第四个旁白片段将超出雕刻的感知范围,背景音乐将无法静音地在它下面闪避。相反,命名分组可以在分析时解决成员资格问题,这样稍后添加到分组中的片段无需改动 sources 就能被覆盖:

<!-- 对所有旁白进行分组,然后对背景音乐针对该组进行雕刻 -->
<audio id="vo-intro" data-audio-group="voiceover" …></audio>
<audio id="vo-middle" data-audio-group="voiceover" …></audio>
<audio id="vo-outro" data-audio-group="voiceover" …></audio>

<audio id="music" data-fx-carve='{"enabled":true,"sources":["voiceover"],"strength":0.8}' …></audio>

一个 sources 列表包含两个或多个普通片段 ID 而不是一个分组,会被 audio_carve_ungrouped_sources lint 规则检测到——它仍然能工作,但这是会在添加片段时悄然失效的版本。

保持雕刻分组为旁白分组:不包含背景音乐、音效或音乐。 sources 中的分组 ID 在每次分析时都会解析为所有当前成员,因此你命名的分组就是你稍后将得到的分组——而不是写入时被测量的音轨。两种情况会出问题:

  • 背景音乐位于其自己的源分组中。 它将自己视为一个旁白,并针对自己的内容进行雕刻——"永远不要将音轨针对自身进行雕刻"这一规则将在下次重新分析时成立。
  • 一个音效或音乐片段位于旁白分组中。 它会在下次分析时进入侧链,背景音乐将开始针对一个呼啸声进行闪避,即使当初写入属性的那次运行从未测量过它。

这两种情况在雕刻被写入的瞬间都是不可见的:分析会将其检测到的旁白求和,并且不会通过分组解析进行往返检查,因此第一次运行确实正确,只有下一次运行才会出错。所以,为每个角色分配其自己的分组——music 用于背景音乐,voiceover 用于旁白,sfx 用于音效——并确保 sources 中命名的分组只包含旁白。

当 carve.mjs 遇到这两种情况中的任何一种时,它会拒绝写入分组形式,记录片段 ID,并在 stderr 上说明是哪个成员阻止了它。audio_carve_ungrouped_sources 规则随后会指向该安排。

Individual skills in this repo

This repo contains 20 individual skills — each has its own dedicated page.

samyakiasonline-ctrl/hyperframe

Add captions or subtitles to an existing single-subject talking-head video without editing the footage. Use for plain verbatim captions, cinematic captions embedded behind the subject, VFX captions, “炸/特效/酷炫字幕,” or a named identity from the 35-style catalog. Route by visual identity, not by backend engine. The quiet `anchor` rail is the default; embed every word only when the user explicitly wants a fully cinematic treatment. The workflow runs locally end to end, including transcription and subject matting; split multi-shot footage before applying it.

samyakiasonline-ctrl/hyperframe

Turn arbitrary text — an article, notes, a topic, a brief — into a faceless explainer video: there is no site or footage to capture, so the visuals are invented per scene (typography, abstract graphics, diagrams, data-viz). Use for topic explainers, concept breakdowns, how-tos, listicles. Not a video built from a website (/product-launch-video — promo or tour). Unclear → /hyperframes.

samyakiasonline-ctrl/hyperframe

Import Figma content into a HyperFrames composition — rendered assets, brand tokens, components, storyboard sections → reconstructed motion (frames read as states, not slides) (REST/CLI), connector-assisted motion when available, and shaders from a connector or native export. Use when the user pastes a figma.com link or asks to bring a Figma design, frame, logo, brand, or animation into a video/composition.

samyakiasonline-ctrl/hyperframe

Author or edit a custom HyperFrames composition when no specialized workflow fits, or when BRIEF.md sets flow: companion. Use for longer or multi-scene pieces, brand and sizzle reels, montages, static loops, static title cards, footage remixes, and freeform builds. Use motion-graphics instead for a short unnarrated motion-first unit, including an animated title. Route fresh creation through hyperframes before using this skill.

samyakiasonline-ctrl/hyperframe

All animation knowledge for HyperFrames — atomic motion rules, multi-phase scene blueprints, scene transitions, broader motion-design techniques, AND the seven runtime adapters (GSAP default, plus Lottie, Three.js, Anime.js, CSS keyframes, Web Animations API, TypeGPU). Use for any motion or animation task: pick 2-4 rules and compose, or load a blueprint, or look up runtime-specific API (e.g. GSAP eases / Lottie player / Three.js mixer). Also covers auditing an existing composition's choreography (animation map) and 24 named text-animation effects. HyperFrames-native: single paused timeline, seek-safe, deterministic.

samyakiasonline-ctrl/hyperframe

Use the HyperFrames CLI development loop: init, add, catalog, capture, lint, check, snapshot, compare, grade-compare, preview, play, present, beats, keyframes, single or batch render, publish, cloud, cloudrun, feedback, lambda, doctor, browser, info, upgrade, skills, compositions, timeline, history, clean, docs, benchmark, telemetry, transcribe, auth, tts, and remove-background. Also use when diagnosing build or render failures. validate, inspect, and layout are deprecated aliases; use check. Covers local, HeyGen-hosted cloud, AWS Lambda, and Google Cloud Run rendering.

samyakiasonline-ctrl/hyperframe

The HyperFrames composition contract — build one renderable project. Use for composition structure, the `data-*` timing attributes, `class="clip"`, tracks, sub-compositions, variables, framework-owned media playback, deterministic-render rules, and validation. Read before writing composition HTML.

samyakiasonline-ctrl/hyperframe

Non-animation creative direction for HyperFrames videos. Use for design spec (frame.md / design.md) handling, palettes, typography, narration, beat planning, audio-reactive visuals, composition patterns, and brand / style decisions. For atomic motion patterns and scene blueprints, use `hyperframes-animation`.

samyakiasonline-ctrl/hyperframe

Use when a HyperFrames composition needs a punch-in, punch-out, zoom, reframe, Ken Burns treatment, camera move, visual match/whip handoff, or other seek-safe 2D/3D keyframes; also for GSAP, CSS keyframes, Anime.js, WAAPI, FLIP, paths, masks, SVG morph/draw, text trails, 3D depth, or `hyperframes keyframes` diagnostics. Don't use for broad scene strategy, brand design, media sourcing, captions, or general video planning.

samyakiasonline-ctrl/hyperframe

Search, install, and wire registry blocks and components into HyperFrames compositions. Use BEFORE hand-building any named visual — whenever a brief, a user, or a storyboard names a look, effect, treatment, or transition such as CRT scanlines, glitch, chromatic aberration, film grain, a shimmer sweep, a chart, a code or terminal window, a map, or a confetti burst — because roughly 400 hosted items already cover many of them and the search ranks all of them with nothing installed, no project, and no account. Also use when running hyperframes add or hyperframes catalog, installing one item or every block matching a tag, wiring an installed item into index.html, or working with hyperframes.json. Covers discovery, install locations, block sub-composition wiring, component snippet merging, and authoring a new block or component to contribute upstream (idea → scaffold → validate → PR).

samyakiasonline-ctrl/hyperframe

Mandatory entry point: read this first for any request to make, create, edit, animate, or render a video, animation, or motion graphic, including a promo, explainer, captioned clip, title card, overlay, slideshow or interactive deck, Remotion port, or any HyperFrames HTML composition. Also use it to inspect, diagnose, validate, preview, publish, or batch-render an existing HyperFrames project. Inputs may be a website URL, GitHub PR, Figma design or URL, text or brief, existing footage, or music. It resumes project state, captures intent when applicable, selects and installs the owning workflow, and routes domain capabilities. HyperFrames is the default output framework unless the user explicitly chooses another framework for the deliverable or asks only to record a browser session.

samyakiasonline-ctrl/hyperframe

Use when working with a person on a HyperFrames project in Studio: first, whether their message asks for a change at all (questions, loose ideas and "don't change anything" get an answer and a plan, not an edit); for a new film, the plan, storyboard and build order that the HyperFrames launch films follow; and how the timeline should be laid out so it reads well (one caption track, one element kind per track, every scene a sub-composition) and where captions and key content may sit (safe zones). Don't use for how to perform an individual edit (split, trim, retime, volume, copy, swap): that is `creator-editing-recipes.md` in `/hyperframes-core`.

samyakiasonline-ctrl/hyperframe

Agent Media OS, the single skill for every media need in a HyperFrames project. Resolve BGM, SFX, image, icon, brand logo, voice, color grade, or LUT into a frozen local file or paste-ready block + ledger record (one verb, `resolve`); generate via TTS / music / image models when the catalog misses; produce voiceover, transcription, captions, and background removal through one shared audio engine; operate on media (cut / reframe / transform); and reuse assets across projects. Also use for vague feedback that real footage looks dark, flat, boring, should feel retro/camcorder/print/ASCII, needs privacy, or needs a media reveal.

samyakiasonline-ctrl/hyperframe

A short, design-led motion graphic where motion is the message — kinetic typography, stat count-up, chart/data-viz hit, logo sting / brand lockup, lower-third / callout / social overlay, animated map (highlight regions, connect places, zoom to a location), animated tweet / news-article / headline, webpage / UI animation (scroll, cursor, callouts), or fusing a real image's geometry into a chart. Usually under 10s (up to ~30s), no narration or live-action subject; renders to MP4 or transparent overlay. Longer / narrated / multi-scene → /general-video. Unclear → /hyperframes.

samyakiasonline-ctrl/hyperframe

Turn a music track (an audio file, a video to pull audio from, or a track generated from a mood brief) into a beat-synced video — lyric video, slideshow, or kinetic promo. The music drives all pacing; any user-supplied images/videos are cut onto the same beat grid, and a complete video needs zero assets. Narrated pieces → the input-matched workflow (see /hyperframes). Unclear → /hyperframes.

samyakiasonline-ctrl/hyperframe

Turn a product or marketing URL, pasted script, or brief into a product launch / promo video — SaaS promos, feature reveals, product demos, app and company launches. Use when the user wants to market, launch, promote, or reveal a product; the default for any commercial URL. Site tours / showcases of a website route here too — the brief carries the show-it-as-is intent. Unclear → /hyperframes.

samyakiasonline-ctrl/hyperframe

Turn a GitHub pull request (a PR URL, owner/repo#N, or 'this PR' in a checked-out repo) into a code-change explainer video — changelog, feature reveal, fix, or refactor walkthrough built from the diff, commits, and files: the input is a code change, not a website. Not a product promo (/product-launch-video) or a no-PR topic explainer (/faceless-explainer). Unclear → /hyperframes.

samyakiasonline-ctrl/hyperframe

Port an existing Remotion (React) composition''s source to HyperFrames HTML. Use ONLY on an explicit ask to port/convert/migrate/translate a Remotion source — one-way, Remotion-only. A passing Remotion mention, reference-only code, or "make something like my Remotion video" is a fresh build (/general-video). Unclear → /hyperframes.

samyakiasonline-ctrl/hyperframe

Author a HyperFrames slideshow — a presentation, pitch deck, or interactive deck with discrete slides, fragment reveals, branching, hotspot navigation, and built-in presenter mode with speaker notes; also converts an existing page into a deck. Output is a navigable deck, not a rendered MP4. If the user didn't explicitly ask for a slideshow, confirm before authoring. Unclear → /hyperframes.

samyakiasonline-ctrl/hyperframe

Package an existing talking-head / interview / podcast video with timed, designed GRAPHIC OVERLAY cards — kinetic titles, lower-thirds, data callouts, quotes, side panels, picture-in-picture — synced to the transcript, on a 16:9 / 9:16 / 4:5 canvas of your choice; the clip plays untouched underneath. Trigger on "graphic overlays", "on-screen graphics", "package / dress up my video". Not plain subtitles (/embedded-captions). Unclear → /hyperframes.

相关技能