Communitygithub.com

motion-sound-design

Crie e mixe sons sincronizados com eventos para vídeos de movimento e Reels: escolha musical e sincronia de batida, um SFX por evento visual, variação de tom, níveis específicos por banda, micro-ducking e masterização a -13 LUFS, com um sintetizador e mixer de SFX integrados.

O que é motion-sound-design?

O skill Motion Sound Design transforma vídeos de movimento em experiências profissionais de áudio, sincronizando música e efeitos sonoros com cada evento visual. Ele automatiza a criação de uma biblioteca de sons UI (sem downloads externos) usando um sintetizador Python, mixa uma lista de eventos em um arquivo WAV masterizado e multiplexa o áudio de volta ao vídeo. O sistema suporta síntese de som e samples reais, aplica regras como variação aleatória de tom para evitar repetições robóticas, micro-ducking seletivo em frequências altas para que os efeitos sonoros cortem a música sem bombear o grave, e masterização a -13 LUFS para plataformas como Reels, TikTok e Shorts. Ideal para criadores de conteúdo e editores de vídeo que desejam som de alta qualidade sem um estúdio de áudio dedicado, o skill funciona com Python 3, numpy, scipy e ffmpeg, e é compatível com fluxos de trabalho baseados em especificações de tempo.

Funciona com~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/qiyascc/ai-skills/tree/HEAD/skills/motion-sound-design

Perguntar na sua IA favorita

Abre um novo chat com esta habilidade de agente já pré-carregada.

Documentação

Motion Sound Design

Style rule: never use em dashes or en dashes in anything you write (replies, specs, captions, files). Use a comma, colon, period, parentheses or a plain hyphen instead.

Sound is half of why a motion video feels expensive. Default output usually has no sound or one music track slapped on. This skill makes every visual event audible, keeps the music clean under it, and masters to platform loudness. It ships a tool that synthesizes a clean UI sound library (no downloads needed) and mixes a cue list into a mastered WAV.

Reply in the user's language.

0. Files in this skill

FileUse it when
scripts/sfx.pyBuilding the sound library, mixing a cue list, muxing audio into the video
assets/cues.example.jsonStarting a cue list

scripts/sfx.py needs Python 3 with numpy + scipy (pip install numpy scipy, add --break-system-packages only on a system Python that refuses) and ffmpeg for mix and mux. Run it from this skill's folder:

  • python3 scripts/sfx.py synth sfx_lib → 12 sound types × 3 variants: tick, click, key, pop, whoosh, swish, thud, chime, shine, squelch, snip, shutter (no ffmpeg needed)
  • python3 scripts/sfx.py mix cues.json mix.wav → places cues, applies all rules below, masters
  • python3 scripts/sfx.py mux video.mp4 mix.wav final.mp4

Real samples beat synthesized ones: if the user has a pack (Epidemic, Artlist, freesound CC0), drop files into the library folder named TYPE_anything.wav (e.g. whoosh_soft.wav) and they are used automatically.

1. Music

  • Choose by the film's emotion and energy, not by trend. UI/tech calm: soft minimal ambient, no drops, no heavy bass. Promo: punchy electronic 120-140 BPM. High-energy: 150-160 BPM.
  • Lock the edit to the track: note its BPM, pick a start offset so beat 0 lands on frame 0, and put the film's biggest visual change on the track's drop/phrase change.
  • High-pass music at ~55 Hz (no sub booms on phone speakers); no filter sweeps unless they tell the story.
  • Perspective sound: when the camera goes inside something (a room, a device, underwater), cut the kick and bass and keep only the highs ("heard through the walls"); bring the low end back on the way out and hit full on the money moment.
  • Licensing: commercial posts need licensed music (platform business library or a paid library). Never suggest ripping audio.
  • If the user wants specific tracks by mood, use reels-music-picker if available.

2. One sound per visual event

Map every visual event to a sound type:

Visual eventSound
first frame / logo glintshine (soft, nothing hard in the first 12 frames)
object hops / flies / camera whipwhoosh (long) or swish (short)
landing, drop into a slotthud (soft, no sub)
card/banner sliding inswish + click
button press, toggle, row collapseclick
digits, odometer wheels, counterstick per landing digit
typingkey on letters (every 2nd-4th letter when fast)
icon/badge pop, checkmarkpop / snip / "marker stroke" (snip)
liquid spread, blob mergesquelch
shutter, iris, screenshotshutter
success, final lockupchime

Rules (applied automatically by the mixer):

  • random pitch ±1 semitone per hit, so repeats never sound robotic
  • the same sample never twice within 2 s (3 variants per type)
  • max 8 events in any 0.25 s (extras dropped and reported); clutter kills clarity
  • 160 Hz high-pass on small UI sounds (ticks, clicks, keys, swishes, pops, snips)
  • no musical notes, booms or sub hits in the SFX layer

3. Levels and mix

Default levels relative to the music in the same band (built into the tool, override per cue with "db"): ticks +10.5 dB (4-10 kHz) · clicks +10 · keys +9 (1.5-8 kHz) · swishes +9.5 · hits/thuds +7 · pops +8 · squelch +7 · chime +5.

  • No pumping sidechain. Instead, under each tick/click/key the music gets a -8 dB, 60 ms dip only in 2-8 kHz (micro-ducking) so the hit cuts through while the groove continues.
  • Master: -13 LUFS integrated (Reels/TikTok/Shorts), true peak ≤ -1 dBTP, look-ahead limiter without pumping. For YouTube long-form use -14. sfx.py mix limits 1 dB under the true-peak target because AAC encoding in mux raises peaks by about 0.6 dB.
  • Voice-over (if any) sits on top: music bed 18-25 dB below speech.
  • Check on phone speaker AND headphones.

4. cues.json format

A copy to start from is in assets/cues.example.json.

{
  "duration": 15.0, "lufs": -13, "true_peak": -1.0, "seed": 3,
  "library": "sfx_lib",
  "music": "track.mp3", "music_start": 49.735, "music_gain_db": 0, "music_highpass": 55,
  "duck": {"db": -8, "ms": 60, "band": [2000, 8000], "types": ["tick", "click", "key"]},
  "cues": [
    {"t": 0.05, "type": "shine"},
    {"t": 0.59, "type": "whoosh"},
    {"t": 0.99, "type": "thud"},
    {"t": 3.16, "type": "swish", "db": 12}
  ]
}

Paths are relative to the JSON file. Omit music for SFX-only.

5. Workflow

  1. From the timed spec (motion-story-director), list every visual event with its exact time → cue list. Snap to the beat grid if the spec is beat-locked.
  2. synth the library (or use the user's samples).
  3. mix → read the report: dropped cues mean too much density at that moment.
  4. Verify loudness: ffmpeg -i mix.wav -af ebur128 -f null - 2>&1 | grep "I:".
  5. mux with the rendered video; deliver the final MP4.

Write a short SOUND section for any spec in this form: music (mood, BPM, offset, high-pass) → event list with times → levels → master target.

Individual skills in this repo

This repo contains 4 individual skills — each has its own dedicated page.

motion-render-pro

Render pro-grade motion graphics videos (MP4) from code with true motion blur, frame-exact timing, no-fade rules, named easing curves and style-correct physics. Use for any animated video, motion graphic, UI animation or promo built in code.

motion-story-director

Turn an idea into a frame-exact, beat-locked motion video spec (hero object, object-handoff transitions, camera language, ban list) and lint any motion prompt for timing, count and density errors.

reels-edit-director

Turn a Reel, TikTok or YouTube Shorts idea, script, voiceover or footage description into a precise, timestamped edit plan and a copy-paste editor brief covering typography, colour-screen breaks, music, sound effects, motion and pacing. Also diagnoses drafts that feel boring, chaotic or lose viewers. Use this whenever someone wants to edit, cut, plan, improve or brief a short vertical video, asks how to make a Reel more engaging, needs subtitles or on-screen text timed, or says things like "my video feels flat", "write a brief for my editor" or "how should I edit this", even if they never say "edit plan".

reels-music-picker

Pick background music for an Instagram Reel, TikTok or YouTube Short by mood rather than genre, then tell the editor exactly where the track's changes land, how loud it sits under the voice, which version to use and whether a business account may use it. Includes beat and bar maths, a loudness checker and licensing guidance. Use this whenever someone asks what song or sound to use for a short video, wants trending audio, needs music that fits a voiceover, asks how to sync cuts to the beat, how loud music should be under talking, or whether they are allowed to use a track on a business account.

Habilidades Relacionadas