What does Remotion Controls Skill do?
Professional skill for code-driven video animation. Remotion is a React-based video creation framework that gives you precise control over every frame via code, with native support for transparent background rendering.
Core Capabilities
| Capability | Description |
|---|---|
| Transparent Background Rendering | Natively supports Alpha channel; outputs WebM (VP9) / MOV (ProRes 4444) with transparent video |
| Precise Code Control | Use React/TypeScript to exactly control position, scale, rotation, opacity, and easing curves |
| API Service | HTTP API to receive animation commands and output video files |
| Template Library | Pre-built animation templates (character animation, UI animation, text animation, transition effects) |
| Quality Control | Automatic detection of frame rate, resolution, bitrate, and Alpha channel integrity |
| Self-Learning Evolution | Records rendering parameters and effect scores to optimize preset parameters |
Positioning Differences from ComfyUI / Blender
| Skill | Core Strength | Use Cases |
|---|---|---|
| ComfyUI-controls | AI generation (image/video/audio), creativity uncontrollable | Character images, scene images, special effects video generation |
| Blender-controls | 3D animation, physics simulation, high-quality rendering | 3D character animation, product demos, physical effects |
| Remotion-controls | 2D code animation, precisely controllable, transparent background | Template animation assets, UI animations, text layout, 2D character animation |
Quick Start
1. Install Dependencies
cd remotion-project
npm install
2. Render Transparent Background Video
# CLI method
npx remotion render src/index.ts MyComp out/video.webm --transparent
# API method
python remotion_controls.py render --composition MyComp --output out/video.webm --transparent
3. Start API Service
python remotion_controls.py serve --port 8765
Transparent Background Rendering Instructions (Verified Process)
Remotion natively supports transparent backgrounds, but the CLI's --transparent encoding loses the Alpha channel (verified failed for WebM VP8/VP9, MOV ProRes).
Correct verified process (PIT-024):
- Render PNG Sequence:
npx remotion render src/index.ts Composition out/frames --sequence(outputs PNG sequence with Alpha channel) - Synthesize ProRes 4444 with ffmpeg:
ffmpeg -y -framerate 30 -i out/frames/%04d.png \ -c:v prores_ks -profile:v 4 -pix_fmt yuva444p12le \ out/animation.mov - Verify Alpha Channel:
python verify_animation.py out/animation.mov
CapCut Integration Notes (PIT-024):
- Using
add_media_safeto import a ProRes 4444 mov auto-transcodes it to H.264 mp4, losing Alpha (66MB → 0.07MB) - Must import manually: copy the mov directly into the draft materials directory → create a VideoMaterial → register in materials.videos → VideoSegment(material=anim_material) → add_segment
Animation Asset Quality Standards
See full standard in QUALITY_STANDARD.md.
Hard requirements for qualified animation assets:
- Alpha channel preserved (yuva444p12le)
- ProRes 4444 encoding (profile=4)
- Resolution / frame rate / duration matching configuration
- Content coverage ≥ 50% (10-point sampling)
- File size reasonable (≤15MB/sec)
Automated verification:
python verify_animation.py <animation file> --duration 20 --width 1080 --height 1920
Base Animation Component Library
Located in remotion-project/src/components/, all components support transparent background.
Character & Motion Components
| Component | Description |
|---|---|
| CharacterSprite | Character sprite: multi-pose switching, position/scale/rotation/opacity keyframe animation |
| MotionPath | Motion path: linear/bezier/elastic/bounce motion |
| FlashEffect | Flash white effect: quick fade-in, slow fade-out |
| ShakeEffect | Shake effect: random shake with amplitude decay |
| FadeEffect | Fade in/out: controllable fade-in/fade-out duration |
| PopEffect | Pop effect: elastic scale bounce |
| SlideEffect | Slide effect: ease-out slide in four directions |
Text Animation Components (TextAnimations.tsx)
| Component | Description | Use Cases |
|---|---|---|
| TextReveal | Character-by-character reveal: typewriter/fade-in/slide-up/slide-left | Narration, dialogue, title entry |
| TextPop | Pop text: scale/rotate/bounce | Keyword emphasis, beat sync |
| TextWave | Wave text: character-by-character sine wave float | Fun style, background music rhythm |
| TextGlitch | Glitch style: RGB separation + shake | Tech vibe, glitch art, transitions |
| TextGradient | Gradient shimmer: color flow + light sweep | Titles, brand names, premium feel |
| KineticText | Kinetic typography: multi-line combined animation | Opening titles, end credits |
Transition Effect Components (TransitionEffects.tsx)
| Component | Description | Use Cases |
|---|---|---|
| FadeTransition | Fade in/out transition (in/out/inOut) | General transitions, emotional mood shifts |
| SlideTransition | Slide transition (up/down/left/right) | Scene changes, content replacement |
| ZoomTransition | Zoom transition (push in/pull out) | Highlight emphasis, lens push |
| WipeTransition | Wipe transition (up/down/left/right/diagonal) | Creative transitions, stylized look |
| BlurTransition | Blur transition (blur then clear) | Dreamy transitions, memory flashbacks |
| GlitchTransition | Glitch transition (RGB separation + scan lines) | Tech vibe, glitch art |
Impact Effect Components (ImpactEffects.tsx)
| Component | Description | Use Cases |
|---|---|---|
| PunchImpact | Punch impact (shockwave + stars + white flash) | Fighting, hitting, collision |
| ImpactFlash | Impact flash (quick white flash) | Heavy hit, explosion, beat sync |
| ParticleBurst | Particle burst (stars/sparks/debris) | Celebration, explosion, impact |
| Shockwave | Shockwave (multi-ring expansion) | Energy release, explosion, tremor |
| SpeedLines | Speed lines (radial) | High-speed impact, sprint, combo hit |
Usage example:
import { PunchImpact, ParticleBurst, FadeTransition } from "./components";
// Fight scene
<PunchImpact startFrame={90} x={540} y={800} scale={1.2} />
<ParticleBurst startFrame={90} x={540} y={800} count={16} particleType="star" />
<FadeTransition direction="in" duration={15} startFrame={0} color="#1a1a2e" />
Usage example:
import { CharacterSprite, FlashEffect, TextReveal, TextPop } from "./components";
<CharacterSprite
poses={[
{ name: "idle", image: "/doubao_normal.png", frameRange: [0, 90],
position: [{frame: 0, x: 0, y: 0}, {frame: 90, x: 100, y: 0}] },
{ name: "falling", image: "/doubao_falling.png", frameRange: [90, 150] },
]}
width={250} height={250}
/>
<FlashEffect startFrame={90} duration={10} />
<TextReveal text="Got hit!" fontSize={56} startFrame={95} revealType="typewriter" />
<TextPop text="Ouch!" fontSize={72} color="#ff6b6b" startFrame={110} popType="bounce" />
Project Structure
remotion-controls-skill/
├── SKILL.md # This file
├── QUALITY_STANDARD.md # Animation asset quality standards
├── verify_animation.py # Automated verification tool
├── remotion_controls.py # Main control script (CLI/API)
├── .env.example # Environment variable example
├── .gitignore
├── capabilities/
│ ├── cap_api_wrapper/ # Remotion API wrapper
│ ├── cap_animation_renderer/ # Animation renderer
│ ├── cap_template_library/ # Animation template library
│ ├── cap_quality_control/ # Quality control
│ └── cap_self_evolution/ # Self-learning evolution
├── remotion-project/ # Remotion project
│ ├── src/
│ │ ├── components/ # Base animation component library
│ │ │ ├── CharacterSprite.tsx
│ │ │ ├── MotionPath.tsx
│ │ │ ├── Effects.tsx
│ │ │ └── index.ts
│ │ ├── AnimationTemplate.tsx # JSON-driven animation template
│ │ ├── Root.tsx
│ │ └── index.ts
│ ├── public/ # Static assets (character/prop images)
│ └── package.json
└── out/ # Render output
Capability Modules
cap_api_wrapper — Remotion API Wrapper
render_media(): Render video (supports transparent background)render_still(): Render a single frame imageselect_composition(): Get list of available compositionsget_props_schema(): Get Props definition for a Composition
cap_animation_renderer — Animation Renderer
- Input animation command JSON → Output transparent background video
- Supports keyframe animation (position/scale/rotation/opacity)
- Supports easing curves (ease-in/ease-out/ease-in-out/linear/spring)
- Supports multi-layer compositing
cap_template_library — Animation Template Library
- Character animation templates (Doubao getting hit, expression switching, etc.)
- UI animation templates (button click, page transition, etc.)
- Text animation templates (typewriter, fade in/out, bounce, etc.)
- Transition effect templates (fade in/out, slide, zoom, etc.)
cap_quality_control — Quality Control
- Frame rate detection (24/30/60fps)
- Resolution detection (1080p/4K)
- Alpha channel integrity detection
- Video duration vs. expected comparison
- File size reasonability check
cap_self_evolution — Self-Learning Evolution
- Records rendering parameters and effect scores
- Optimizes preset parameters
- Generates best practice documentation
- Template effect leaderboard
Environment Variables
REMOTION_PROJECT_PATH=./remotion-project
REMOTION_OUTPUT_DIR=./output
REMOTION_DEFAULT_FPS=30
REMOTION_DEFAULT_WIDTH=1080
REMOTION_DEFAULT_HEIGHT=1920
REMOTION_API_PORT=8765
Integration with ai-video-editor
Remotion-controls-skill serves as the animation asset creation tool for ai-video-editor:
- ai-video-editor's director engine outputs animation instructions
- Remotion-controls-skill receives instructions and renders transparent background video
- The transparent background video serves as an animation asset layer for CapCut templates
- After users replace the background, the animation perfectly overlays
Notes
- Remotion requires Node.js 18+ environment
- For transparent background video, WebM format is recommended (better CapCut compatibility)
- Rendering long videos is time-consuming; segment rendering and compositing is recommended
- Avoid using CSS filters in animations (some filters do not support transparent backgrounds)