Drama Keyframe Forge (Storyboard Keyframe and Asset Consistency Process)
Process Positioning: Short drama asset and pre-keyframe process. Core Concept: Upgrade the inefficient workflow of "blindly running T2V for 8 minutes, hoping for the best, and relying on post-production quality checks and re-draws" to a systematic approach: "Before video sampling, use an image generation model to create storyboard keyframes in 5 seconds, cheaply verify and lock them in, then feed them to I2V for execution."
1. Operational Contract, Inputs, and Outputs
- Inputs:
plan.jsonfrom the 1st process and the storyboard table;- Character Reference Sheet (2+3 head-body decoupled views);
- Scene settings and key prop descriptions.
- Outputs:
style_bible.json: The globally unique, immutable art style master card;- 16:9 high-definition first-frame placeholder images for each storyboard:
segments/segXX_keyframe.png; - First-frame gate quality inspection sign-off sheet:
keyframe_qc.json.
2. Hardcore SOP: Global Style Bible and Pre-Production Style Gate
Rule: The entire short drama must have a single, legitimate
style_bible.json. Individual storyboard prompts are strictly forbidden from freely playing with or privately tampering with core style words!
2.1 Five Core Attributes of the Style Bible
Before starting work, the following 5 fields must be solidified:
- Visual Genre: e.g.,
Cinematic retro-future dieselpunk graphic novel style, mature neo-noir tone; - Color Palette: e.g.,
desaturated amber and deep teal contrast, rusty bronze highlights, rich shadow details; - Lighting Base: e.g.,
heavy chiaroscuro lighting, harsh directional rim light, high contrast dramatic shadows; - Environment Base: e.g.,
weathered rust and scuffed brass, damp asphalt reflections, atmospheric smog; - Quality & Lens: e.g.,
35mm film grain, Panavision anamorphic lens flare, shallow depth of field, 8k resolution.
2.2 Pre-Production Style Verification Checklist
Before starting work, generate 4 style verification samples at different shot distances using the image generation model, and obtain manual sign-off:
- Sample 1 (Long Shot - LS): Verify if the lighting, color tones, and material atmosphere match expectations;
- Sample 2 (Medium Long Shot - MLS of the protagonist): Verify the protagonist's costume, posture, and signature accessories;
- Sample 3 (Close-Up - CU of the protagonist): Verify eyes, face features, hairstyle, and skin texture;
- Sample 4 (Extreme Close-Up - ECU of key prop): Verify the prop's hard surface details and mechanical structure.
3. Hardcore SOP: Storyboard-Level Combined Keyframe Image Generation (I2V Pre-Generation)
Counterexample (Strictly Prohibited): Directly feeding plain text to H3 for T2V without a storyboard first-frame keyframe image! Symptom: Due to random noise in the latent space during the early diffusion stages in 3D, the same generated character may have a changed hairstyle, facial bone drift (face swapping), or different clothing styles across shots.
3.1 Combined Keyframe Image Generation Steps
For each storyboard segment (seg01 to seg08) in plan.json:
- Assemble the storyboard image generation prompt:
- Inject the protagonist's specific appearance and clothing;
- Inject the camera position specified for the current segment (e.g.,
M2_RACK_FOCUSfor a prop focus pull); - Inject the specific micro-scene and props for the current segment (e.g.,
sharp serrated hunting dagger vibrating in tabletop); - Inject the style and lighting terms from
style_bible.json.
- Use a fast image generation model (Flux / SDXL) to batch render 16:9 static images (5~10 seconds per image);
- Triple Gate Quality Check (Keyframe Gate Check):
- Face Consistency: Key features (eyepatch, hairstyle, scar) are clearly aligned;
- Camera Obedience: Shot distance and angle strictly follow the storyboard requirements, no extra body parts;
- Prop Hard Surface: Edges of weapons, dials, and suitcases are sharp, with no melting;
- After passing inspection, rename and save the files as
segments/{seg_id}_keyframe.png.
4. Dedicated Tool Scripts
- Manage Style Verification and Storyboard First-Frame Generation:
python scripts/keyframe_gate.py --scan - Sync First-Frames to ComfyUI Storage:
python scripts/keyframe_gate.py --project <project_name> --sync