Drama Keyframe Forge

Drama Keyframe Forge (Storyboard Keyframe and Asset Consistency Process)

Process Positioning: Short drama asset and pre-keyframe process. Core Concept: Upgrade the inefficient workflow of "blindly running T2V for 8 minutes, hoping for the best, and relying on post-production quality checks and re-draws" to a systematic approach: "Before video sampling, use an image generation model to create storyboard keyframes in 5 seconds, cheaply verify and lock them in, then feed them to I2V for execution."

---

1. Operational Contract, Inputs, and Outputs

• Inputs:
  1. plan.json from the 1st process and the storyboard table;
  2. Character Reference Sheet (2+3 head-body decoupled views);
  3. Scene settings and key prop descriptions.
• Outputs:
  1. style_bible.json: The globally unique, immutable art style master card;
  2. 16:9 high-definition first-frame placeholder images for each storyboard: segments/segXX_keyframe.png;
  3. First-frame gate quality inspection sign-off sheet: keyframe_qc.json.

---

2. Hardcore SOP: Global Style Bible and Pre-Production Style Gate

Rule: The entire short drama must have a single, legitimate style_bible.json. Individual storyboard prompts are strictly forbidden from freely playing with or privately tampering with core style words!

2.1 Five Core Attributes of the Style Bible

Before starting work, the following 5 fields must be solidified:

1. Visual Genre: e.g., Cinematic retro-future dieselpunk graphic novel style, mature neo-noir tone;
2. Color Palette: e.g., desaturated amber and deep teal contrast, rusty bronze highlights, rich shadow details;
3. Lighting Base: e.g., heavy chiaroscuro lighting, harsh directional rim light, high contrast dramatic shadows;
4. Environment Base: e.g., weathered rust and scuffed brass, damp asphalt reflections, atmospheric smog;
5. Quality & Lens: e.g., 35mm film grain, Panavision anamorphic lens flare, shallow depth of field, 8k resolution.

2.2 Pre-Production Style Verification Checklist

Before starting work, generate 4 style verification samples at different shot distances using the image generation model, and obtain manual sign-off:

• Sample 1 (Long Shot - LS): Verify if the lighting, color tones, and material atmosphere match expectations;
• Sample 2 (Medium Long Shot - MLS of the protagonist): Verify the protagonist's costume, posture, and signature accessories;
• Sample 3 (Close-Up - CU of the protagonist): Verify eyes, face features, hairstyle, and skin texture;
• Sample 4 (Extreme Close-Up - ECU of key prop): Verify the prop's hard surface details and mechanical structure.

---

3. Hardcore SOP: Storyboard-Level Combined Keyframe Image Generation (I2V Pre-Generation)

Counterexample (Strictly Prohibited): Directly feeding plain text to H3 for T2V without a storyboard first-frame keyframe image! Symptom: Due to random noise in the latent space during the early diffusion stages in 3D, the same generated character may have a changed hairstyle, facial bone drift (face swapping), or different clothing styles across shots.

3.1 Combined Keyframe Image Generation Steps

For each storyboard segment (seg01 to seg08) in plan.json:

1. Assemble the storyboard image generation prompt:
   • Inject the protagonist's specific appearance and clothing;
   • Inject the camera position specified for the current segment (e.g., M2_RACK_FOCUS for a prop focus pull);
   • Inject the specific micro-scene and props for the current segment (e.g., sharp serrated hunting dagger vibrating in tabletop);
   • Inject the style and lighting terms from style_bible.json.
2. Use a fast image generation model (Flux / SDXL) to batch render 16:9 static images (5~10 seconds per image);
3. Triple Gate Quality Check (Keyframe Gate Check):
   • Face Consistency: Key features (eyepatch, hairstyle, scar) are clearly aligned;
   • Camera Obedience: Shot distance and angle strictly follow the storyboard requirements, no extra body parts;
   • Prop Hard Surface: Edges of weapons, dials, and suitcases are sharp, with no melting;
4. After passing inspection, rename and save the files as segments/{seg_id}_keyframe.png.

---

4. Dedicated Tool Scripts

• Manage Style Verification and Storyboard First-Frame Generation: python scripts/keyframe_gate.py --scan
• Sync First-Frames to ComfyUI Storage: python scripts/keyframe_gate.py --project <project_name> --sync