AI Video Color Shifts Mid-Clip

Same shot, but the tint suddenly turns colder or redder. The model re-guesses color temperature between frames — pin it with a Kelvin spec and unify in post.

You generate a 5-second clip of a person walking through a park. At second 1 the scene is warm afternoon light. By second 3 it’s cool blue twilight. By second 5 it’s warm again. The shot didn’t change locations, no character moved through different lights — the model is just re-guessing the color temperature frame by frame, and the result looks like a broken auto-white-balance.

This is a common video-model failure mode. Unlike images, where the model commits to one set of colors, video models update color information per-frame, and small drifts compound.

Common causes

Ordered by hit rate, highest first.

1. No fixed white balance specified

Without 5500K or similar, the model treats white balance as a free parameter and drifts. Each frame’s “best guess” is slightly different.

How to spot it: prompt has no K (Kelvin) or explicit white balance instruction.

2. Light source description ambiguous or changing

"warm afternoon light, glowing sunset, magic hour"

These three terms have slightly different color temperatures — model picks different ones for different frames.

How to spot it: multiple lighting words that imply slightly different temperatures (afternoon, sunset, golden).

3. Multiple light sources without dominance

indoor lamp + window light + street light — model has 3 color sources to pick from per frame and can’t decide.

How to spot it: prompt has 2+ light sources without specifying which is dominant.

4. Scene description implies multiple environments

"woman walks from a sunlit garden into a shadowed hallway, then outside to a snowy field"

You said the lighting changes; the model is correctly varying color. But if you wanted ONE consistent scene, this is overcommitted.

How to spot it: prompt describes movement between environments. Pick one environment.

5. Style anchor evokes color-shift work

Wong Kar-wai style, In the Mood for Love, dream sequence, lynchian — all evoke color-shifting cinema. Model honors the style.

How to spot it: style word evokes color experimentation.

6. Clip too long for color stability

Like character drift, color drifts more in longer clips. 5s+ on some tools produces noticeable shift even without prompt issues.

How to spot it: short clips are stable, long clips drift.

Shortest path to fix

Step 1: Pin a specific Kelvin temperature

Add to prompt:

"consistent color grading, fixed white balance 5500K daylight"

# Or for warmer
"3200K tungsten warm throughout, consistent color, no shift"

# Or cooler
"6500K cool daylight, locked white balance, consistent color"

# Cinematic
"locked color grading, neutral 5600K, no color drift, professional grade"

The single most effective fix.

Step 2: One light source, named explicitly

# Before — ambiguous
"warm afternoon glow"

# After — explicit
"single key light: window light from camera left at 4500K, no fill, consistent throughout"

If you must have multiple, pick a dominant:

"dominant key light: window from camera left at 5500K; subtle ambient fill from room interior at lower intensity, same temperature"

Step 3: Strip color-shift-evoking style words

Remove:

Wong Kar-wai, dream sequence, lynchian, surreal,
shifting colors, color play, magic hour transition,
dawn to dusk

Replace with stable language:

naturalistic color, stable grade, documentary style,
consistent palette, locked color

Step 4: Apply a unifying LUT in post

Even with the best prompts, expect some drift. Fix in post:

# DaVinci Resolve (free)
- Apply LUT (built-in: Kodak 2383, Cinematic, etc.)
- Stabilizes color across the clip

# Premiere / FCPX
- Lumetri color → apply LUT
- Set black point and white point to match across clip

# Quick fix in any editor
- Add a uniform color grading layer
- Normalize exposure / temperature / tint

Step 5: Generate shorter clips for color stability

Same as character drift — split long shots into shorter ones, each color-stable, then stitch.

1 × 10s drifty → 2 × 5s stable → stitch in editor

Step 6: Use color match in post for multi-clip projects

# DaVinci Resolve
- Color page → right-click clip → "Use this clip as reference"
- Other clips → "Apply automatic color match"

# Premiere
- Lumetri → Color → "Color Match" → set reference clip

This locks color across an entire sequence after generation.

Prevention

  • Decide overall palette (warm / cool / neutral) before generating; commit to a Kelvin value
  • Always specify ONE light source as dominant
  • Apply a unifying LUT to every clip in a project, not per-clip ad-hoc
  • For multi-clip projects, generate all clips at the same Kelvin spec

Tags: #Video generation #Debug #Troubleshooting