THE SOLUTION

Hybrid AI Integration: Real Footage + AI Enhancement

Rather than building everything in AI or relying on studio-controlled environments, we developed a hybrid methodology that strategically deployed AI where it delivered maximum impact with minimum friction.

PRODUCTION TIMELINE

Week 1: Treatment development, location scout, tech scout (sun path mapping), AI styleframe iteration
Week 1 (Day 7): Production shoot (4 hours, 20 setups, Simi Valley rock sanctuary)
Week 2-4: Post-production (AI enhancement, sky replacement, compositing, color grading)



Step 1: Treatment Development & Pre-Production (Week 1)

Creative Vision:
J'Riva's journey unfolds as a meditation on resilience:

  • Opens with J'Riva alone atop a rocky hill overlooking the city at dusk

  • A single bee appears, then more arrive progressively

  • Bees land on his arms, shoulders, neck—he continues performing, undeterred

  • Final payoff: Completely enveloped by bees, J'Riva levitates skyward, ascending above the city

Color Palette: Muted tones, warm amber hues, surreal turquoise skies—evoking introspection and transformation

Pre-Production Planning:
This was an outdoor location shoot—requiring:

  • Location scout: Identified rock sanctuary in Simi Valley with city overlook

  • Tech scout: Mapped sun path to maximize golden hour lighting within 4-hour window

  • Shot list prioritization: 20 setups sequenced by lighting progression (we were racing the sunset)

  • Crew logistics: Skeleton crew (DP Jacob Caron, Steadicam operator Ilya Gittelson, minimal support)

AI Styleframe Process:
Generated styleframes showing bee placement, swarm density, and J'Riva's ascension—similar iteration count to previous projects (1,200+ variations) but streamlined by lessons learned.







Step 2: Production - Racing the Sun (Week 1, Day 7)

Location: Rock sanctuary, Simi Valley, CA
Shoot Window: 4 hours before sunset
Setups Completed: 20
Camera: Sony FX6
Crew: DP (Jacob Caron), Steadicam (Ilya Gittelson), Director/Producer (Martyn Watts)

On-Set Workflow:

  • No bees on set—J'Riva performed against empty air, reacting to imagined swarms

  • Shot with natural light, no green screen, no LED walls

  • Prioritized wide establishing shots first (longest shadow angles), then moved to close-ups as light changed

  • Steadicam movement added cinematic fluidity to performance shots

  • Challenge: Gray, overcast sky on shoot day—not the surreal turquoise/amber palette we'd storyboarded

Key advantage of shooting traditionally first:

  • J'Riva's authentic performance energy

  • Natural lighting interactions on skin and tattoos

  • Real camera movement (handheld, Steadicam) added organic feel

  • Faster shoot (4 hours vs. full day in studio)








 


Step 3: Post-Production - Hybrid AI Enhancement (Week 2-4)

Timeline: 3 weeks post-production
Approach: Run traditional footage through AI tools to add elements impossible/prohibitive to capture practically

AI Enhancement Workflow:

A. Bee Animation on Skin

  • Captured J'Riva's performance footage with clean tattoos visible

  • Fed footage into Nano Banana (AI enhancement tool) to generate initial bee placement

  • Refined animation using Google Veo 3.1 for realistic crawling movement, wing flutter, and organic behavior

  • AI recognized tattoo patterns and kept bees tracked to skin topology frame-by-frame

B. Swarm Compositing

  • Generated wide shots of bee swarms using Runway ML

  • Composited swarms around J'Riva using traditional VFX techniques

  • Blended AI-generated swarms with practical footage using Magic Keyer (10% of shots required AI-assisted rotoscoping)

C. Sky Replacement - Novel AI Solution
Challenge: Shoot day delivered gray, flat skies—not the surreal turquoise/amber aesthetic we'd designed

Traditional approach: DaVinci Resolve's sky replacement tool (tested, results unsatisfactory)

AI-Native Solution:

  1. Imported footage into Kling Omni

  2. Used object removal feature to isolate J'Riva from shot, separating background

  3. Replaced sky using custom sky map image (1080p source)

  4. Uprezed footage back to 4K using Topaz AI

  5. Reinserted J'Riva on top of new sky-replaced background plate using DaVinci Resolve Fusion

  6. Applied color correction, film grain, and tilt-shift lens effect for selective focus

Why this worked: Kling Omni's object-removal AI was more sophisticated than Resolve's masking—cleaner separation, better edge work



Step 4: Fully AI-Generated Finale

Challenge: Final shot required J'Riva to ascend into the sky, levitating above the city—impossible to capture practically without expensive wire rigs or helicopter shots

AI Solution:

  • Created Kling Omni Elements 3D model of J'Riva using 4-5 reference angles from the shoot day

  • This ensured tattoo consistency across the AI-generated ascension sequence (critical artist requirement)

  • Generated fully AI shot: J'Riva surrounded by a swarm, rising into the twilight sky above city lights

  • Final composite approximated real footage aesthetic (lighting, grain, color palette matched)

Why Elements mattered: Without the 3D character mapping, J'Riva's distinctive tattoos would have shifted/morphed across frames—breaking immersion. Elements locked his visual identity.