Workflow to create aerial clips

Rory Flynn has shared a workflow that uses a combination of AI tools to create aerial clips.

The tools are: Claude 3.7, Magnific and Runway.

The workflow is:

  1. Build a 3D Render in Claude 3.7
  2. Program in camera movements
  3. Screen record the render
  4. Upload this video to Runway Gen-3
  5. Extract the first frame
  6. Apply a Magnific Structure Reference to the first frame
  7. Upload this new first first frame in Runway
  8. Apply the new first frame to the initially rendered video using Runway Restyle.

The Claude prompt he used in Step 1 is: “can you code a 3d version of [subject + env] in three.js?” E.g. “can you code a 3d version of an epic castle atop a mountain plateau in a valley in three.js?

The Magnific Structure Reference he used in Step 6 is: “editorial photo, epic castle on a plateau, intricate rocky textures and fine details, immaculate New Zealand landscape, white marble castle, high precision photography” with these settings:

  • Model: Mystic 2.5
  • Structure Reference
  • Structure Strength: 52%
  • Resolution: 2k
  • Creative Detailing: 75%
  • Engine: Magnific Sharpy

See his X post or LinkedIn post.

See an interview with Rory on AI in business.

My take: amazing!