Rory Flynn has shared a workflow that uses a combination of AI tools to create aerial clips.
CLAUDE + MAGNIFIC + RUNWAY WORKFLOW
3D-to-Video (full tutorial) ↓
PROCESS:
01. Build 3D Renders in Claude 3.7
02. Program camera movements
03. Screen record render
04. Upload video to Runway Gen-3
05. Extract 1st frame
06. Magnific Struct. Ref. 1st frame
07. Upload in Runway… pic.twitter.com/PriqPhnKif— Rory Flynn (@Ror_Fly) March 11, 2025
The tools are: Claude 3.7, Magnific and Runway.
The workflow is:
- Build a 3D Render in Claude 3.7
- Program in camera movements
- Screen record the render
- Upload this video to Runway Gen-3
- Extract the first frame
- Apply a Magnific Structure Reference to the first frame
- Upload this new first first frame in Runway
- Apply the new first frame to the initially rendered video using Runway Restyle.
The Claude prompt he used in Step 1 is: “can you code a 3d version of [subject + env] in three.js?” E.g. “can you code a 3d version of an epic castle atop a mountain plateau in a valley in three.js?”
The Magnific Structure Reference he used in Step 6 is: “editorial photo, epic castle on a plateau, intricate rocky textures and fine details, immaculate New Zealand landscape, white marble castle, high precision photography” with these settings:
- Model: Mystic 2.5
- Structure Reference
- Structure Strength: 52%
- Resolution: 2k
- Creative Detailing: 75%
- Engine: Magnific Sharpy
See his X post or LinkedIn post.
See an interview with Rory on AI in business.
My take: amazing!