Love it or hate it, as of August 2024, AI Video still has a long way to go.
In this video, AI Samson lays out the current AI Video Pipeline. Although there are a few fledgling story-building tools in development, full-featured “story mode” is not yet available in AI video generators. The current pipeline is:
- Create the first and last frames of your clips
- Animate the clips between these frames
- Create audio and lip-sync the clips
- Upscale the clips
- Create music and SFX
- Edit everything together offline.
It seems new platforms emerge weekly but AI Samson makes these recommendations:
00:23 AI Art Image Generators
09:19 AI Video Generators
16:28 Voice Generators
18:02 Music Generators
20:44 Lip-Syncing
21:52 Upscaling
Keep an eye open for LTX Studio though.
My take: You know, the current pipeline makes me think of an animation pipeline. It’s eerily similar to the Machinima pipeline I used to create films in the sandbox mode of the video game The Movies over ten years ago: