The goal here is to consistently end up with the same real person in multiple generated video clips.
“In this tutorial we’ll learn how to use the Flux image generator to train a custom AI model specifically for your own face and generate AI photos of yourself. Then we’ll animate those photos with the Kling AI video generator, which in my opinion generates the best AI videos right now.”
In a nutshell, the process is:
Create an archive of at least ten photos of your star
Upload this to the Ostris flux-dev-lora-trainer model on Replicate
Train the LORA custom image model and use it to generate key frames
Upscale these images on Magnific, optionally
Generate six second clips in Kling AI with these images
My take: it seems week by week we’re getting closer to truly usable generated video that rivals (or even surpasses) Hollywood’s CGI/VFX. Imagine being able to train more than one LORA model into Flux for Kling. I have it on good authority that that is just around the corner.
My take: a lot of people will immediately claim this is heresy, and threatens the very foundations of cinema as we’ve come to know it over the last one hundred years. And they would be right. And yet, time marches on. I believe some variation of this is the future of ultra-low budget production. Very soon the quality will surpass the shoddy CGI that many multi-million dollar Hollywood productions have been foisting on us lately.
Love it or hate it, as of August 2024, AI Video still has a long way to go.
In this video, AI Samson lays out the current AI Video Pipeline. Although there are a few fledgling story-building tools in development, full-featured “story mode” is not yet available in AI video generators. The current pipeline is:
Create the first and last frames of your clips
Animate the clips between these frames
Create audio and lip-sync the clips
Upscale the clips
Create music and SFX
Edit everything together offline.
It seems new platforms emerge weekly but AI Samson makes these recommendations:
My take: You know, the current pipeline makes me think of an animation pipeline. It’s eerily similar to the Machinima pipeline I used to create films in the sandbox mode of the video game The Movies over ten years ago:
Folks who follow this blog, know that I love Telefilm‘s Talent to Watch competition. It remains your best chance at funding your first feature film in Canada.
Until they allowed direct submissions from underrepresented folks two years ago, this is normally a two-stage process. Each of approximately 70 industry partners get to forward one (and sometimes two or three) projects to Telefilm and then the Talent to Watch jury selects eighteen or so for funding.
The prize? $250,000. One quarter of a million dollars.
Don’t belong to one of the Industry Partners? No problem!
The Chilliwack Independent Film Festival has got you covered. Launched last year, Pitch Sessions lets you throw your first feature project into the ring; five are selected to then pitch in person at the festival and the winner becomes CIFF’s nominee to Telefilm’s next Talent to Watch competition.
Oh yah, the top five also get free passes and a hotel room for the festival.
My take: If you’ve got a spare $100 and you want to hone your pitch in public, this is a great opportunity. Note that each industry partner sets their own rules but this is the only one I know of that incorporates a live pitch. Just be aware that Telefilm typically doesn’t open the Talent to Watch competition until mid-April.
BANFF Spark provides market access, training, and networking opportunities to help build more Canadian women-owned media businesses.
“Since the program began in 2019, BANFF Spark has already provided opportunities for more than 200 women entrepreneurs. The program is open to all candidates and is designed to empower women of colour, Indigenous women, women with disabilities, 2SLGBTQI+ women, and non-binary individuals.”
All selected participants will receive:
Online workshops (that address the core components of business development).
Networking opportunities with top industry professionals.
A full-access pass to the 2025 Banff World Media Festival (June 8-11, 2025) and its complement of top industry sessions and international marketplace.
A $1500 CAD travel stipend to attend the 2025 Banff World Media Festival
(on the condition of in-person Festival attendance).
“For the first time in the history of the Olympic Summer Games, the Opening Ceremony will not take place in a stadium. The parade of athletes will be held on the Seine with boats for each national delegation. Winding their way from east to west, the 10,500 athletes will cross through the centre of Paris. The parade will come to the end of its 6-kilometre route in front of the Trocadéro, where the remaining elements of Olympic protocol and final shows will take place. Eighty giant screens and strategically placed speakers will allow everyone to enjoy the magical atmosphere of this show reverberating throughout the French capital.”
My take: It was spectacular! As it should be, costing a reported 120 million Euro.
You’ve seen the Sora samples. The Dream Machine videos. How does LTX Studio, touted as “the future of storytelling, transforming imagination into reality,” stand up?
“There are whole bunch of things it does not do, but I love where it’s going and where I hope it’s going to go…. It’s brilliant for keeping track of all of the shots that you really do need to keep track of. It’s brilliant for scene wide settings and project wide settings, something I’ve been craving, and it’s really, really good at that. It’s great for casting. It’s brilliant for allowing you to then kind of just drop those characters in. I love the generative tools that will allow you to erase bits that you don’t need in your starting shot and to add other bits that you need that will help you tidy up the shot…. My two big gripes and I don’t think these are bugs that they’re going to fix, this is just fundamental features that it needs to be in there. One of them is every shot is slow motion…. Secondly, breaking the fourth wall. It drives me out of my mind!”
Here’s a peek at actually using LTX Studio by Riley Brown:
My take: In addition to Haydn’s slo mo and fourth wall gripes, I would add these requirements as well: movement and expression control including blinking and lip-sync. Mid-2024, one has to use each of the many AI tools for what it does best and then bring all the bits together in post. As an early proponent of Machinima (using video games to make movies,) I’m watching this space with interest. My conclusion: advances are being made but we’re nowhere near lucid dreaming.
“To fund Canadian narrative feature You Can Live Forever, Rob Vroom was able to utilize some of the same backers and funders he had used with previous films. They secured a pre-license TV deal that triggered Canadian federal top-up funding and Canadian tax credits. Canadian funding most of the time requires distribution to be in place beforehand, and although the film was Sarah Watts’ and Mark Slutsky’s first feature, Canadian distributor Mongrel Media stepped up and came on early.”
Robert explains:
“I proposed a CAD $2.5 million Canadian budget. I was able to raise that money through Telefilm Canada—through SODEC—which is our Quebec provincial equivalent to Telefilm, via a pre-license deal with CBC and a top-up fund through the CMF (Canadian Media Fund). If you can secure a pre-license fee of at least 5% of your budget, then CMF will top up another 15% of your budget, which for us was huge. And then of course tax credits.”
This table is very revealling:
equity / grant / TV licence / tax credit
amount
SODEC
CAD $750,000
Telefilm
CAD $550,000
CBC Films
CAD $125,000
CMF
CAD $373,500
Provincial Tax Credits
CAD $402,000
Federal Tax Credits
CAD $80,000
COVID Support Fund
CAD $195,000
Producer Investment
CAD $15,000
To summarize how to finance a low-budget feature film in Canada:
Get Telefilm Canada funding.
Get a Canadian Distributor (see below.)
Get a TV license to trigger CMF funds.
Make the movie and apply for Canadian federal and provincial tax credits.
My take: Some might wait until their festival release and the hoped-for bidding war, but I think it’s a great idea to get a Canadian distributor on board as soon as possible. They can help you secure:
A direct pitch to a foreign streamer doing business in Canada that as of September 2024 must contribute 5% of Canadian revenue to CanCon (and they can choose to direct invest 2% of that 5%.) See http://www.informediation.com/blog/2024/06/19/is-the-digital-ecosystem-starting-to-look-a-lot-like-tv/ The Big Three are Netflix, Prime Video and Disney+. (CAVCO insists you approach these through a Canadian distributor to qualify for Tax Credits!)
A Canadian TV deal. They’ll get you in the room to pitch to CBC (includes GEM,) Bell Media (includes CraveTV,) and Rogers. This will then trigger Canada Media Fund funds.
An Educational TV deal: Knowledge Network in BC and TVO in Ontario.
Airlines for in-flight entertainment.
US and International distribution deals.
A one-week screening in Toronto to qualify for the Toronto Film Critics Association’s $50K Rogers Best Canadian Film Award, perhaps the biggest film cash prize in Canada. See https://torontofilmcritics.com/awards/signature-award-2-2/ (Hey Rogers, why did you reduce this prize by half, from $100,000? Are you goading someone else to offer more? Netflix and Prime, I’m looking at you!)
