YouTube’s Dream Track and Music AI Tools

Sarah Fielding of Engadget reports that YouTube’s first AI-generated music tools can clone artist voices and turn hums into melodies.

The YouTube technology is called Dream Track for Shorts.

The mock-up asks you for a text prompt and then writes lyrics, music and has a voice-cloned artist sing:

YouTube is also testing Music AI Tools:

This is all possible due to Google DeepMind’s Lyria, their most advanced AI music generation model to date.

Cleo Abram also explains the real issue with AI music: When do artists get paid?

My take: AI is just a tool — I use it occasionally and will be exploring it more in 2024. What we as a society really need to figure out is what everyone’s going to do, and how they’ll get (not earn) enough money to live, when AI and Robotics make paid work redundant.

Filmed on iPhone

Apple‘s October 30, 2023 Event closed with this end credit: “This event was shot on iPhone and edited on Mac.

That would be filmed using the iPhone 15 Pro Max with the free Blackmagic Camera App and Apple Log. Plus edited in Premier Pro and then graded and finalized in Davinci Resolve.

michael tobin adds further insight and commentary:

My take: Of course, now Apple has to film everything they do like this!

 

Technology saves “last Beatles song”

The Beatles have just released their last single, Now and Then.

It appears as a free VEVO music video as well as these for-purchase products: various versions of vinyl and cassette.

“Now and Then” was a demo John Lennon recorded in The Dakota in the late 1970’s. The main reason it’s The Beatles’ last single is because until now it was too hard to separate John’s vocals from the piano notes. Technology to the rescue:

Want to know more? Check out this Parlogram documentary.

My take: I like this video most when it starts incorporating images from “Then” with footage from “Now” viz. 1:47, 1:55, etc. I would have liked to have seen much more of this technique used. This is truly the visualization of Now and Then — show us more!

Unfortunately, I’m not overly enamoured with the song itself; I find it middling and melancholic. I also don’t like:

  • The graphics and the cover image — boring!
  • The first few shots of the video are over-sharpened and plop us in the “uncanny valley” — not a good start.
  • The lip sync is poor — if you’re going to use AI, why not go all the way and use AI to reshape the mouths for perfect sync?
  • I think they missed a great opportunity to have Paul and Ringo sing verses in their own voices. Again, why not go all in and use AI to voice clone George and have him sing a verse too?

As to “last singles” — I think they should give this treatment the last song the Beatles actually recorded together: The End. Although, after 60 years, perhaps it’s just time to move on.

Telefilm releases annual report for 2022-23

Telefilm Canada has release two annual reports: Full Screen 2022-2023 Annual Report and PROGRAM RESULTS FROM SELF-IDENTIFICATION DATA COLLECTION Fiscal 2022-2023 – First Edition.

Some highlights:

“We guide filmmakers every step of the way: from training and mentoring at the beginning of their journey, to supporting them in development and production, from helping them promote their projects to partners and digital platforms, to supporting them in theatrical and festival releases.”

  • The foreign production and production services sector accounts for approximately 57% of the total volume of screen-based content produced in Canada.
  • Canadian films’ share of screen time in movie theatres: 4.7%.
  • Telefilm administered a total of $158.7 million.
  • Quebec received 47% of total funding.
  • Ontario received 32% of total funding.

From the 2022-2023 self-identification data report:

  • “Telefilm granted 24% ($20 million) of total funding to projects in which one of the key creative positions was held by a person with a disability.”
  • “For producers with disabilities, the representation is at a quarter (25%) in the Talent to Watch Program.”

My take: there’s lots to celebrate in these reports. I just wish we could see more Canadian films on cinema screens in Canada.

Victoria’s connection to Letterboxd

On September 29, 2023, co-founder Matthew Buchanan of Letterboxd announced, “we have accepted an offer for Tiny to acquire a 60 percent stake in Letterboxd, securing the platform’s future as an independently run company and part of the Tiny stable.”

Matthew elaborates:

“Something else that began around this time, courtesy of Tumblr’s flourishing design community, was my friendship with Andrew Wilkinson and his brother Will, both involved with MetaLab. There was no-one paying attention to the design scene at that time who wasn’t aware of their digital agency in Victoria and the quality of work it was delivering. We first met in person at XOXO in Portland, then kept in touch, as we both continued to build: us with our studio and Letterboxd, and Andrew with MetaLab and then Tiny, which acquires and supports great, creative businesses.”

The Hollywood Reporter reports the deal at $30,000,000 USD.

My take: fascinating! I can’t help but think the world is smaller than I once thought.

Using AI for good

Alyssa Miller reports on No Film School that Deepfake Technology Could Help You Change Inappropriate Dialogue in Post.

Flawless AI‘s tools include TrueSync that can be used to replace dialogue or even change the spoken language, all the while preserving correct mouth and lip movement.

Flawless TrueSync from Flawless AI on Vimeo.

Lara Lewington from BBC‘s Click explores the technology well:

Flawless on BBC Click from Flawless AI on Vimeo.

Other Flawless AI tools include: AI Reshoot (“‘allows you to make dialogue changes, synchronizing the on-screen actors mouths to the new lines, without needing to go back to set”) and DeepEditor (“enables filmmakers to edit and transfer an actor’s performance from one shot, to another, even if the shots were filmed from different angles.”)

My take: this is powerful technology but not sure how I feel about Robert De Niro’s face speaking in German, German that some other actor is speaking. (Of course, the next iteration of this tech is to voice clone and use that to speak in German. But now we’re really offside.)

The Revolution Will Be Televised!

Blackmagic has introduced Digital Film for iPhone.

Blackmagic Camera unlocks the power of your iPhone by adding Blackmagic’s digital film camera controls and image processing! Now you can create the same cinematic ‘look’ as Hollywood feature films. You get the same intuitive and user friendly interface as Blackmagic Design’s award winning cameras. It’s just like using a professional digital film camera! You can adjust settings such as frame rate, shutter angle, white balance and ISO all in a single tap. Or, record directly to Blackmagic Cloud in industry standard 10-bit Apple ProRes files up to 4K! Recording to Blackmagic Cloud Storage lets you collaborate on DaVinci Resolve projects with editors anywhere in the world, all at the same time!”

The tech specs are impressive.

This is a great way to learn Blackmagic’s menu system.

It’s also a great way to get introduced to Blackmagic’s Cloud.

And it’s a great way to explore the Sync Bin in DaVinci Resolve.

Oh, and by the way, it’s free.

My take: Grant Petty mentions how multiple filmers at “protests” in this update could use Blackmagic Cameras on their iPhones and work with an editor to create almost instant news stories; I think this technique could also be used during concerts as well.

So, have things changed from fifty years ago? The revolution will be live.

NEGRONI Week!

Kofi Outlaw reports on Comicbook.com strong-worded views by Ryan Reynolds on Pumpkin Spice: “What the F Are We Doing People?”

Kofi points out: “Beyond his acting, Ryan Reynolds has made a name for himself as one of the most media-savvy modern-day moguls. In addition to Aviation Gin, Reynolds also has his Mint Mobile venture; the Canadian wealth management service Wealthsimple; tech ventures Nuvei and 1Password; production and marketing venture Maximum Effort, and sports ventures including stakes in F1 team Alpine and England’s Wrexham AFC soccer team (which is also the subject of his hit docu-series). Reynolds is also pursuing a bid for Canada’s Ottawa Senators NHL team, and their stadium, the Tire Centre. Reynolds’ wife, actress Blake Lively, is similarly branching out as a mogul, launching her own line of sparkling non-alcoholic cocktail mixers, Betty Buzz.”

Here’s the transcript, delivered as only Ryan Reynolds can:

“It’s nearly fall, which means the entire universe will once again be losing its mind for pumpkin spice. Well, not at Aviation. Not on my watch. Let’s make a Negroni.
First, take one part each of Bitter Red Liqueur and Sweet Vermouth. Pour over ice. Take a pumpkin spiced cinnamon stick and shove it right up your [BLEEP].
Then, we add one part Aviation American Gin. And stir.
Then while stirring, we’re going to take a moment to ponder, why it is, that once a year for two or three months, we lose our [BLEEP] mind over pumpkin spice. What the [BLEEP] are we doing, people? I’m not sending my kids off to school with a [BLEEP] cumin yogurt in their lun…
Next, we’re going to garnish with an orange peel, delicious orange fruit, and enjoy a real drink. [BLEEP] you pumpkin spice, it’s Negroni week.
(credits)
It’s come to my attention that pumpkin spice has quite a lot of fans, and a powerful political lobby. So, on behalf of Aviation American Gin, its parent company Diageo, we’d like to wholesale apologize for our previous commercial.
Help me.”

My take: I love Negronis!

Broadcast Surpassed by Streaming in July 2023

Nielsen relays that Streaming grabs a record 38.7% of total TV usage in July 2023.

Streaming: “Acquired content was the stand-out for the month. Suits… set new viewing records for an acquired title, amassing almost 18 billion minutes. In aggregate, the heavy viewing levels pushed streaming’s share of TV to 38.7%, a new record, with Amazon Prime Video, Netflix and YouTube all hitting all-time highs.”

Broadcast: “Drama remained the most watched category, capturing 25.7% of viewing. Overall, total broadcast viewing was down 3.6% to finish the month at 20% of TV, representing a new low.”

Cable: “Cable viewing slipped as well, losing a full share point to capture 29.6% of TV in July. Feature film was the only genre to see a rise in viewership (0.5%).”

Other includes video on demand (VOD), audio streaming, video gaming, as well as Blu-ray/DVD playback.

My take: According to Nielsen, Broadcast and Cable TV viewing totalled 49.6% or just less than half. Of course, when the NFL and the NHL roar back in the Fall, these numbers will increase. But still….

Sony tests cameraless virtual production

Jourdan Aldredge notes on No Film School of Sony Testing Real-Time Cameraless Production for New Ghostbuster Movie.

He writes:

“Sony Pictures Technologies has unveiled its latest developments in real-time game engine technology with this new proof-of-concept project…. Its “cameraless” virtual production style… intends to allow developers to use this real-time game engine to produce a scene live on a motion capture set.”

Jason Reitman, who wrote and directed the two-minute scene in one day, says:

“I love filmmaking in real places with real actors. So for me, this is not a substitute. If I were to make Juno again today, I would make Juno exactly the same way. What I see here, what thrills me, is if I wanted to make a movie like Juno that took place in ancient Rome, I wouldn’t be able to do that because it would cost $200 million to make Juno. And that’s not cost effective. There’s no studio who would sign up for that. You can make Ghostbusters for a lot of money, but you can’t make an independent film in an unexpected location. You can’t make an independent film underwater, on the moon or, you know, a thousand years ago or into the future, and what thrills me about it is the possibility of independent filmmakers who want to tell their kind of stories, but in environments that they don’t have access to with characters that they don’t have access to, and the possibility of getting a whole new wave of stories that you could read in a book, but you would never actually get in a film.”

My take: While I agree with Jason Reitman that this technology is promising, I think their finished scene is underwhelming. It’s just not believable. For instance, the folks on the sidewalks are obviously from a video game. The traffic is not real world either. And the actor is not human; he’s a marshmallow! However, this might be where superhero comic book movies are going: totally computer-generated, with the faces of the stars composited onto the quasi-lifelike animation. (My nightmare situation: those faces and voices are AI generated from scans and recordings!)