M+E Daily

Adobe Expands Frame.io Platform, Adds AI Text-Based Editing to Premiere Pro

Ahead of the 2023 NAB Show in Las Vegas, Adobe on April 13 announced that it expanded Frame.io’s video collaboration platform to photos and PDF documents, broadening the cloud-based solution’s appeal to new markets with a wider range of creative professionals and businesses than ever before.

Frame.io now offers users an end-to-end workflow from content capture to edit, review and approval via one centralized hub, leveraging new Camera to Cloud native integrations with FUJIFILM X-H2S and X-H2 cameras.

Adobe also unveiled enhanced security features including forensic watermarking, “making Frame.io the world’s most secure creative collaboration platform,” it said

New Frame.io Camera to Cloud technology, meanwhile, enables photographers to transfer photos immediately from their cameras to Frame.io’s cloud platform without the need to remove or download memory cards to hard drives, “facilitating the immediate sharing of assets with stakeholders,” Adobe said.

New native Frame.io Camera to Cloud integrations with FUJIFILM X-H2 and X-H2S cameras allow for instant sharing of both RAW photos from the field.

And Frame.io now “fully supports PDF documents to aid teams in reviewing collateral and other project-adjacent materials,” Adobe said.

Adobe’s latest release of Frame.io will be on display at the 2023 NAB Show, April 15-19 in Las Vegas, at booth #N2438. Fujifilm’s native Frame.io Camera to Cloud integrations for X-H2 and X-H2S cameras are available now, Adobe said.

Premiere Pro Innovations

Meanwhile, Adobe debuted dozens of new Premiere Pro features including artificial intelligence-powered text-based editing that Adobe said makes “editing video as easy as copying and pasting text, and Automatic Tone Mapping to achieve consistent colors and contrast when mixing footage from different cameras.”

Demonstrating text-based editing, Francis Crossman, Sr., product manager at Adobe, said: “The transcription is powered by Adobe Sensei. It runs on device, so no internet is required. It’s fast and accurate. You can transcribe all your footage in the background. It uses the keyboard shortcuts … and it truly is an entirely new way to edit inside Premiere Pro.”

Text-based editing is now available in public beta and it’s” expected to ship in May, and we can’t wait to see what you create with it,” he added.

Significant GPU acceleration and other performance enhancements also make the latest Premiere Pro the fastest version Adobe has ever released, it noted.

Over 400 partners now deliver solutions to customers of Adobe’s video tools, the company pointed out.

Adobe Firefly

Paul Saccone, senior director of Pro Video Marketing at Adobe, pointed out in a virtual media briefing ahead of NAB that the company recently announced Adobe Firefly.

“While today’s product release is not about Firefly specifically, we do have a vision about how it might eventually fit into our professional video and audio apps that we’re going to talk about today,” he said.

“Adobe Firefly is a new family of creative generative AI models, and we train our models using hundreds of millions of pieces of Adobe stock, openly licensed and public domain content,” he noted. “And that means that we’re generating content that’s actually safe for commercial use. Our Gentech models combined with our Adobe expertise and imaging, text design and video produces extremely high quality assets, and we’ve taken great care to ensure that Firefly won’t generate content based on other people’s brands or IP,” he added.

“Although we don’t have any Firefly specific video features to announce today, we want to just talk about our vision and some of the what ifs so to speak,” he told reporters.

“Generative AI can be an incredible tool to help editors visualize creative intent,” he explained, adding: “Imagine taking a script or even natural language text inputs to generate objects or story points or … to add an effect that changes a shot from day to night or add snow. Imagine using AI to organize footage into bins and automatically matching location, camera metadata, analyzing speech and then creating a rough cut based on the character names and lines in the script. The point is not to edit for you. It’s to act as your creative assistant so you may have more time to work on your craft. So we’re thinking really deeply about what generative AI and Adobe Firefly can mean for editors and motion designers throughout the entire workflow. And we couldn’t be more excited about its potential.”