AI video technology is advancing rapidly, with Adobe introducing its most recognizable AI editing tool, Generative Extend, out of beta. This tool, powered by Firefly, is the first of its kind in Premiere Pro and allows editors to seamlessly extend video and audio frames for perfectly timed edits. Adobe has a mix of AI-powered tools and those that create new elements using AI, with Generative Extend falling into the AI creation category. This tool can be used to create a few seconds of film that lengthens existing clips, providing editors with the ability to extend scenes where needed.
In addition to Generative Extend, Adobe is bringing two other AI-powered tools out of beta in Premiere Pro. The first is a smart search panel called Media Intelligence, which helps users navigate Premiere and refine their content without leaving the program. The second tool is an AI caption translation feature, allowing users to add captions in multiple languages on the same clip without having to switch to a different platform. Adobe has been heavily invested in AI technology, with Firefly AI video generator and AI updates to Photoshop among its recent advancements.
Generative Extend in 4K is one of Premiere Pro’s standout AI features, allowing users to create a few extra seconds at the beginning or end of clips in 4K resolution. This tool was initially launched in beta in October 2024 and now offers the ability to render AI-generated clips in 4K and vertically in the regular version of Premiere Pro. Users can extend clips by selecting the Generative Extend tool from the toolbar and dragging out the clip, with Premiere Pro labeling AI-generated clips in the timeline for easy identification. To use Generative Extend, users will have a limited time to try it out for free before Firefly generation credits are required.
The new smart search panel in Premiere Pro, Media Intelligence, aims to simplify the process of finding specific clips by recognizing elements within clips and providing advanced search capabilities. This tool allows users to search for clips based on metadata, shoot date, camera type, and even specific visual elements within the footage. Additionally, Media Intelligence can highlight sections of longer videos, making it easier to locate specific content within a larger video file without extensive scrubbing. The tool runs locally on the user’s computer and does not read or store information about the clips.
Premiere Pro’s auto-captioning feature is also getting an upgrade with the addition of translation capabilities. Users can now add translated captions to their videos within the Premiere Pro beta app, enabling them to create captions in 27 different languages, including Spanish, German, French, and Japanese. This feature allows for greater accessibility and reach for videos by providing multilingual captioning options. Overall, Adobe’s focus on AI technology in Premiere Pro is aimed at enhancing the editing experience and providing users with innovative tools to create high-quality video content.