Adobe Firefly Now Supports Prompt-Based Video Editing, Adds More Third-Party Models

Adobe has announced a significant update to its AI video-generation app, Firefly, introducing a new video editor that supports prompt-based edits. This update enables users to edit video elements, colours, camera angles, and other attributes via text prompts, making video editing more flexible and efficient. Previously, Firefly supported only prompt-based generation, requiring users to recreate the entire CLID to modify any part. With the new editor, users can make detailed edits without redoing the whole video.

The new editor also includes a timeline view that allows easy adjustments to frames, audio, and other settings, streamlining the editing process. This feature, which was first introduced in a private beta in October, is now available to all users.

Image Credits: Adobe

Leveraging Runway’s Aleph model, users can now provide specific instructions such as “Change the sky to overcast and lower the contrast” or “Zoom in slightly on the main subject” to make targeted adjustments to the video. Adobe’s Firefly Video model provides more granular control, such as uploading a start frame and a reference video of a camera motion to replicate that specific camera angle in the current video.

In addition, Adobe Firefly now integrates third-party models to enhance its capabilities. The Topaz Labs’ Astra model is included for upscaling videos to 1080p or 4K, and Black Forest Labs’ FLUX.2 image generation model is also being incorporated into the app. FLUX.2 will be available across platforms immediately, with Adobe Express users gaining access in January.

Image Credits: Adobe

This update comes as Adobe seeks to maintain its competitive edge in the image and video generation market, while competitors release new models. Adobe’s Firefly subscribers, including those on the Firefly Pro, Firefly Premium, 7,000-credit, and 50,000-credit plans, will get unlimited generations from all image models and the Adobe Firefly Video Model until January 15.

Adobe has made several enhancements to its Firefly models and apps throughout the year. In February, the company introduced a subscription service for access to various levels of image and video generation. Later in the year, Adobe launched a Firefly web app and mobile apps, further expanding its offerings. Now, with the addition of third-party models, Firefly is positioning itself as a comprehensive solution for image and video creation.

Key Highlights:

• Prompt-based video editing is now available in Adobe Firefly
• New timeline view for easy adjustments of frames, sounds, and video elements
• Integration of the Topaz Astra model for video upscaling to 1080p and 4K
• FLUX.2 image generation model added, with access on all platforms
• Firefly Pro and Premium users get unlimited access to image and video models until January 15