Adobe is updating its AI video-generation app, Firefly, with a new video editor that supports precise prompt-based edits, as well as adding new third-party models for image and video generation, including Black Forest Labs’ FLUX.2 and Topaz Astra.
Until now, Firefly only supported prompt-based generation, so you would have to recreate the entire clip if any part of the video was not to your liking. With the new editor, you can use text prompts to edit video elements, colors, and camera angles, and we also get a new timeline view that lets you adjust frames, sounds and other characteristics easily.
The company first announced the new video editor in October in private beta, and now it is rolling out to all users.
The company said that using Runway’s Aleph model, users can give Firefly specific instructions, such as “Change the sky to overcast and lower the contrast” or “Zoom in slightly on the main subject.”
And with Adobe’s own Firefly Video model, users can now do stuff like upload a start frame and a reference video of a camera motion and tell it to recreate that camera angle for the video they’re working on.
The company also said users can now use the Topaz Labs’ Astra model to upscale videos to 1080p or 4K. Black Forest Labs’ FLUX.2 image generation model is coming to the app, too, along with a collaborative boards feature.
The company said FLUX.2 will be available on Firefly across platforms immediately, and Adobe Express users will be able to use FLUX.2 from January.
With competitors releasing new models for image and video generation, Adobe wants to lure users into engaging with its app more. Along with new updates to the Firefly app, the company said subscribers of the Firefly Pro, Firefly Premium, 7,000-credit, and 50,000-credit plans will get unlimited generations from all image models and the Adobe Firefly Video Model in the Firefly app until January 15.
Adobe has made a ton of changes to its Firefly models and apps this year. In February, the company launched a subscription that let users access various levels of image and video generation; then it launched a new Firefly web app along with mobile apps later in the year, and has added support for more third-party models within the Firefly app.
