Adobe has made a significant advancement in the world of AI with the launch of its AI-powered video generator, marking an expansion in its suite of generative AI models. This new offering, known as the Firefly Video Model, adds to the company's already impressive lineup, which includes the Image Model, Vector Model, and Design Model. The introduction of this video model is a game-changer for content creators, as it brings AI-generated video tools to the forefront, designed specifically to be commercially safe. Adobe has opened up the Firefly Video Model for limited public beta, further solidifying its leadership in creative AI technology.
Within just a year of its launch, Adobe’s Firefly models were integrated into popular software such as Photoshop, Illustrator, and Adobe Express, enabling enhanced workflows for creatives. Supporting text prompts in over 100 languages, Firefly has quickly become a global tool for content generation. This latest video model adds a new dimension to Adobe's offerings, providing video generation capabilities that will help creatives produce stunning content with the assurance of commercial safety.
As part of the Firefly Video Model launch, Adobe is rolling out three new tools aimed at enhancing video generation and editing. These tools are designed to streamline workflows for content creators, offering functionalities that range from extending video footage to generating new video clips from text and images.
The first tool to be introduced in Adobe's new video model is the Generative Extend tool for Premiere Pro. This feature, now available in beta, allows users to extend existing video clips by up to two seconds at resolutions of either 720p or 1080p, with a frame rate of 24 FPS. This tool can be particularly helpful for fine-tuning footage, such as adjusting eye-lines or correcting minor movements, which can often eliminate the need for reshoots.
In addition to its video extension capabilities, the Generative Extend tool can also enhance audio. It allows users to extend sound effects and ambient noises by up to ten seconds, offering greater flexibility in post-production. However, it should be noted that this feature does not yet support spoken dialogue or music. While the tool is primarily designed for small adjustments, it brings a high level of precision to video and audio editing processes.
One of the most exciting features of the Firefly Video Model is the Text-to-Video tool. Similar to other AI-powered video generators like Runway and OpenAI's Sora, this tool enables users to create videos from simple text descriptions. The tool offers flexibility in the type of video styles it can generate, from traditional film formats to 3D animation and stop-motion. With the addition of camera controls, users can manipulate camera angles, motion, and shot distance to refine the output to their liking.
The Text-to-Video tool is ideal for creators looking to bring their ideas to life quickly without the need for complex video production skills. This feature opens up a world of possibilities, enabling the generation of short films, promotional videos, and creative clips in just a few steps.
The third tool in Adobe’s new Firefly suite is Image-to-Video, which allows users to combine text prompts with reference images to create video content. By uploading a still image, users can gain greater control over the final video output, making it particularly useful for creators looking to generate b-roll or visualize potential reshoots. The Image-to-Video tool provides a new level of versatility in video editing, as it allows creators to transform static images into dynamic visual content.
This feature is especially useful for those in need of supplementary footage, whether for enhancing existing projects or visualizing different creative directions. Though the tool is still in beta, it represents a major step forward in the world of AI-powered video generation.
All three tools—Generative Extend, Text-to-Video, and Image-to-Video—are currently in limited public beta and take approximately 90 seconds to process outputs. Adobe has announced that it is working on a "turbo mode" that will accelerate this process, but for now, users will need to wait a little longer for their videos to be generated.
A key feature that sets Adobe's Firefly Video Model apart from other video generation tools is its focus on commercial safety. The models are built entirely on content that Adobe has the rights to use, ensuring that users can generate videos without worrying about copyright issues. This is a significant advantage over competitors like Runway, which has faced criticism for using scraped YouTube videos to train its models, or Meta, which has allegedly used personal videos without user consent.
For creators concerned about copyright compliance and commercial use, Adobe's emphasis on legal and ethical standards could make the Firefly Video Model a more attractive option.
Adobe’s Firefly Video Model is currently available in limited public beta through its official website. During this phase, users can join a waitlist to gain access to the new tools, and all video generations are free. However, the company has not yet announced pricing details for when the tool moves out of the beta phase. Adobe has promised to release more information about pricing and subscription plans closer to the official launch.
Conclusion
With the introduction of the Firefly Video Model, Adobe is positioning itself as a major player in the rapidly evolving field of AI-generated video content. The three new tools—Generative Extend, Text-to-Video, and Image-to-Video—offer creatives the ability to extend and enhance their videos with ease, while ensuring that all content is safe for commercial use. Though currently in beta, these features represent a significant leap forward for video production, allowing creators to bring their ideas to life faster and more efficiently than ever before. As the AI video generation landscape continues to evolve, Adobe’s focus on legal compliance and user control will likely make Firefly a popular choice for creators around the world.