Adobe has announced the expansion of its Firefly family of generative AI models to include video capabilities, marking a significant step forward for creative professionals.
The Firefly Video Model, is designed to be "commercially safe", broadening the range of tools available for content creators. This latest development comes alongside enhancements to Adobe's image, vector, and design models, which are integrated into Photoshop, Illustrator, Adobe Express, and Premiere Pro.
Ely Greenfield, Adobe's chief technology officer for digital media, commented on the breakthrough.
"The usage of Firefly within our creative applications has seen massive adoption, and it's been inspiring to see how the creative community has used it to push the boundaries of what's possible," he said.
"We're thrilled to bring creative professionals even more tools for ideation and creation, all designed to be commercially safe."
Firefly's growing ecosystem
Since its launch in March 2023, Firefly has been used to generate over 13 billion images, with 6 billion of those created in the past six months.
The model has become an essential tool for creators looking for innovative ways to generate content while ensuring commercial safety, thanks to its licensed content foundation. Firefly is already integrated across various Adobe Creative Cloud applications, including Photoshop, Illustrator, Substance 3D, and Premiere Pro, providing users with seamless tools to accelerate creative workflows.
The Firefly Video Model adds several new features that expand the scope of what creative teams can accomplish. Among these is the 'Generative Extend' feature, available in Premiere Pro's beta version. This tool allows users to extend video clips to fill gaps in footage, smooth out transitions, or hold shots for longer, creating perfectly timed edits. Additionally, 'Text to Video' and 'Image to Video' capabilities are available in the Firefly web app, enabling creators to generate video from text prompts or bring still images to life through motion.
These tools offer camera controls for adjusting angles, motion, and zoom, enhancing the creative possibilities.
Adobe's Firefly Image Model also received upgrades with the release of Firefly Image 3, delivering image generation speeds up to four times faster than previous iterations. These enhancements make it easier for creators to quickly generate images, providing more opportunities for ideation and experimentation.
Other significant updates include advancements in Adobe Illustrator, where the Firefly Vector Model continues to evolve. The new version allows designers to control the density of elements within patterns, providing greater flexibility when working with vectors. Furthermore, the 'Generative Workspace' in Photoshop enables simultaneous concept development and visual creation, making it easier for teams to iterate on ideas.
Enterprise offerings and collaboration
For businesses, Adobe introduced new Firefly-powered services designed to scale content creation. The 'Bulk Create' tool, now in beta, simplifies the process of editing large volumes of images, while Dubbing and Lip Sync features allow for automated translation of spoken dialogue in videos, ensuring lip movements match the new language.
These tools have already seen adoption by major brands such as PepsiCo, IBM, and Mattel, which use Firefly to streamline workflows and focus more on creative exploration.
Greenfield spoke to the corporate uptake of Firefly's tools, noting, "It's been incredible to see leading brands and enterprises embrace Firefly to scale content creation, freeing up their creative professionals to focus on innovation and storytelling."
Responsible AI development
Adobe has placed significant emphasis on the responsible development of its AI tools. Firefly is trained on licensed content, such as Adobe Stock and public domain materials, ensuring the outputs are safe for commercial use. This responsible approach aligns with Adobe's commitment to ethical AI practices, guided by principles of accountability, responsibility, and transparency.
The company has also spearheaded the Content Authenticity Initiative since 2019, promoting transparency in digital content. Select Firefly-powered features within Adobe's Creative Cloud now carry Content Credentials, which provide users with a digital "nutrition label" showing how content was generated or modified.
As Firefly's video model moves through its beta phase, Adobe aims to gather feedback from a select group of creative professionals to refine its offerings. The company will share more details on pricing and availability when the Firefly Video Model exits beta.
Adobe's continued investment in generative AI technologies reflects the company's broader mission to empower creators with cutting-edge tools, providing the flexibility and control needed to bring their visions to life.
