Currently, it only has one text-to-image generative model that can create pictures and stylized text. But more models are coming to the Firefly suite in the future.
This new AI image generator profiles itself as transparent and legally sound, as it's only trained with out-of-copyright or approved content from Adobe Stock. It also counts with an opt-out system for artists to exclude their work from Firefly's training datasets.
Read on for more details!
Announced today, the new Adobe Firefly progresses from the AI tools introduced into Adobe Express and Photoshop during 2022’s Adobe Max conference. But it promises to be far more powerful and deeply integrated into the Adobe ecosystem.
Today, Firefly offers a text-to-image generating tool that can create images and stylized text with visual effects (some called a “modern WordArt”) and perform AI image editing by applying a certain style to existing images, all from a written instruction entered by the user. Images created with Firefly are for commercial use, and from the samples we've seen, they look very high-quality.
They announced that Firefly will be a “family of AI generative models” that will include apps to generate 3D models, create vector-format variations of user sketches, and automatically apply a certain image style to entire videos, among other features.
While at this time, Firefly is available on its own web page only, the idea is to integrate all the models in all Adobe platforms: Adobe Express, Creative Cloud, Document Cloud, and Experience Cloud.
While in functionality, Firefly is not much different from other popular tools like Dall-E, Stable Diffusion, or Midjourney, Adobe has put a stronger focus on offering optimal results from minimal user input, something the former apps do not excel at.
Namely, Firefly doesn't require complex text prompts in order to produce satisfactory images – but you can use detailed, custom prompts if you wish. Instead, it comes equipped with presets for things like visual style, lighting, or aspect ratio, which helps you get the job done without having to write a lot of instructions. The preset features are also useful for Firefly’s other functionality, AI image editing: applying a certain style to existing images.
It seems that Adobe, as Shutterstock did too with their Shutterstock Generate tool, identifies that the regular user wants to produce great AI-generated images without having to become an expert in text prompt writing.
Another user (and artist) need they made efforts to cover is ethical management and legal safety of the AI-generated content. And they did so through three main decisions:
- All Firefly models have been trained only with out-of-copyright content and licensable content from Adobe Stock, which they have the authorization to use. That should keep them safe from the lawsuits that Stable Diffusion and Midjourney are facing due to how they trained their software.
- They excluded non-Adobe Stock artists’ work and any trademarked brands’ data from Firefly datasets. Meaning the apps are unable to accidentally replicate someone else's work or infringe their trademarks.
- They are defining a way to reward Adobe Stock contributors for using their work in Firefly training, which aims at a fairer treatment of the artists whose work is the backbone of AI-generative tools.
- As part of their Content Authenticity Initiative (CAI), they will establish a Do Not Train metadata tag for artists to exclude their work from AI-training datasets expressly. They expect other developers and models to accept this tag as part of a new industry standard for ethical AI training.
In a final note, Adobe communicated they can't guarantee whether Firefly-generated content would be copyrightable after the latest guidance on the copyright of AI-generated media by the USCO. But they believe their models give users enough creative control for copyright to be a possibility.
Adobe took its sweet time coming out with its native AI generative models, and even now, they are releasing only one initial tool is under beta. That makes them one of the latest “big fishes” to come out to swim in the AI pond.
But they do seem to have really thought of and creatively solved the most pressing user and artist needs from the get-go, plus having solid plans for the future that look really promising. Clearly, being a decades-long leader in the creative software industry has its perks.
The initial results shared from Adobe Firefly are rather impressive, and if user-friendliness is as real as it seems, then it’ll be no doubt a valuable tool to add to their Creative Cloud suite.
Are you signing up to try Adobe Firefly? Let us know how you find it!