Video now in Firefly

Firefly screen

Adobe has launched the Firefly Video Model, which the company says is the only generative AI model that is IP-friendly and commercially safe; it has also expanded the Firefly AI-powered Web app. As a result of adding Firefly Video Model in public beta, video, image, and vector generation are now integrated within a single application.

Adobe unleashed a new species of its Firefly application, which now includes the ability to generate videos using the Firefly Video Model (in public beta). According to Adobe, the new Firefly Video Model is the first commercially-safe AI video generation model for production-ready content.

Firefly screen
(Source: Adobe)

The Firefly app is an all-in-one application with a suite of professional-grade controls; it  enables users to seamlessly ideate and create and deliver production-quality work. Users can now start with style and structure reference images, use professional camera angles to get their ideal shot, and translate audio and video into multiple languages while maintaining an authentic voice, all with Firefly. The Firefly app integrates directly with Adobe Creative Cloud applications including Photoshop, Premiere Pro, Express, and more.

Previously, the Firefly app supported image and vector generation. But now, video is supported, thanks to the new Firefly Video Model, which powers Generate Video (beta) in the Firefly application. It also powers Generative Extend (beta) in Premiere Pro.

The new Generate Video (beta) provides creative professionals with tools to generate video clips from a text prompt or image, use camera angles to control shots, create professional-quality images from 3D sketches, craft atmospheric elements, generate B-roll to fill gaps in timelines, and develop custom motion design elements. It supports 1080p resolution to start, with both a lower resolution ideation model for high-speed iteration and a 4K model for pro-level production work said to be coming soon.

Also new and available in the Firefly app are multi-modal workflows that enable creators to seamlessly ideate and create, all within the Firefly application. Bringing together video, image, and vector generation in a single app provides creatives with the ability to generate an image and turn it into video, quickly translate audio into several new languages, and write a text prompt to create a video clip with the desired style and camera angle, all within Firefly.

And, Scene to Image (beta) provides the ability to create professional-quality images from 3D sketches and reference shapes.Using a lightweight 3D sketching tool, creative professionals can transform artwork into high-resolution images, build structure references directly within Text to Image, and create precise visual guides using intuitive 3D tools. And, production-ready assets can be seamlessly rendered from 3D shapes.

Adobe is offering two new Firefly plans—Firefly Standard and Firefly Pro. Both provide customers with unlimited access to Firefly imaging and vector features as well as tiered capacity for new video and audio features. Firefly Standard plans enable access to 2,000 video/audio credits per month, up to 20 five-second 1080p video generations, starting at $9.99. Firefly Pro plans enable access to 7,000 video/audio credits per month, up to 70 five-second 1080p video generations, starting at $29.99. There’s also a new Firefly Premium plan designed for professionals generating video content on a regular basis that Adobe says will be coming soon.

LIKE WHAT YOU’RE READING? INTRODUCE US TO YOUR FRIENDS AND COLLEAGUES.