Meta is introducing its AI video capabilities to Instagram, offering new features that allow users to modify their videos simply by using text to manipulate imagery. These features enable users to add bling, change backgrounds, and perform various modifications limited only by their imagination.
In a video announcement, Instagram head Adam Mosseri expressed his excitement about Movie Gen, an early AI research model that empowers users to change nearly any aspect of their videos through a simple text prompt. In the video, Mosseri is initially seen in his original attire and location—an ordinary-looking bedroom with a grey jacket. However, the scenery begins to randomly transform, showcasing Mosseri in places like Paris, New York, and a pool, while also changing his clothes to different outfits such as a leather jacket or a puffy sweater in the Himalayas.
Mosseri explained that users should be able to modify their outfits, the context in which they appear, or even add accessories like chains. He demonstrated seamless background switching and transformations of his appearance.
Meta previously unveiled Movie Gen a few months ago, highlighting its superior quality and adherence to prompts compared to other models. The company showcased AI-generated Instagram reels created by influencers such as Paige Piskin and the social media brand 10pm Curfew’s Girls and K5sh accounts.
In addition to generative video capabilities, Movie Gen also handles video inpainting. This function allows users to alter specific elements within a video while keeping the rest intact. This versatility enables users to perform various visual manipulations, such as changing outfits, swapping backgrounds, and even transforming individuals into puppet-like cartoon versions of themselves by manipulating the overall scene style.
This technology appears to build upon Meta’s Movie Gen AI model, which was reported on by Decrypt last year. It serves as Meta’s response to similar tools offered by competitors, including OpenAI’s recently announced Sora video generator, Runway’s inpainting feature, and open-source tools like Propainter.
For Instagram, this marks the first time Meta is directly providing users with its video AI capabilities. Movie Gen can create entirely new 16-second videos or modify existing ones, complete with synchronized sound effects and music.
The generative video scene has experienced significant advancements in recent months, following a relatively quiet year with infrequent releases. Notable developments include the release of Sora, as well as alternatives like Invideo V3, Dream Machine, Google’s Veo2, and Showrunner.
Meta has not announced a specific launch date for Movie Gen on Instagram, but Mosseri stated that it will arrive in 2024.