Meta just announced a new generative AI model to help users turn simple text into images, videos, and audio clips.
Meta Movie Gen allows users to input text and automatically generate new videos, personalize videos, do video editing, and generate audio, all of which is trained on a « combination of licensed and publicly available datasets. »
If that seems a lot like OpenAI’s Sora, that’s because it is quite similar. But Movie Gen builds upon Meta’s previous work with AI — you might remember, or even use, Llama Image, for instance. But Movie Gen is the third wave of its generative AI work, which Meta says combines all of its previous modalities. « Similar to previous generations, » Meta wrote in a blog post, « we anticipate these models enabling various new products that could accelerate creativity. »
Meta notes that « generative AI isn’t a replacement for the work of artists and animators, » but says the company « believe[s] in the power of this technology to help people express themselves in new ways and to provide opportunities to people who might not otherwise have them. »
« Our hope is that perhaps one day in the future, everyone will have the opportunity to bring their artistic visions to life and create high-definition videos and audio using Movie Gen, » the blog post reads.
The entire post about this new technology is focused on the future, noting that you can’t actually use Movie Gen yet.
Chris Cox, Meta’s chief product officer, wrote on Threads that the company isn’t « ready to release this as a product anytime soon — it’s still expensive and generation time is too long — but we wanted to share where we are since the results are getting quite impressive. »
The company said it was looking to tweak the model in the lead-up to it hitting the public.
« As we continue to improve our models and move toward a potential future release, we’ll work closely with filmmakers and creators to integrate their feedback, » Meta wrote in the blog post. « By taking a collaborative approach, we want to ensure we’re creating tools that help people enhance their inherent creativity in new ways they may have never dreamed would be possible. Imagine animating a ‘day in the life’ video to share on Reels and editing it using text prompts, or creating a customized animated birthday greeting for a friend and sending it to them on WhatsApp. With creativity and self-expression taking charge, the possibilities are infinite. »
