09.10.2024
97

Movie Gen – AI for Generating Video with Sound

Yuliia Zablotska
Author at ApiX-Drive
Reading time: ~1 min

Meta introduced a new artificial intelligence model called Movie Gen, designed to generate realistic video and audio based on user requests. The company believes that it can compete well with the development of such giants as OpenAI and ElevenLabs. In addition to video, Movie Gen is able to create background music and sound effects that harmoniously complement the visual series. For example, this AI can add the sounds of a car engine, thunder, or the sound of a waterfall according to the displayed content, as well as make sound design for already existing videos.

According to Meta, the maximum length of videos created by Movie Gen is 16 seconds, and the frame rate is 16 frames per second. The duration of the audio is longer – up to 45 seconds.

Meta representatives indicated that, unlike previous models such as Llama, access to Movie Gen for third-party developers is unlikely to be open. They assess potential risks and are primarily concerned with safety. However, the company plans to work closely with entertainment industry representatives and content creators to use this technology.

***

Do you want to achieve your goals in business, career and life faster and better? Do it with ApiX-Drive – a tool that will remove a significant part of the routine from workflows and free up additional time to achieve your goals. Test the capabilities of Apix-Drive for free – see for yourself the effectiveness of the tool.