Meta AI's Latest AI Tool Can Create Realistic Videos With Sound


Mohul Ghosh

Mohul Ghosh

Oct 06, 2024


Meta, the parent company of Facebook and Instagram, has unveiled its latest artificial intelligence model called Movie Gen. This groundbreaking tool can create realistic video and audio clips based on user prompts, potentially rivaling offerings from leading media generation startups like OpenAI and ElevenLabs.

Meta AI's Latest AI Tool Can Create Realistic Videos With Sound

Capabilities and Features

Movie Gen boasts an impressive array of features:

  • Creation of realistic-seeming video and audio clips
  • Generation of background music and sound effects synced to video content
  • Ability to edit existing videos
  • Video duration up to 16 seconds
  • Audio clips up to 45 seconds long

Impressive Demonstrations

Meta has showcased Movie Gen’s capabilities through various samples:

  • Videos of animals swimming and surfing
  • Clips using people’s real photos to depict them performing actions like painting
  • Editing existing videos to add elements like pompoms or change environmental conditions

Competitive Edge

According to Meta, blind tests indicate that Movie Gen performs favorably compared to offerings from startups such as Runway, OpenAI, ElevenLabs, and Kling.

Industry Impact and Concerns

The announcement of Movie Gen comes at a time when Hollywood is grappling with the potential of generative AI in video technology. While some technologists are eager to use such tools to enhance and expedite filmmaking, others express concerns about copyright issues and the use of AI-generated content without permission.

Deepfake Concerns and Election Integrity

Lawmakers have raised concerns about the use of AI-generated fakes, or deepfakes, in elections worldwide, including in the US, Pakistan, India, and Indonesia.

Meta’s Cautious Approach

Meta has stated that it’s unlikely to release Movie Gen for open use by developers, unlike its Llama series of large-language models. The company is taking a cautious approach, assessing risks individually for each model.

Future Plans

Meta plans to work directly with the entertainment community and content creators on Movie Gen applications. The company aims to incorporate the technology into its own products sometime next year.

Conclusion

As AI-generated content continues to evolve, tools like Movie Gen represent both exciting possibilities and potential challenges for creators, lawmakers, and the public. The development of such technologies will likely shape the future of media creation and consumption in profound ways.


Mohul Ghosh
Mohul Ghosh
  • 1668 Posts

Subscribe Now!

Get latest news and views related to startups, tech and business

You Might Also Like

Technology
Sep. 8, 2022

Samsung Launches The Wall All-In-One and Flip Pro: Is This The Future Of Display Technology?

Samsung has launched The Wall All-In-One – the modular MicroLED it says is revolutionizing the future of display and the Flip Pro, which is an interactive display. Both were unveiled at the InfoComm India 2022 which is India’s Professional AudioVisual (Pro AV) and Systems Integration Technology Exhibition. This took place in Mumbai from September 5-7. […]

Technology
Jul. 28, 2022

Google Street View Launches In India Across These 10 Indians Cities! Plans To Expand To 700,000 Kms, 50 Cities In 2 Years

Google’s Street View is finally available in India a decade after it was prevented from capturing data for its Street View services. Second coming Street view offers a 360-degree interactive panorama feature initially for 10 Indian cities with data from local partners Tech Mahindra and Mumbai-based Genesis International. Its entry into India is facilitated by […]

Technology
Jul. 10, 2022

This Electricity-Free Cooler Developed By IIT Researchers Can Replace Air Conditioners! How It Work?

Indian Institute of Technology Guwahati researchers have built a ‘Radiative Cooler’ which does not require electricity to operate. This is an affordable and efficient ‘passive’ radiative cooling system that can serve as an alternative to ACs. The coating material is an electricity-free cooling system that can be applied in the rooftops and functions during both […]

Technology
Jun. 27, 2022

This New Battery Will Enable Electric Cars To Run 1000 Kms In Single Charge! Will This Transform Electric Mobility?

Chinese company Contemporary Amperex Technology Co Ltd (CATL) has developed a battery that gives EVs a driving range of over 1,000 km or 621 miles on a single charge. About the company The company is China’s leading automotive lithium-ion battery maker. Tesla, Volkswagen, BMW, and Nio are among the companies for which CATL supplies batteries. […]

Recent Posts

Related Videos

   

Subscribe Now!

Get latest news and views related to startups, tech and business

who's online