Meta AI gets a bunch of free upgrades: Voice, vision and auto-dubbing

From natural language processing to live translation, Zuckerberg's chatbot is getting smarter.
By
Chris Taylor
 on 
Mark Zuckerberg in front of a screen that says Meta AI translation
Credit: Meta

In the race to make truly useful AI for a mass audience, Meta just jumped forward a few key steps — including AI's ability to "see" objects and provide live, lip-synched translations.

At the Meta Connect developers' conference, CEO Mark Zuckerberg unveiled the latest version of Llama. That's the open-source Large Language Model (LLM) powering the AI chatbot in the company's main services: Facebook, WhatsApp, Messenger, and Instagram.

Given that reach, Zuckerberg described Meta AI as "the most-used AI assistant in the world, probably," with about 500 million active users. The service won't be available in the European Union yet, given that Meta hasn't joined the EU's AI pact, but Zuckerberg said he remains "eternally optimistic that we can figure that out."

He's also optimistic that the open-source Llama — a contrast to Google's Gemini and OpenAI's GPT, both proprietary closed systems — will become the industry standard. "Open source is the most cost-effective and the most customizable," Zuckerberg said. Llama is "sort of the Linux of AI."

Mashable Light Speed
Want more out-of-this world tech, space and science stories?
Sign up for Mashable's weekly Light Speed newsletter.
By clicking Sign Me Up, you confirm you are 16+ and agree to our Terms of Use and Privacy Policy.
Thanks for signing up!

Meta AI edits photos by text

But what can you do with it? "It can understand images as well as text," Zuckerberg added — showing how a photo could be manipulated simply by asking the Llama chatbot to make edits. "My family now spends a lot of time taking photos and making them more ridiculous."

Voice chat is now rolling out to all versions of Meta AI, including voices from celebrities such as Judi Dench, John Cena and Awkafina. Another user-friendly update: When using Meta AI's voice assistant with its glasses, you no longer have to use the words "hey Meta" or "look and tell me."

Zuckerberg and his executives also demonstrated a number of use cases. For example, a user can set up Meta AI to provide pre-recorded responses to frequently asked questions over video. You can use it to remember where you parked. Or you can ask it to suggest items in your room that might help to accessorize a dress.

The most notable, and possibly most useful feature: live translation. Currently available in Spanish, French, Italian and English, the AI will automatically repeat what the other person said in your chosen language. Zuckerberg, who admitted that he doesn't really know Spanish, demonstrated this feature by having an awkward conversation live on stage with UFC fighter Brandon Moreno.

Slightly more impressive was the live translation option on Reels, and other Meta videos. The AI will synchronize the speakers' lips so they look like they're actually speaking the language you're hearing. Nothing creepy about that at all.

Chris Taylor
Chris Taylor

Chris is a veteran tech, entertainment and culture journalist, author of 'How Star Wars Conquered the Universe,' and co-host of the Doctor Who podcast 'Pull to Open.' Hailing from the U.K., Chris got his start as a sub editor on national newspapers. He moved to the U.S. in 1996, and became senior news writer for Time.com a year later. In 2000, he was named San Francisco bureau chief for Time magazine. He has served as senior editor for Business 2.0, and West Coast editor for Fortune Small Business and Fast Company. Chris is a graduate of Merton College, Oxford and the Columbia University Graduate School of Journalism. He is also a long-time volunteer at 826 Valencia, the nationwide after-school program co-founded by author Dave Eggers. His book on the history of Star Wars is an international bestseller and has been translated into 11 languages.


Recommended For You
Meta plans to launch standalone Meta AI app. OpenAI's Sam Altman fires back.
Meta CEO Mark Zuckerberg at Donald Trump's inauguration making a frowning face

Best Buy has knocked $30 off the Meta Quest 3S VR headset in its Spring Sale
meta quest 3s vr headset against a pink and yellow patterned background

Immerse yourself in VR with $30 off this Meta Quest 3S bundle
Meta Quest 3S headset on red, blue, and orange abstract background

Apple plans cheaper Vision Pro as tariffs threaten costs
Apple Vision Pro seen inside an Apple Store in Hong Kong


Trending on Mashable
NYT Connections hints today: Clues, answers for April 27, 2025
Connections game on a smartphone

NYT Connections hints today: Clues, answers for April 26, 2025
Connections game on a smartphone

Wordle today: Answer, hints for April 27, 2025
Wordle game on a smartphone

The new M4 MacBook Air is down to its lowest-ever price on Amazon
Apple MacBook Air on gradient background

NYT Strands hints, answers for April 27
A game being played on a smartphone.
The biggest stories of the day delivered to your inbox.
These newsletters may contain advertising, deals, or affiliate links. By clicking Subscribe, you confirm you are 16+ and agree to our Terms of Use and Privacy Policy.
Thanks for signing up. See you at your inbox!