Meta adds AI video, live translation to Ray-Ban smart glasses

Meta Platforms (NASDAQ:META) said on Monday that it was updating the Ray-Ban Meta smart glasses with live AI video capability and real-time language translation.

Starting on Monday, the social media giant has started rolling out the v11 software update.

The company said that during a live AI session, Meta AI can see what a user is seeing continuously and converse with them more naturally. Users can get real-time, hands-free help and can ask questions without saying “Hey Meta,” reference things they discussed earlier in the session. Users can also interrupt anytime to ask follow-up questions or change topics.

Meta noted that eventually live AI will, at the right moment, give useful suggestions even before the users ask.

The company said the update would be available for members under its Early Access Program, which is open to Ray-Ban Meta glasses owners in the U.S. and Canada.

The Facebook owner had announced the features, along with other product updates, during its annual Connect conference in September.

The second feature that Meta launched was live translation, which Meta Founder and CEO Mark Zuckerberg demoed live onstage at Connect.

Through this new feature, the glasses will be able to translate speech in real time between English and either Spanish, French or Italian. When the user is talking to someone speaking one of those three languages, they will hear what they say in English through the glasses’ open-ear speakers or viewed as transcripts on their phone, and vice versa, the company added.

Meta noted that these AI features may not always get it right, and the company continues to learn what works best and improve the experience.

The Instagram parent has also added song identifying app Shazam to the smart glasses.

Users can say “Hey Meta, what is this song?” and they will get to know about the song. Shazam on Ray-Ban Meta glasses is available in the U.S. and Canada, the company noted.

In September, Ray-Ban maker EssilorLuxottica (OTCPK:ESLOF) (OTCPK:ESLOY) extended its partnership with Meta to collaborate into the next decade to develop multi-generational smart eyewear products. Last year, Ray-Ban Meta smart glasses became its first product to include an audio version of the Meta AI chatbot.