Meta enriches its connected Ray-Bans with an AI assistant, but for what purpose?

Meta has announced the introduction of an artificial intelligence-powered assistant to its augmented reality glasses in collaboration with Ray-Ban. This initiative will increase the capabilities of the device tenfold, the company promises.

Launched in October 2023, the Ray-Ban Stories 2 are selling like hotcakes, assures Meta in a blog post. Allowing photos and videos to be captured using simple voice commands, this model marks the company’s entry into the highly coveted augmented reality market. It already has a well-defined roadmap and even plans to present its own model this year. But in the meantime, it is the product made in collaboration with Ray-Ban which is in the spotlight.

Meta AI arrives on Ray-Ban Stories 2

Meta has announced several new features relating to its glasses, including the arrival of new frames and colors in order to offer more choice to its customers. Also, it will now be possible for their wearer to share their view during a video call on WhatsApp or Messenger. As a reminder, the glasses are equipped with a camera and five microphones, the audio quality of which has been acclaimed by their users.

However, the most important novelty concerns, unsurprisingly, artificial intelligence. In the United States and Canada to begin with, all Ray-Ban Stories 2 owners will be able to access the AI ​​assistant Meta AI with Vision for free. Powered by Llama 3, this template will soon be integrated into WhatsApp, Messenger and Instagram.

The incorporation of AI into an augmented reality gadget demonstrates the change in strategy made by the social media giant. If he primarily focused on the metaverse, he now makes AI a priority and considers that mixing the two technologies represents an ideal solution for its evolution.

“ I thought augmented reality glasses wouldn’t really be a mainstream product until we had full holographic displays. But today, it seems clear that there is also a significant market for screenless artificial intelligence glasses », Recently observed Mark Zuckerberg during a meeting with his investors, on the sidelines of the company’s quarterly results.

A real-time assistant

But then, what can these AI-assisted glasses be used for? They ” help you understand the world around you by interpreting what you see and what you ask “, explains Meta. Their built-in camera and microphones act as the eyes and voice of the AI. They can describe whatever the wearer is looking at, for example telling them the breed of a dog or the species of a plant.

Likewise, the assistant can translate panels or a menu into another language in real time. “ Whether it’s finding an Instagram caption, looking up information while sightseeing, or simply preparing meals for the week, Meta AI with Vision can help you do it hands-free », summarizes the firm. A sneak peek of Meta’s upcoming augmented reality glasses, which are sure to feature even deeper AI capabilities.

Source : Meta