Brilliant Labs just announced the launch of Frame, what the company calls the world’s first glasses with a multimodal AI assistant.
If your definition of smart glasses is based on layering visual elements in your environment and adding floating text as you walk around, then Frame, not dozens of screen mirror glasses, is what you’ve been waiting for .
Frame, like Humane AI Pin and Rabbit R1, allows you to navigate and interact with the physical world through multi-modal and generative AI agents.
From GPT-4V to Stable Diffusion via Perplexity.ai
You can ask the “Noa” assistant questions about what’s in front of you, how many calories you’re about to consume or what’s written on that road sign when you’re abroad, and it will find the most appropriate AI model to respond to you.
And this ranges from GPT-4V for visual queries to Stable Diffusion for image generation, including Perplexity.ai for search.
Quick responses
The integration of Perplexity represents arguably Frame’s most notable AI partnership, with its Google-rivaling search capabilities and ability to generate fast, reliable results.
“On a more technical level, we’ve tried a lot of things, but no service has matched its speed. Speed is important when you’re in the moment and you only have seconds to know something. thing before moving on to the next thing,” Bobak Tavangar, CEO of Brilliant Labs, tells me.
The shape of the Frame is inspired by the retro glasses, “off-beat” style, as Bobak calls them, worn by Steve Jobs, John Lennon and Gandhi.
“This technology is so innovative that we tried to refer to our pop culture”
“This technology is so innovative that we tried to refer to something that seems familiar but, at the same time, has a lot of links with our pop culture. The lenses hide a projector capable of broadcasting text and images on a diagonal of about 20 degrees of field of view. This is more than enough to display query responses and the field of coverage is similar to the dimensions of an iPad Pro held at arm’s length, I’m told .
See below for a first look at the Frame glasses.
No storage of searches
It’s hard not to make comparisons between Frame glasses and Meta/Ray-Ban smart glasses; both wearable products aim to place an artificial intelligence assistant on your face, available at any time.
But there’s one thing Frame glasses don’t do. They do not capture or store images. There’s only one front-facing sensor on the Frame, and as soon as it captures what’s in front of you to answer visual questions, like “What would you recommend on this menu for vegetarians?” Data is deleted shortly after.
Wearable AI is not meant to replace your smartphone
However, like the Ray-Ban Meta, the Frame glasses are powered by your smartphone and work on the cellular or Wi-Fi network they’re connected to, meaning wearable AI isn’t meant to replace your smartphone.
Another consequence: glasses will only be a fashion accessory and nothing more when you are in a white area.
A call to hackers
If there is one conviction that Bobak wishes to share, it is the development of an open source and hackable device (in the good sense of the word).
“It’s critical that developers, hackers, artists, and mad scientists delve into this technology and truly understand its implications, for all of us, collectively,” he tells me.
The Frame is available for pre-order today for $349 (and it ships to Europe), with deliveries beginning in April. Brilliant Labs has also partnered with AddOptics to provide “precision bonded” prescription lenses to those who need them.
Source: “ZDNet.com”