Meta’s Multimodal AI Unleashed on Ray-Ban Meta Glasses, Bringing Vision More AI Interactions

Meta enabled multimodal AI assistant on the Ray-Ban Meta glasses, allowing you to talk to and receive visual feedback from the wearable device like some kind of cyberpunk daydream.

The newly launched “Meta AI with Vision” (or MMAI for short) integrates the company’s latest large language model (based on the open-source Meta Llama 3) with camera capabilities, enabling all sorts of visual and audio AI assistance through the smart glasses. It’s a game-changer for wearable tech that makes artificial intelligence feel more interactive and intuitive.

Ray-Ban Meta glasses

So what can this multimodal Meta AI actually do on the Ray-Ban Stories? A whole lot, as it turns out. You can snap a pic of a product or point your glasses at a book cover, then quiz the AI for more info. Need a page of dense text summarized or translated? Just ask. The AI can also analyze videos and images for potential issues like blurriness or obstructed views.

Of course, the Ray-Ban Stories smart glasses can still handle basic smartglass tricks too – Meta’s update adds improved video calling through Messenger and WhatsApp by tapping the built-in camera, plus integration with Apple Music for audio playback.

But let’s be real, the flagship addition here is MMAI and its multimodal capabilities. Being able to seamlessly combine speech, vision, and language models opens up wearable AI to more natural back-and-forth conversation compared to traditional text input. It’s an important step toward making this nascent product category feel practical rather than gimmicky.

Ray-Ban Stories owners aren’t the only ones scoring new options either – Meta says it’s expanding the line with fresh frame styles including a new low bridge fit and redesigned “Skyler” model with a more feminine flair. The company seems intent on making these smart sunglasses a mainstream consumer product.

Will MMAI be the key that unlocks real-world adoption of smart glasses? I’m still skeptical that people will ditch their phones entirely for AI-powered eyewear. But scaling up the capabilities sure makes these high-tech frames feel a bit more compelling as a supplemental device alongside your typical handset. We’ll have to see if MMAI lives up to the hype when it hits the streets.

Latest

Meet the Cortex-X925, A725, and A520 – ARM 2024 Latest Flagship and Efficiency Cores

Every year, Arm's CPU core announcements set the stage...

Shooting with the vivo X100 Ultra: A Photographer’s Wildest Dream?

I'll be honest, when vivo first unveiled the X100...

Xiaomi Launches Affordable Gigabit and 10-Gigabit Switches for Sweet Network Speeds

Just when you thought Xiaomi was done launching every...

AMD’s EPYC 4004 Chips Are a Dagger Aimed at Intel’s Server Heart

Intel's server dominance is facing a serious challenge. AMD's...

Newsletter

Don't miss

Meet the Cortex-X925, A725, and A520 – ARM 2024 Latest Flagship and Efficiency Cores

Every year, Arm's CPU core announcements set the stage...

Shooting with the vivo X100 Ultra: A Photographer’s Wildest Dream?

I'll be honest, when vivo first unveiled the X100...

Xiaomi Launches Affordable Gigabit and 10-Gigabit Switches for Sweet Network Speeds

Just when you thought Xiaomi was done launching every...

AMD’s EPYC 4004 Chips Are a Dagger Aimed at Intel’s Server Heart

Intel's server dominance is facing a serious challenge. AMD's...

Microsoft Copilot+PCs Fires a Blistering AI Broadside at Apple Dominance

Satya Nadella has a bold message for Apple: the...
ScottCharles
ScottCharles
Scott Charles is a professional writer and contributor for Gizmoweek. An avid collector of all things Apple watch, cool gadgets, phones.

Meet the Cortex-X925, A725, and A520 – ARM 2024 Latest Flagship and Efficiency Cores

Every year, Arm's CPU core announcements set the stage for the next generation of smartphone and computing performance. And with the newly unveiled 2024...

Shooting with the vivo X100 Ultra: A Photographer’s Wildest Dream?

I'll be honest, when vivo first unveiled the X100 Ultra and its ridiculously specced camera array headlined by an almost suspiciously capable ultra-telephoto lens,...

Xiaomi Launches Affordable Gigabit and 10-Gigabit Switches for Sweet Network Speeds

Just when you thought Xiaomi was done launching every gadget under the sun, the company surprises us with a couple of new networking switches....