Meta just gave its $299 smart glasses their biggest AI upgrade yet, and I’m beyond excited

When Meta first launched its Ray-Ban smart glasses, there was one function that I used to be excited to attempt however could not. The promise of a multimodal AI machine able to answering questions primarily based on what the person was gazing appeared like a dream wearable, however Meta would not be rolling out that performance to its $299 good glasses till “subsequent 12 months.” That idolized future could also be nearer than I anticipated.

Additionally: Meta’s $299 Ray-Ban good glasses often is the most helpful gadget I’ve examined all 12 months

Right now, the corporate is launching an early entry program that can enable Ray-Ban Meta good glasses customers to check the brand new multimodal AI options, all of which leverage the onboard digital camera and microphones to course of environmental knowledge and supply contextual info equivalent to what a person is gazing.

The way it all works is moderately easy. You begin a Meta AI immediate by saying, “Hey Meta, check out this,” adopted by the specifics. For instance, “Hey Meta, check out this plate of meals and inform me what elements have been used.” To reply the query, the glasses seize a picture of what is in entrance of you after which break down the varied topics and components with generative AI. 

The performance goes past the standard “What is that this constructing?” or “What is the climate like right this moment?” prompts, in fact, as Meta CEO, Mark Zuckerberg, demoed in an Instagram Reel. Within the video, Zuckerberg asks Meta AI, “Look and inform me what pants to put on with this shirt.” as he holds up a rainbow-striped button-down. Not solely does the voice assistant establish the attire, but it surely suggests pairing it with dark-washed denims or solid-colored trousers. (The actual query is do tech CEOs truly put on outfits past the monochromatic t-shirts and dark-colored pants.)

(Facet notice: Up till right this moment, Meta AI on the Ray-Ban glasses had a data cutoff of December 2022. In accordance with Meta CTO Andrew Bosworth, they now have entry to real-time information due to Bing.)  

Additionally: Meta rolls out its AI-powered picture generator as a devoted web site

Solely a small batch of customers will obtain the brand new replace at first, as Meta plans to gather suggestions and refine its upcoming AI options earlier than the official releases. To take part, replace the Meta View app to the most recent model, faucet on the gear icon within the backside proper of the menu bar, swipe right down to “Early Entry,” and faucet “Be part of Early Entry.” 

I am not seeing something resembling an early entry program on my Android and iOS apps, however you may wager that when the replace comes alongside, I will be fast to obtain and begin testing it — as a result of what was already probably the most helpful tech devices I examined in 2023 is about to turn out to be much more helpful.