With Brain.ai, generative AI is the OS

The Humane Ai Pin and Rabbit handheld have captured a great little bit of press interest for his or her individual approaches to integrating generative AI with hardware. Humane, specifically, is presenting its wearable as a take a look at life beyond the smartphone. That naturally prompts the query: What, precisely, is incorrect with the smartphone? While it’s true that the shape factor has plateaued, these devices are still out on this planet, in billions of hands.

Earlier this week, I met with Jerry Yue amid the cacophonous din of Deutsch Telekom’s Mobile World Congress booth. After a product demo and a sit-down conversation, I admit that I’m impressed with the Brain.ai (alternately often known as Brain Technologies) founder and CEO’s vision for the longer term of smartphones. I won’t go to date as saying I’m fully convinced until I’ve had a chance to spend more time with the product, nevertheless it absolutely paints a compelling picture of how generative AI is perhaps foundational to the subsequent generation of devices.

The entire “way forward for smartphones” bit could also be hyperbolic, but on the very least, I think a few of the biggest names within the biz are currently studying the way in which first-party generative AI effectively forms the backbone of the product’s operating system. But while phone firms might even see the longer term, the interface may prove foggier for consumers. The implementation turns the present smartphone operating system paradigm on its head, requiring a demo to totally comprehend the way it’s different and why it’s useful. While I admit I wasn’t completely sold by the pitch, watching it in motion brings its efficacy into sharp focus.

The OS isn’t wholly disconnected from Google’s open operating system, but only within the sense that it’s built atop the Android kernel. As we’ve seen from the Trump-era development of Huawei’s HarmonyOS, it’s entirely possible to create something distinct from Android using that as a base. Here, generative AI is greater than just integrated into the system, it’s the muse to the way in which you interact with the device, the way it responds and the interface it constructs.

The notion of an “AI phone” isn’t an altogether recent one. The truth is, it’s a phrase you’re going to listen to loads in the approaching years. I guarantee you’ll be sick of it by December. Elements of AI/ML have been integrated into devices in some form for several years now. Amongst other things, the technology is foundational to computational photography — that’s the processing of the info collected by the camera sensor that happens on the chip.

Earlier this month, nevertheless, Samsung became one among the primary large firms to actually lean into the notion of an “AI phone.” The excellence here is the arrival of generative AI — the technology behind programs like Google Gemini and ChatGPT. Once more, much of the combination happens on the imaging side, nevertheless it’s starting to filter into other elements, as well.

Image Credits: Brian Heater

Given how big an investment Google has made in Gemini, it stands to reason that this trend will only ramp up in the approaching years. Apple, too, can be entering the category at a while later this 12 months. I wouldn’t classify generative AI as a whole gamechanger on these devices just yet, nevertheless it’s clear that those firms that don’t embrace it now are going to get left behind in the approaching years.

Brain.ai’s use of the technology goes much deeper than other current implementations. From a hardware perspective, nevertheless, it’s an ordinary smartphone. The truth is, the Deutsch Telecom deal that found Yue exhibiting within the magenta-laden booth means the operating system will initially see the sunshine of day via the device often known as the T-Mobile REVVL here within the States (often known as the “T Phone” in international markets just like the EU). The precise model, release date and nature of the deal can be revealed “soon,” based on Yue.

The reality, nevertheless, is that the Brain interface is designed to be hardware-agnostic, adapting to the shape factor it’s been run on. That’s to not say that hardware isn’t necessary, after all. At its heart, the T-Mobile REVVL Plus, for instance, is a budget phone, priced at around $200. It’s not a flagship by any stretch, nevertheless it gives you decent bang on your buck, including a Snapdragon 625 processor and dual rear camera at 13- and 15-megapixels, respectively. Although 2GB isn’t much RAM, Yue insists that the Brain.ai’s operating system can do more with less. Also, again, we don’t know what specific specs the device can have at launch.

The interface begins with a static screen. From there, you query things off with either a voice or text prompt. In a single example, Yue asks the system to “recommend a present for my grandma, who can’t get away from bed.” From there, Brain goes to work pulling up not the response to the query, but an interface specific to it — on this case, it’s aggregated e-commerce results. The resulting page is barebones from a design perspective — black text on a white background. Sentences alternate with boxes showcasing results (on this case, blankets and Kindles).

The query sits at the highest. This, like much of the interface, is interactive. On this case, you’ll be able to tap in to change the search. Tapping on a picture, meanwhile, will add it to a shopping cart for the third-party e-commerce site, and you’ll be able to try from there. I should note that each one of the leads to the demo were pulled directly from Amazon. Yue says the system will pull in some 7,000 retail sites at launch, and you’ll be able to prioritize results by things like retailers and business size (in the event you’d prefer to support smaller businesses).

Image Credits: Brian Heater

Shopping is the primary example Yue shows me, and most of the fundamentals apply across the board. Actually there’s consistency in design across features. That’s due largely to the proven fact that the device is definitely devoid of third-party apps. This represents an enormous shift from the present smartphone landscape for the past 15-plus years.

“From a privacy and security perspective, we wish to present a brand new level of control that individuals don’t have without delay,” Yue. “The pc’s understanding of you, now it’s aggregated into different apps. These AI models are black boxes — advice machines that exploit our attention. We imagine in explainable AI. We can be explaining to you, each step of the way in which, why we’re making a advice. You’ve more people owning the AI and never big tech black boxes.”

Adaptability is one other big selling point. The model improves recommendations and gets more customized for the user the more queries are run and tweaked. In fact, third parties were the first reason app stores revolutionized the industry. Suddenly you’ve gone from a single company creating your entire phone’s experiences to a system that harnesses the smarts and creativity of countless developers. Brain’s experience can be a mix of what its 100-person team can produce and what the AI model can dream up. Because the model improves, so, too, will its functionality. Brain.ai is counting on its own model for the first interface, but will pull from third parties like OpenAI and Google when it determines they’re higher equipped to reply a selected query.

Image Credits: Brian Heater

There are limitations to what one can discover in a demo like this, so, as with many other elements, I’m going to must wait until I actually have a shipping product in my hand to actually evaluate the experience. I’m especially eager about the way it handles certain applications, like imaging. It’s value noting that the REVVL line doesn’t sport great cameras, so unless there’s an enormous upgrade, this won’t be the device for individuals who prioritize photos/videos.

The camera can even play a vital role in search. One example we discussed is taking a photograph of a menu abroad. Not only will it translate (à la Google Lens), it would also offer food recommendations based in your tastes. Yue also briefly demonstrated the system’s image generation with a straightforward request befitting our surroundings: make magenta sneakers. It did so quickly, with the one real bottleneck being convention center connection speeds (ironic, given the settings).

Connectivity is vitally import here. The AI processing is being done off-device. I discussed the potential for adding some on-device processing, but Yue couldn’t confirm what it would appear like at launch. Nor did I get a completely clear answer for the offline experience. I think an enormous a part of the explanation Deutsch Telekom is so eager about the product is that it’s one which couldn’t exist in the identical way without 5G. It recalls Mozilla’s ill-fated Firefox OS and the earliest days of Chrome OS, or some other variety of examples of a product that loses significant functionality when offline.

Image Credits: Brian Heater

Yue founded Brain in 2015, and remained its sole worker until hiring a CTO the next 12 months (Yue stays the only founder). Born in China, he first connected to technology through a love of robotics and participation within the RoboCup robotic soccer tournament. At 18, he founded the Chinese social app, Friendoc. Two years later, he co-founded Benlai.com, which is now one among the country’s largest food delivery apps. Yue has since returned to the Bay Area to run Brain.ai full time. Up to now, the corporate has raised $80 million.

After nearly a decade, the Brain interface is nearly able to launch — and it arrives at the proper moment. The zeitgeist may be very much focused on the style of generative AI that powers the experience, from standalone devices like Rabbit and the Humane Ai Pin to tech giants like Samsung pitching their very own “AI phones.”

Read more about MWC 2024 on TechCrunch