Google Cloud announced its latest Automotive AI Agent on Monday, with the Mercedes-Benz CLA becoming the first vehicle to integrate the system later this year. The new AI Agent is designed to expand the conversational capabilities of Mercedes-Benz’s MBUX Virtual Assistant, enhancing interaction between passengers and the vehicle.
Mercedes-Benz offered a preview of its next-gen assistant during CES 2024, but at that time, the underlying large language model remained undisclosed. Unlike the current MBUX system—which recognizes roughly 24 in-car commands and relies on data from ChatGPT and Bing—this new assistant is built on Google’s Gemini large language model using Vertex AI. It is crafted to offer a more dynamic and conversational experience, moving beyond static responses.
The Google Automotive AI Agent supports multimodal and multilingual inputs, offering tailored interactions. For example, it can recommend Italian restaurants nearby, provide reviews, and even highlight popular menu items. It also boasts multi-turn dialog capabilities, enabling it to remember details from prior conversations and respond contextually.
Real-time integration with Google Maps ensures the new MBUX assistant delivers updated, accurate information about over 250 million points of interest globally, along with current traffic conditions. “At Mercedes-Benz, we aim to deliver an unparalleled digital experience for our customers,” said Ola Källenius, CEO of Mercedes-Benz Group AG. “Our collaboration with Google Cloud elevates in-car navigation by combining advanced location data with generative AI.”
Mercedes-Benz plans to implement this advanced assistant in more models over time, though no specific vehicles have been named beyond the CLA.