Before IO, Google has announced a number of major changes to Android Auto and the in-car entertainment system that powers many modern cars. Here’s what it’s like to use.
Although it’s often quietly updated, Android Auto has become a very basic component in Google’s arsenal over the past few years. Last year we saw what a Gemini-powered experience would look like, but this year the company is finally moving forward with a more unified experience that adds some things we’ve been complaining about for years.
Subscribe to 9to5Google on YouTube for more video content.
Identifying the same complaints for years
The good news is that Google listened. Android Auto in particular needed some of the changes announced at the Android Show so badly that they never came.
Finally, adding YouTube feels like one of the easiest wins for in-car entertainment. The fenders are responsive, and the ability to effectively listen to a YouTube video while driving is a huge boon for long-form content lovers. Podcast fans will be quietly delighted, I’m sure. However, it feels long overdue when it’s been possible with Google Built-in (formerly Android Automotive) for a while.
Watching a bit of YouTube while parked is something I’m looking forward to very soon.
Adding more detail to Google Maps with the Immersive View experience looks great at face value. I can definitely see it helping in places you’re not familiar with or haven’t visited before. 3D elements help you position yourself instantly without being overwhelmed. Just a few visual cues would be enough, but it’s a great take on the sometimes abstract shapes currently in use. I see myself losing less in the future.
I’m curious to see how this will work on each car. Not all in-car displays are giant, nearly borderless panels. If your car has a small head unit that doesn’t have the visual clarity to see the finer details, extra detail can be lost.
This criticism aside, Immersive View appears to have accessible controls close to the driver. I like this change because it makes micro-adjustments quick, simple and doesn’t take the focus away from driving your car.
However, a personal gripe is that every demo or hands-on session I’ve had with Android Auto or Google Built has been in a car with a landscape head unit. With many car manufacturers favoring portrait-oriented displays, we should see more variation where possible – if you own a Volvo, you know what I’m complaining about here.
Touching on Google Built’s differences for a second, connecting directly to the car’s cameras and using them for more accurate navigation is something that’s felt outside of Waymo. We were told that the logs are just a 30 second snapshot, so no files are stored locally.
The demo requested information about a sign visible from the driver’s seat. Although Gemini can be a personal guide in this situation, the security implications seem more reliable. I could see myself using a feature like this to ask about traffic rules, route closures, and even clarification on toll road conditions. Real-time visual search without the risks associated with using your phone is still where this kind of integration is sold. Gemini can also refer to car controls, settings, and even various dashboard data points.
I am worried about the increased power consumption and processing requirements. As impressive as some of the demos are, losing your data connection while accessing any cloud process kills the experience instantly. I can confirm that. At least I don’t have to bother my passengers when things go wrong.
The hows and whys of in-car UIs
One of the few design changes I’m not sure about is the use of widgets on the dashboard. Sure, it’s feature parity with your phone, but is it really useful while driving? Why should I see the Google Photos widget in my car? Google Home controls make more sense as music player controls, but are they still necessary?
Google is going deep on customizable widgets, and despite my objections, it’s probably more useful for drivers. Unfortunately, we only saw one other weather/condition widget from this demo. I guess that’s the extent of what most people do with their cars during the test phase.
However, it got me thinking, and my initial takeaway is that I prefer a customizable main home screen view with custom widgets integrated. To me, this is probably the best way for Google to add this feature to cars instead of just ignoring them until you call them.
I think the current standard weather record is a little information light. If I’d like to get more detailed information about the upcoming weather in my area, or take it a step further and go to another destination, it would be great to have Android Auto show the weather in that new location.
Maybe some security issues limited what we were shown, but if it could be integrated a little better, there’s potential here.
I know a lot of people will love that you can customize the Android Auto in-app wallpaper, but it felt so trivial that I don’t think it was even mentioned during the demo. It’s a part of the system I’m trying to avoid in all honesty, but it will still be good for those who care.
Widget and very small wallpaper complaints on the one hand; Magic Cue feels more at home here than on my phone. In the demo we saw, the data was ready to go, but I’m curious how it will work in the real world. The less time I spend with the already large display on Volvo’s center console, the safer I feel. Magic Cue definitely feels like a sleep supplement.
Unfortunately, with phones, this rarely shows up in my daily life. Perhaps Gemini Intelligence will come to Pixel phones later this summer, providing the basis for a better experience. Google Assistant was terrible at voice dictation, and Gemini does. Magic Cue just being able to lead and having ready responses based on phone context seems like a killer feature. I wish we had more examples of this working than just asking for the date and time of an event, but I guess it’s easy to demonstrate.
The future of AI in cars
I’ve consistently come to AI integration if done right. The downside to this is that unless someone tries it first, we simply don’t know. Over the past 12 months, I’ve found myself more inclined to experiment with different Gemini traits. Some are terrible and some are really helpful.
As someone who actively avoids driving, I was thrilled to have a Gemini in my car. It needs some work, but I think it’s the best place to integrate a context-aware voice assistant. Mainly because automakers have decided that touch buttons are just overkill. I hate dealing with a touchscreen while driving. It’s distracting because it’s potentially dangerous.
Gemini in vehicles is the solution to a problem created by car manufacturers.
In my opinion, Gemini for Travel should be a larger component of Android Auto and Google Built. For example, I am about to travel several hours away. It’s rainy where I live, but it’s sunny where I go. This information is available, but Gemini reminds me that an umbrella or jacket may not be necessary, which can be helpful. At least not sunscreen, or a pre-drive checklist option would be nice.
I’m sure you go on autopilot when you’re in the car, just like me. I’ve forgotten a lot of important things because I’m so focused on the driving task, so the proactive nudges from Gemini can be a really strong trait differentiator. Couple that with my Google account, which is intimately aware of my movements, and it’s a recipe for something no in-car entertainment system could potentially offer.
Ordering food from the driver’s seat is something that feels foreign to my European mindset. I’ve never felt the need to order something on a whim. Google insists on proving that AI is ready to do this, but I don’t think I trust it throughout the ordering process. Drive-thrus literally exist for this scenario. I think I’ll stick to the rare pattern of satisfying my drive-thru food cravings.
as we see with A big addition to Gemini Live last yearwe still have a potential age to wait before all of this comes to our vehicles. I hope the demos are also more accurate than last time The introduction of the twins was a bit of a mess. It even feels like the perfect place to add a little more Gemini flavor.
FTC: We use automatic affiliate links that generate income. More.
