Automotive XR (VR/AR/MR) Industry Report, 2024

Automotive XR (Extended Reality) is an innovative technology that integrates VR (Virtual Reality), AR (Augmented Reality) and MR (Mixed Reality) technologies into vehicle systems. It can bring drivers and passengers richer and more intuitive information interaction experiences. It is an important embodiment of differentiation between intelligent cockpits of the future.

XR is integrated with IVI and smartphones to create multi-terminal integration experience.

In March 2023, Rokid and Li Auto announced Rokid Max, their cooperative AR glasses which support L series models. Li Auto’s IVI APP can be projected onto VR glasses for viewing, gaming, online office, etc. In addition, it allows handheld game consoles to be projected onto the center console screen and then to the glasses, so that users can control IVI and play games through gesture interaction.

In November 2023, Xingji Meizu released MYVU intelligent AR glasses based on Flyme AR OS. The integration with Meizu smartphones via Flyme Link (a smartphone-IVI integration solution) not only allows for circulation of phone calls, music, videos, navigation, important application notifications and more to the AR glasses, but also makes it share computing power and network with the smartphone, thereby reducing the power consumption of the glasses and enabling a long cruising range. In the future, MYVU AR glasses will be integrated with cars and smartphones to create multi-terminal integration experience through seamless flow of applications and data.

Therefore, at the “Meizu Flyme Ecosystem Launch”, Xingji Meizu upgraded the operating system Flyme to FlymeOS. Composed of Flyme 10 (smartphone OS), Flyme Auto (Meizu IVI system), and Flyme AR (AR glasses OS), FlymeOS covers three major areas: smartphone, XR and intelligent vehicle. FlymeOS features 'Internet of Everything, Boundless and Infinite', and becomes the base for connecting all terminals.

AI+AR to enhance voice interaction experience

At CES 2024, Rayneo unveiled Rayneo X2 Lite, a stereo full-color MicroLED optical waveguide AR glasses that introduce Rayneo AI (released in December 2023), a foundation model voice assistant. With Rayneo AI, Rayneo X2 Lite enables multiple capabilities including multi-round natural language conversations, trip planning, easy encyclopedic Q&A and brainstorming, and supports AI-assisted translation, 3D spatial navigation, and first-person perspective video creation. In March 2024, Rayneo Technology closed a new funding round and raised RMB100 million which will be used to develop and spawn next-generation AR glasses and expedite the construction of the AI+AR glasses ecosystem.

Xingji Meizu is also laying out AI+AR. In November 2023, Xingji Meizu released two MYVU series AR glasses, connected to the Flyme AI foundation model. Based on AI, AI assistant can be awakened in real time to provide travel tips, study plans, business analysis, and other daily life and work collaboration. At the same time, AR glasses can realize scenario functions such as teleprompter, real-time translation (in Chinese and English), and cycling navigation.

Automotive XR scenarios expand from entertainment to driving assistance and vehicle control.

Currently, XR mainly caters to users’ needs for cockpit entertainment, for example, viewing and gaming. Moreover suppliers are also exploring other application scenarios such as driving assistance and vehicle control.

At CES 2024, BMW and XREAL together demonstrated XREAL Air 2 AR glasses, a device which integrates vehicle information, infotainment, vehicle electronic and electrical information, BMW cloud information and other data. Wearing the glasses, users can see how navigation instructions, hazard warnings, entertainment content, information on charging stations and supporting visualizations in parking situations are embedded perfectly into the real-world environment by the “XREAL Air 2”.

At CES 2023, Audi presented activesphere, a concept car which is equipped with four AR headsets. Wearing Magic Leap 2 AR glasses, the driver can view trip data, road conditions, location and navigation information in real time the MR visual interface with a 70° FOV; the passengers can control air conditioning temperature, airflow, and audio system next to their seats via gestures.

Furthermore, AR technology can be available beyond the cockpit. In off-road scenarios, the topographic map can be projected into the surroundings; in commuting, traffic information, routes and safety warnings can be projected in layers into the driver's view.