As automobiles are going smart, cockpit and intelligent driving require more efficient processors.
Full LCD instrument cluster with at least 3 or even 5 to 6 screens, will be an integral of a mainstream electronic cockpit solution which may be integrated with some local and cloud capabilities such as natural language processing (NLP), gesture control, fatigue detection, face recognition, AR HUD, HD map and V2X. So it can be said that cockpit has endless demand for computational resources, for instance, 50000DMIPS in 2020 and more after the year.
Autonomous driving needs processors that perform far better. According to Horizon Robotics’ summary of OEM demand, a higher level of automated driving means more orders of magnitude, namely, 2 TOPS for L2 autonomy, 24 TOPS for L3, 320 TOPS for L4 and 4,000+TOPS for L5.
Only computing power is not enough. Complexity of automotive applications should be taken into account. That’s because an automotive processor also has to consider how much power is consumed, how much computing power is used or whether it is up to the automotive and safety standards or not.
Automotive processor, also referred to as automotive computing chip, typically falls into three types: Application specific standard products (ASSP), like CPU and GPU; application specific integrated circuits (ASIC); field programmable gate arrays (FPGA). Conventional CPU and GPU have begun to find it hard to meet increasing new demand as AI computing is developing by leaps and bounds, and in terms of energy efficiency, underperform semi-custom FPGA and full-custom ASIC, both of which are booming.
By and large, FPGA and FPGA have their own merits and demerits, offering options for different areas
The huge demand from intelligent connected vehicle (ICV) for semiconductors (including processors) is an enticement for the inrush of consumer electronics processor vendors. Take example for Qualcomm, the fastest entrant whose 820E and 855E among other products have won great popularity in automotive sector. Of the top 25 OEMs worldwide, 18 have chosen the giant’s processors. Samsung, MediaTek, Huawei and even Apple follow suit to forge into the automotive semiconductor field.
Processor vendors’ fight is more than in computing power area. Tool chain is also their battleground.
One competitive edge on processor lies in more tools for users’ easier and more efficient use of processors.
"No one will buy your GPU, if you don’t have software and applications", said Greg Estes, the vice president of NVIDIA, at GTC CHINA 2018. With efforts, the inventor of the GPU has expanded its developer’s community with more than 1 million members and 600,000 GPU applications.
In 2017, NVIDIA unveiled new NVIDIA? TensorRT? 3 AI inference software that significantly boosts the performance and slashes the cost of inferencing from the cloud to edge devices, including self-driving cars and robots. With TensorRT, the user can get up to 40x faster inference performance comparing Tesla V100 to CPU. TensorRT inference with TensorFlow models running on a Volta GPU is up to 18x faster under a 7ms real-time latency requirement.
At CES 2019, NVIDIA didn’t release more efficient processors but enlarge its software tool kit. The company integrated its previous Drive Autopilot software, Drive AGX computing platform and DRIVE Works development tool into a platform, called Drive AP2X. DRIVE AutoPilot offers precise localization to the world’s HD maps for vehicle positioning on the road and creates a self-driving route. Drive Works provides developers with reference applications, tools and a complete module library.
Deephi Tech’s deep neural network development kit (DNNDK) is an equivalent of NVIDIA TensorRT. DNNDK offers a complete process from neural network inference to model compression, heterogeneous programming, compilation and operation deployment, which is a solution for deep learning algorithm engineers and software development engineers to accelerate AI computing load.
In July 2018, Xilinx acquired Deephi Tech in a USD300 million deal, helping the two-year-old firm promote FPGA.
Starting from EyeQ?5, Mobileye will support an automotive-grade standard operating system and provide a complete software development kit (SDK) to allow customers to differentiate their solutions by deploying their algorithms on EyeQ?5. The SDK may also be used for prototyping and deployment of Neural Networks, and for access to Mobileye pre-trained network layers.
In July 2018, Intel released OpenVINOTM Toolkit for accelerating development of high performance computer vision and deep learning vision application.
There are more than 70 AI start-ups globally, but few of them remain powerful enough to develop tool chain. And conforming to the active safety standards poses a bigger challenge to development of automotive computing chip tool chain.
In China, Horizon Robotics, an autonomous driving chip bellwether, provides full-stack perception software and full-stack tool chain. The way of coordinating algorithms, computing architecture and tool chain enables the firm’s BPU with a performance 30 times higher than GPU.
Automakers are deficient in deep learning capability of their processors as well, and they are going all out to improve weaknesses.
In early 2019, NXP joined forces with Kalray to co-develop an autonomous driving computing platform, with the aim of helping NXP gain muscle in deep learning. The partnership will combine NXP’s scalable portfolio of functional safety products for ADAS and Central Compute with Kalray’s high-performance intelligent MPPA (Massively Parallel Processor Array) processors. MPPA with an optimized tool and a library, enables the best performance of deep learning or vision algorithms.
Renesas plans to roll out next-generation R-CAR SoC for deep learning, which is expected to be mounted on L4 autonomous cars in 2020. The new SoC sample will be unveiled in 2019, and can compute 5 trillion times per second with power consumption of a mere 1W. Also, Renesas upgrades its processor tool chain and ecosystem via its Autonomy Platform."
*The Chinese Version of this Report is Available on Request.
1. Overview of Automotive Processors (Computing Chip)
1.1 Automotive Semiconductor Market
1.1.1 Automotive Semiconductor Market Share
1.1.2 Demand of L2-L4 Autonomous Vehicle for Automotive Semiconductors
1.1.3 Demand of Autonomous Vehicle for Different Sensors (L2-L5)
1.2 Classification of Automotive Semiconductors
1.3 Classification of Automotive Computing Chips
1.7 Comparison between Typical Autonomous Driving Computing Chips
1.8 Different Processors Used in Different Links of Autonomous Driving
1.9 Typical Automotive Processor Companies
2. Cockpit Processors and Trends
2.1 Cockpit Electronic System
2.2 Overview of Cockpit Processors
2.3 Renesas Cockpit Processor
2.4 MBUX and Processors
2.5 Intel Cockpit Processor
2.6 Qualcomm Cockpit Processor
2.7 Nvidia Cockpit Processor
3. ADAS/AD Processors and Trends
3.1 ADAS and Autonomous Driving Processors
3.2 3D Bounding Box
3.3 Stereo Camera and DSP
3.4 NVIDIA and Competitors
3.5 ARM A76AE
3.6 MIPS I6500-F
3.8 R-CAR V3H
3.9 Requirements on Computing Power of Autonomous Driving Processors
4. Global Automotive Processor Manufacturers
4.1.2 Processor and Microcontroller Portfolios
4.1.3 i.MX Processor Technology Roadmap
4.1.4 i.MX Processors Applied to Cockpits
4.1.5 S32 Series Processors
4.1.6 Autonomous Driving Computing Platform: Bluebox
4.1.7 Bluebox System Architecture
4.1.8 Collaboration between NXP and Kalray
4.1.9 Autonomous Driving Development Trends
4.2.2 Intel Go
4.2.3 Intel Go Users
4.2.4 Mobileye’s EyeQx Product Line
4.2.5 EyeQ Chip Users and Shipments
4.2.6 Mobileye EyeQ5 Chips
4.2.7 EyeQx Product Line Integrates with the Intel System
4.3.2 ADAS Layout
4.3.3 ADAS Chip: TDAx SoCs
4.3.4 ADAS Chip and Deep Learning
4.3.5 TDAx Development Roadmap
4.4.2 Automotive Semiconductor Revenue and Growth Rate
4.4.3 Status in Automotive Semiconductor Segments
4.4.4 Infineon AURIX Series Processors
4.4.5 AURIX and Other Autonomous Driving Computing Platforms
4.4.6 Future Layout in Autonomous Driving
4.5.2 820A and 602A
4.5.3 820A Artificial Intelligence
4.5.5 Automotive Communication System
4.6.2 Parameter Comparison between DRIVE Series Products
4.6.4 AGX Xavier
4.6.5 AGX Pegasus
4.6.6 Xavier for Driverless Delivery
4.6.7 DRIVE AutoPilot
4.6.8 Models with DRIVE Series Chips
4.6.9 Partners in Autonomous Driving
4.7.2 MCU & SoC
4.7.3 Autonomous Driving Layout
4.7.4 Chip Comparison between Renesas and Its Competitors
4.7.5 Next-generation Autonomous Driving SoC
4.7.6 Autonomous Driving Partners and Ecosystem
4.7.7 Autonomy Platform
4.7.8 Application of Chips in Autonomous Driving
4.7.9 Automotive Chip Cooperation
4.8.2 ADAS Solutions
4.8.3 Automotive Processor Layout
4.8.4 Secure Real-Time Microcontrollers
4.8.5 Autonomous Driving Chip Roadmap
4.9.3 Processors Applied in Automobiles
4.9.3 SoC Applied in Automobiles
4.9.4 Product Roadmap
4.9.5 Autonomous Driving Technology Planning
4.9.8 Safety Ready Plan
4.9.9 Dynamics in Autonomous Driving
4.9.10 Autonomous Driving Ecosystem
4.10.1 Soc+FPGA Series Products
4.10.2 Scalable Product Series
4.10.3 Models Applied and Partners
4.10.4 ADAS/Autonomous Driving Market
4.10.5 Versal ACAP Series
4.10.6 RFSoC Development Roadmap
4.10.7 Zynq UltraScale+ MPSoC
4.10.8 Chips Applied in Automobiles
4.11.1 ADAS Solutions
4.11.2 Agency of Miranda
4.12.2 ADAS Solutions
4.12.3 Automotive Image Recognition Processors
4.13.2 Automotive Vision Chips
4.13.3 Development with Hella Aglaia
5. Chinese Automotive Processor Companies
5.1 Horizon Robotics
5.1.2 Chip Ecosystem Planning
5.1.3 Autonomous Driving Chip Roadmap
5.1.4 Autonomous Driving Processors Solutions
5.1.5 Matrix Autonomous Driving Computing Platform
5.1.6 Second-generation BPU Chip
5.2 AutoChips (NavInfo)
5.2.2 Automotive Chip Product Line
5.2.3 Mass-production of Automotive MCU Chips
5.3.2 1A and 1H8
5.3.3 Autonomous Driving Chip
5.3.4 Business Model
5.4.2 ADAS Chip
5.4.3 ADAS Chip Architecture and Parameters
5.4.4 ADAS Chip Algorithm Engine and Supported Algorithms
5.5 Allwinner Technology
5.5.2 Automotive Chips
5.5.3 Cooperative Development of Chips
5.6.1 Two AI Chips for Autonomous Driving
5.6.2 Ascend 310: Efficient-computing and Low-power AI SoC
5.6.3 Ascend 310 for Autonomous Driving
5.6.4 Balong 5000
5.7.1 Automotive Chip Brand
5.7.2 Autus R10
6. Independent Developers of Automotive Processor
6.1.1 Autopilot System and Processor Evolution
6.1.2 Independent Research Progress in Autonomous Driving Processors
6.2.2 Waymo Computing Platform Architecture
6.3 Baidu - AI Chip "Kunlun"
6.4 Leapmotor / Dahua Technology - Leapmotor Teams up with Dahua Technology to Develop AI Autonomous Driving Chip
6.5.2 Core AI Chip Technology
6.5.3 Perception Chip
6.6.2 Core AI Chip Technology
- Allwinner Technology
- AutoChips (NavInfo)
- Horizon Robotics
- Leapmotor/Dahua Technology