Vision Sensor Chip, and Radar/LiDAR chip, who are doing it?
Automated Driving Sensor Chip Industry Report, 2020 analyzes market size, technologies, competitive landscape, development trend, etc of vision sensor chip, Radar and LiDAR chip for automated driving.
Vision sensor Chip: features with function integration and product diversification
Automotive vision sensor chips mainly cover CMOS image sensor (CIS) and image signal processor (ISP) chip. Currently CMOS chips are challenged by high expansion barrier, while the growth rate of CMOS demand is far higher than the expansion speed, especially under the background that automated driving ushers in rapid development in recent years, automotive camera demand skyrockets, pre-installed 960P and 1080P camera CMOS chips are in tight supply.
In terms of market pattern, although SONY, Samsung and other traditional mobile phone CIS vendors have successively launched several CMOS sensors for self-driving, ON Semiconductor still occupies a leading position in the market. It has more than 50 automotive ecological partners, involving businesses like optical lens, signal processors, I/O, Interface, SoC processors and software systems, etc.
In terms of image processing chip, independent ISP chips have strong performance but high cost, the main suppliers include Texas Instruments (TI), Moileye, Huawei HiSilicon, etc, among which TI outstands with the deepest accumulation of technology and the largest market share. In recent years, CIS suppliers like Aptina and OmniVision have also launched the latest CIS integration products with built-in ISP, which have low cost, small area and low power consumption, but is just capable of simple algorithms and is weak in processing power. Under the background of increased requirements for automotive intelligence, independent ISP chip in automotive camera is still the focus.
With the development of artificial intelligence (AI) and automated driving, image processing and calculation are facing more and more challenges. The integration of vision sensor chips has become a trend. In addition to ISP chips, vision processors (VP) chips with AI capabilities are gradually added.
In May 2020, Sony unveiled two models of intelligent vision sensors with AI processing functionality - IMX500 and IMX50, which feature a stacked configuration consisting of a pixel chip (photosensitive function) and a logic chip (calculation and memory function). They are the world’s first CMOS image sensors to be equipped with AI image analysis and processing functionality on the logic chip.
In Jan. 2021, OmniVision released new sensor OAX8000, which uses a stacked-die architecture and integrates a neural processing unit (NPU) and ISP. OAX8000 ASIC samples are provided by BGA196 package now and already passed automotive AEC- Q100 2 certification.
Due to different application positions of vision camera in the car, it can be subdivided into surround view, front view, rear view, side view, drive monitoring, cockpit monitoring, etc. From the perspective of chip, there are also image sensor products dedicated to surround view, front view, rear view and driving monitoring. For example, OmniVision’s vehicle image sensor products include driver monitoring sensors (OV10652, OV2311, OV2312, OV2778, OV4690, etc), sensors for automated driving systems (OV10625, OV10640, OV10642, OV10650, OV10652, etc.), rear view and electronic mirror sensors (OV10626, OV10635, OV10640, OV10650, OV10652, etc), surround view sensors (OV10635, OV10640, OV10652, OV2312, OV2775, etc.）, 8-megapixel forward camera OX08A and OX08B, and DMS sensor OAX8000, etc.
Increase in usage and industrial M&As
The number of vehicle cameras for mainstream models will increase from 1.7 in 2018 to more than 3 in 2022 per vehicle, while the number for high-end models even be more than 10. For example, Leapmotor C11 unveiled a the end of 2020 carries 10 cameras, and NIO ET7, which will be launched in 2022, carries 11 8-megapixel high-definition cameras. Also, the first model of IM (Zhiji Auto) just released in early 2021 comes standard with 15 high-definition vision cameras, 5 radars and 12 ultrasonic radars.
As the incremental application of image sensors in the next few years will be mainly in the automotive market, leading players in the industry begin to deploy and a number of image sensor companies are acquired in 2020:
- SmartSens Technology acquired Allchip
- Goodix acquired Dreamchip
- TE Connectivity acquired First Sensor
- AMS acquired Osram
- Nuvoton acquired Semiconductor Business from Panasonic (including image sensor)
- Jenoptik acquired Trioptics(test equipment for optical components and sensors)
- Sony acquired Insightness(event-based vision sensor)
Radar chip: 4D imaging radar enters mass-production and radar SoC solution arouses much concern.
Radar-used chips cover master chips (MCU, DSP, FPGA), radar chip (e.g., MMIC, ASIC) and other auxiliary ones (like PMI, ADC). The radar vendors are championing 77GHz and chip providers deliver new products, mainly 77GHz chips.
The 4D imaging radar market is already fiercely contested, and the players such as Huawei and Oculii have rolled out 4D imaging radar systems. In early 2021, Continental AG announced it would spawn the first 4D imaging radar - ARS540 within 2021, a solution based on chip cascade plus Xilinx FPGA.
Continental’s 4D imaging radar will be first available to BMW production cars; and SUV Ocean with 4D imaging radar, as an outcome of joint efforts between Magna and Fisker, made its debut in early 2021 and plans to be launched on the market at the end of 2022. Besides, there are also signs of Tesla to deploy 4D imaging radar (the 4D radar Phoenix offered by Arbe Robotics).
In addition to 4D radar, startups prefer to develop radar SoC (radar-on-a-chip) products. Vayyar, with the already raised funds of $188 million has the automotive radar chips enabling 77-81GHz imaging and radar band, incorporating a total of 48 transceivers in a SoC system able to accommodate 2,000-plus virtual channels. Vayyar’s radar SoC contains an internal DSP as well, enabling real-time signal processing. Vayyar’s sensors are enhanced through the integrated powerful DSP and large internal memory to administer complex imaging algorithms and application without a need for external tackling capability. Vayyar’s radar SoC is able to output post-processing data and original 3D images or point-cloud formats.
In December 2020, Uhnder, a start-up in the development of radar-on-a-chip secured its C-round series funding of $45 million, with a plan to unveil its first automotive-grade 4D imaging radar - Voxel within 2021, containing chips and 4D imaging software algorithms. The successful financing will serve as a stimulus to the company’s ambitious production plan in 2021.
LiDAR chip: SoC solution becomes the apple of vendors’ eyes, and hopefully FMCW solution is gaining ground
Despite a varied focus of vendors on chip technologies, LiDAR on chip grows a key trend as those are beneficial to automated driving such as high reliability coming of no mechanical motion mechanisms as well as conforming to vehicle requirements, miniature and being easy to integrate, among others. Moreover, the semiconductor process (like CMOS) truly brings a cut in vehicle LiDAR costs, from the tens of thousands of yuan to less than ten thousand yuan in readiness for massive use.
LiDAR SoC solution is the dream of many a vendor. In August 2016, Massachusetts Institute of Technology (MIT) together with Defense Advanced Research Projects Agency (DARPA) offered such a solution like this: to encapsulate LiDAR sensors onto a single chip with a footprint just 0.5mm×6mm, for the commercialization of which MIT set up a company named Kyber Photonic in early 2020.
In June 2020, Xilight Technology joined forces with Xidian University to develop dToF SPAD LiDAR sensor chip - XHS301 on which the core photosensitive element SPAD is integrated. The solution enables the miniature and cost reduction of LiDAR and is well placed for mass production with proprietary control technologies.
In January 2021, Mobileye announced a partnership with Intel to develop silicon photonics LiDAR SoC system with which the LiDAR sensors are produced for availability onto Mobileye self-driving fleets in 2025. Such chip enjoys significant superiority in the LiDAR sector thanks to Intel’s professional silicon photonics workshops.
The LiDAR SoC developed by Mobileye and Intel employs FMCW (Frequency Modulated Continuous Wave) technology, featuring a high signal-to-noise ratio, low power consumption, irrelevance to both the distance away from objects (compared with the farther TOF LiDAR detects, the lower accuracy of detection will be) and the motion velocity of objects, but with the demerits including great difficulty, high costs and low yield. ToF-based pulse laser has long been dominant in the industry, and only about ten out of more than 100 LiDAR developers worldwide dedicate themselves to the development of FMCW LiDARs. It is over the recent years that FMCW technology is increasingly favored by ever more companies.
Being bullish about FMCW LiDAR, the optics giant Carl Zeiss AG invested and founded Bridger Photonics, an American LiDAR developer in November 2018 and made investments in August 2020 in Scantinel Photonics, a German FMCW LiDAR startup.
1. Overview of Self-driving Sensor Chip
1.1.1 Vision Sensor Chip
1.1.2 Ultrasonic Radar Chip
1.1.3 Radar Chip
1.1.4 LiDAR Chip
1.1.5 Classification of Self-driving Sensor Chip
1.2 Self-driving Sensor Chip Industry Chain
1.2.1 Vision Sensor Chip Industry Chain
1.2.2 Radar Sensor Chip Industry Chain
1.3 Ultrasonic Radar Chip
1.3.1 Ultrasonic Radar Structure and Size
1.3.2 Ultrasonic Radar Chip Technology
1.4 3D Image Sensing Technology
1.4.1 3D CMOS Image Sensor Chip
1.4.2 3D Image Sensor Chip Technology
1.4.3 Comparison of 3D Sensor Chip Products
2 Automotive CIS and ISP Chip Industry and Suppliers
2.1 Overview of Automotive Vision Sensor
2.1.1 Structure of Automotive Vision Sensor
2.1.2 Requirement on Vision Sensors
2.1.3 Vision Sensor Market Size
2.2 Automotive CIS and ISP Chip Technology
2.2.1 CIS（CMOS Image Sensor）
2.2.2 ISP Chip（1）
2.2.3 ISP Chip（2）
2.2.4 ISP Chip: Market Size
2.3 Automotive CIS and ISP Chip Market Pattern
2.3.1 CIS Chip Market Pattern
2.3.2 Comparison of CIS Chip Products of Major Vendors
2.3.3 ISP Chip Competitive Landscape
2.4 Automotive CIS/ISP Chip Development Trend
2.4.1 CIS Development Trend 1
2.4.2 CIS Development Trend 2
2.4.3 ISP Chip Technology Trend 1
2.4.4 ISP Chip Technology Trend 2
2.5 ON Semiconductor
2.5.2 Automotive Business Layout
2.5.3 Automotive Sensor Business
2.5.4 Image Sensor Business
2.5.5 Automotive Image Sensor Customers and Market Position
2.5.6 ADAS Image Sensor Products
2.5.7 Image Sensor for Cockpit
2.5.8 New Image Sensor Products
2.5.9 Typical In-vehicle CMOS Products
2.6 Samsung Electronics
2.6.2 Layout in Automotive ADAS
2.6.3 Automotive Image Sensor
2.6.4 Product Feature of Automotive Image Sensor
2.7.2 Technical Strength in CMOS Field
2.7.3 Automotive CMOS Development Course
2.7.4 Automotive CMOS Product Portfolio
2.7.5 Automotive CMOS Products
2.7.6 Latest Vision CMOS Products
2.8.2 Image Sensor
2.8.3 Automotive Image Sensor
2.8.4 Sensor for Driver Monitoring System
2.8.5 Self-driving Sensor
2.8.6 Display-based Image Sensor
2.8.7 Surround-view Sensor
2.8.8 Latest Technology Progress
2.9.2 CIS and Chip Products and Products Under Planning
2.9.3 PixArt Products
2.9.4 Automotive Vision Application
2.9.5 Automotive Gesture Control IC
2.10 SmartSens Technology
2.10.2 Automotive Image Sensor 1
2.10.3 Automotive Image Sensor 2
2.10.4 Acquisition of Allchip
2.11.1 Visconti Image Processor
2.11.2 Feature of Visconti Image Processor
2.11.3 Visconti4 Image Recognition Processor
2.11.4 Application of Visconti4 Image Recognition Processor
2.11.5 Visconti5 Image Recognition Processor
2.12 Other Vision Sensor Chip Suppliers
2.12.1 GalaxyCore CMOS Image Sensor Business
2.12.2 Fullhan Automotive ISP Chip
2.12.3 Ambarella Launched High-performance Camera Chip
2.12.4 ST Vision Sensor
2.12.5 Newsight Imaging
2.12.6 Infineon 3D Image Sensor Chip
3 Automotive Radar Chip Industry and Suppliers
3.1 Radar Chip Industry
3.1.1 Radar Industry Chain
3.1.2 Radar Chip Market Size
3.3.3 Radar Chip Competitive Landscape
3.2 Radar Chip Technology
3.2.1 Radar Chip System Architecture
3.2.2 Radar Chip Technology: Signal Transceiver
3.2.3 Radar Chip Technology: Digital Signal Processing
3.2.4 Radar Chip Technical Difficulties
3.2.5 Radar Chip Technology Trend 1
3.2.6 Radar Chip Technology Trend 2
3.3 Radar Chip Products Comparison
3.3.1 Radar Chip Suppliers
3.4.2 Radar Chip
3.4.3 24GHz Radar Chip
3.4.4 24GHz Radar Chip Product System
3.4.5 77GHz Radar Chip
3.4.6 77GHz Radar Chip Application
3.4.7 RASIC Chip
3.4.8 77GHz Radar Micro-controller TC3A
3.5.2 Radar Chip Business
3.5.3 77GHz Radar Transceiver Chip
3.5.4 New Radar Solution
3.5.5 Imaging Radar Solution
3.6.2 Sensor Business
3.6.3 24GHz Radar Chip
3.6.4 77GHz Radar Chip
3.7 Texas Instruments
3.7.2 Radar Chip System
3.7.3 77GHz Radar Chip
3.7.4 77GHz Radar Chip in Future
3.8.2 Acquisition of Symeo
3.8.3 CMOS Radar Technology Platform and its Featured Products
3.8.4 ADI 24GHz Radar Chip
3.8.5 24GHz radar Platform-based intelligent Transportation System
3.8.6 Imaging Radar Solution
3.9.2 4D Radar and Chip
3.9.3 Function of 4D Radar
3.9.4 60GHz Radar Chip
3.9.5 Vayyar 3D CMOS System Chip
3.10.2 Uhnder Radar Chip
3.10.3 Uhnder Radar Application
3.10.4 Uhnder Radar Parameters
3.11 ANDAR Technologies
3.11.2 77/79GHz Radar Chip
3.12 Qingneng Huabo
3.12.2 76-81GHz Radar Chip
3.12.3 77GHz Radar
3.13 SGR Semiconductors Inc.
3.13.2 24GHz Radar Chip
3.13.3 New 24GHz Radar Chip Products
3.13.4 77GHz Radar Chip
3.14.2 Launch New Radar Chip
3.14.3 77GHz Radar Transceiver Chip and Application
3.15 Xiamen IMSEMI technology Co., Ltd.
3.15.2 24GHz Radar Chip
3.15.3 Parameters of 24GHz Radar Chip
3.15.4 Development Course
3.16 Citta Microelectronics
3.16.2 77GHz Radar Chip
3.17 MediaTek Launched Ultrashort-range Radar Chip
4 LiDAR Chip Industry and Suppliers
4.1 LiDAR Chip Technology
4.1.1 LiDAR Chip Structure
4.1.2 Laser Transmitter of LiDAR Chip
4.1.3 LiDAR Chip Technology: FMCW
4.1.4 Status Quo of LiDAR Chip Technology
4.1.5 R&D Progress of LiDAR Chip Technology
4.2.2 Global Network
4.2.3 Automotive LiDAR Technology
4.2.4 LeddarCore SoC
4.2.5 LeddarTech LiDAR Solution
4.2.6 Coopeation Mode
4.3 Sense Photonics
4.3.2 LiDAR Chip
4.4 VisionICs Microelectronics Technology Co., Ltd.
4.4.2 LiDAR Chip
4.5 China Science Photon Chip Tech
4.5.2 LiDAR Chip
4.6 Ningbo Xilight Technology
4.6.2 LiDAR Chip
4.6.3 Products R&D
4.7 Abax Sensing
4.7.2 LiDAR Solution
4.7.3 Parameters of LiDAR Products
4.8 Mobileye LiDAR Chip
4.9 Other LiDAR Chip Suppliers
4.9.1 M&As of ON Semiconductor
4.9.2 LiDAR Chip Layout of ADI
4.9.3 LiDAR Chip Business of Dibotics
4.9.4 LiDAR Chip Business of Lumotive
- ON Semiconductor
- Samsung Electronics
- SmartSens Technology
- Texas Instruments
- ANDAR Technologies
- Qingneng Huabo
- SGR Semiconductors Inc.
- Xiamen IMSEMI technology Co., Ltd.
- Citta Microelectronics
- Sense Photonics
- VisionICs Microelectronics Technology Co., Ltd.
- China Science Photon Chip Tech
- Ningbo Xilight Technology
- Abax Sensing