1 EXECUTIVE SUMMARY
1.1 Key Findings
1.2 The Generative AI Hardware Bottleneck
1.3 Materials Value Chain at a Glance
1.4 Eleven-Year Forecast Highlights
1.5 Strategic Implications for Asian Foundries, OSAT, Memory, Substrate, and Cooling Vendors
1.6 Differentiation vs. Adjacent Coverage
1.7 Major Market Players
2 THE COMPUTE STACK BEHIND GENERATIVE AI
2.1 Training vs. Inference Economics
2.2 Cloud, Edge, and Sovereign AI
2.3 Why Memory Bandwidth and Packaging Dominate Cost
2.4 Materials and Components as the New Bottleneck
2.5 Hyperscaler vs. Enterprise vs. Sovereign Capex
2.6 Company Profiles (9 company profiles)
3 AI ACCELERATOR SILICON
3.1 GPUs
3.2 Custom Hyperscaler ASICs
3.3 Domain-Specific and Challenger Architectures
3.4 Chinese AI Chip Ecosystem
3.5 Process Nodes and Foundry Roadmaps
3.6 Wafer-Level Integration and Reticle Stitching
3.7 Company Profiles (53 company profiles)
4 AI-DRIVEN CHIP DESIGN (EDA)
4.1 The EDA Bottleneck in the AI Hardware Era
4.2 The Recursive Loop: AI Designing AI Hardware
4.3 The Incumbent EDA Vendors' AI Initiatives
4.4 The Startup Cohort: Four Distinct Approaches
4.5 Geographic Distribution
4.6 Market Forecast: AI-EDA Tools 2026-2037
4.7 Strategic Implications
4.8 Company profiles (6 company profiles)
5 HIGH BANDWIDTH MEMORY AND BEYOND
5.1 HBM Architecture and TSV Stacking Fundamentals
5.2 HBM Generation Roadmap
5.3 Memory Makers and Capacity Outlook
5.4 Custom HBM (cHBM) and Base-Die Innovation
5.5 Compute-in-Memory and Processing-in-Memory at Scale
5.6 Emerging Memory for AI Datacenters
5.7 Memory Pooling and CXL Fabrics
5.8 3D DRAM - The Post-2030 Path
5.9 Company Profiles (23 company profiles)
6 ADVANCED PACKAGING AND SUBSTRATE MATERIALS
6.1 The 2.5D / 3D Architecture Continuum
6.2 TSMC CoWoS and the Capacity Constraint
6.3 Intel and Samsung Advanced Packaging
6.4 Substrate Technologies (ABF, FC-BGA)
6.5 Interposer Materials (Silicon TSV, Glass, Organic RDL)
6.6 Hybrid Bonding and Copper-to-Copper Interconnect
6.7 OSAT Capacity and Asian Dominance
6.8 Advanced Packaging Materials Suppliers
6.9 Company Profiles (56 company profiles)
7 CO-PACKAGED OPTICS AND SILICON PHOTONICS FOR AI
7.1 The Optical Interconnect Imperative
7.2 CPO Architecture and the Two Network Layers
7.3 TSMC COUPE, CoWoS-Photonics, iOIS
7.4 ASE VIPack and the Merchant Photonics Packaging Layer
7.5 Optical I/O Chiplets: AyarLabs, Lightmatter, Celestial AI
7.6 Switch Silicon and Co-Packaged Optical Engines
7.7 Silicon Photonics Foundries
7.8 Photonics Packaging Materials and Supply Chain
7.9 Market Sizing for Photonics Packaging 2026-2037
7.10 Company Profiles (28 company profiles)
8 THERMAL MANAGEMENT FOR AI DATA CENTERS
8.1 The Thermal Crisis: Power Density at the Package Level
8.2 Thermal Interface Materials (TIMs)
8.3 Heat Spreaders, Vapor Chambers, and Heat Pipes
8.4 Cold Plates and Direct-to-Chip Liquid Cooling
8.5 Immersion Cooling
8.6 Microfluidic and In-Package Cooling
8.7 Market Forecast: AI-Tied Thermal Management 2024-2037
8.8 Company Profiles (40 company profiles)
9 POWER DELIVERY AND GAN/SIC TRANSITION
9.1 The Power Crisis: From 12V to 48V to 800V HVDC
9.2 The Power Hierarchy: System, Board, Package, Die
9.3 SiC Devices and Substrate Supply
9.4 GaN Devices: Lateral, Vertical, Cascode
9.5 Voltage Regulator Modules and Multi-Phase Point-of-Load
9.6 Server Power Supply Units and Rack Rectifier Shelves
9.7 Backside Power Delivery (BSPDN)
9.8 Market Forecast: AI Datacenter Power Semiconductors 2024-2037
9.9 Company Profiles (42 company profiles)
10 NETWORKING AND OPTICAL MATERIALS
10.1 The Three Network Layers in an AI Datacenter
10.2 Switch Silicon Roadmap
10.3 Pluggable Optical Transceivers
10.4 DSP and SerDes for Optical Transceivers
10.5 III-V Materials Layer: InP, GaAs, GaN-Photonics
10.6 NICs, DPUs, and SmartNICs
10.7 Cables, Connectors, and Direct Attach Copper
10.8 Market Forecast: AI-Tied Networking and Optical 2024-2037
10.9 Company Profiles (36 company profiles)
11 DATA CENTER CONSTRUCTION AND SUSTAINABILITY
11.1 The AI Datacenter Buildout: Scale and Scope
11.2 Power Infrastructure: Grid, On-Site Generation, and SMRs
11.3 Facility-Level Cooling Architecture
11.4 Construction Supply Chain and Modular Datacenter Architecture
11.5 Geographic Concentration and Site Selection
11.6 PUE, WUE, and Sustainability Metrics
11.7 Regulatory Framework
11.8 Market Forecast: AI Datacenter Construction Supply Chain 2024-2037
12 EDGE GENAI HARDWARE
12.1 The Edge AI Taxonomy
12.2 AI Smartphones
12.3 AI PCs
12.4 NVIDIA Jetson and the Embedded AI Platform
12.5 Automotive AI Silicon
12.6 Humanoid Robotics: The Emerging Edge AI Compute Frontier
12.7 Edge AI Accelerator Start-ups
12.8 Edge AI Memory: LPDDR5X, On-Chip SRAM, eMRAM
12.9 Market Forecast: Edge AI Silicon 2024-2037
12.10 Company Profiles (51 company profiles)
13 REGIONAL ANALYSIS: GEOGRAPHY OF THE GENAI HARDWARE SUPPLY CHAIN
13.1 The Asian Concentration
13.2 Taiwan
13.3 South Korea
13.4 Japan
13.5 China
13.6 Southeast Asia and India
13.7 The United States
13.8 Europe and Israel
13.9 The Rest of World: Niche Capabilities and Sovereign Ambitions
13.10 Aggregate Regional Capture: Scenario Analysis 2026-2037
14 SUPPLY CHAIN AND GEOPOLITICS
14.1 The Defining Tensions
14.2 The China Strategy: Sovereign Stack and Domestic Substitution
14.3 US CHIPS Act Implementation and Domestic Reshoring
14.4 European Chips Act and Strategic Autonomy
14.5 The Critical Materials Layer
14.6 Single-Point-of-Failure Analysis
14.7 Scenarios for Supply Chain Resilience
14.8 Sovereign AI as a Strategic Demand Driver
15 SUSTAINABILITY AND EMBODIED CARBON
15.1 The Sustainability Stakes
15.2 Operational Emissions: Training, Inference, and the Cooling Energy Tax
15.3 Embodied Carbon in Semiconductor Manufacturing
15.4 Water, Chemicals, and Resource Intensity
15.5 Renewable Energy Procurement at Hyperscaler Scale
15.6 Heat Recovery, Circular Economy, and End-of-Life
15.7 Carbon Accounting Standards and Corporate Disclosure
15.8 Green Manufacturing Practices at Major Suppliers
15.9 Market and Regulatory Outlook 2026-2037
16 MARKET FORECASTS: GENAI HARDWARE 2026-2037
16.1 Forecast Methodology and Framework
16.2 Total GenAI Hardware Market - Base Case Forecast
16.3 Bull/Base/Bear Scenarios at Aggregate Level
16.4 AI Accelerator Silicon Sub-Segment Forecast
16.5 HBM and Memory Sub-Segment Forecast
16.6 Advanced Packaging Sub-Segment Forecast
16.7 Photonics Packaging Sub-Segment Forecast
16.8 Thermal Management Sub-Segment Forecast
16.9 Power Delivery Sub-Segment Forecast
16.10 Networking and Optical Sub-Segment Forecast
16.11 Datacenter Construction Supply Chain Sub-Segment Forecast
16.12 Edge AI Silicon Sub-Segment Forecast
16.13 Regional Capture Forecast
16.14 Customer Tier Forecast
16.15 Key Forecast Risks and Sensitivities
17 STRATEGIC OUTLOOK
17.1 The Five Defining Themes of the GenAI Hardware Decade
17.2 The Choke-Point Map
17.3 The Strategic Investment Framework
17.4 M&A Landscape and Strategic Consolidation
17.5 Sensitivity Analysis
17.6 Strategic Implications by Stakeholder
17.7 What Could Change This Forecast
18 APPENDIX
18.1 Forecast Methodology
18.2 Definitions and Terminology
18.3 Abbreviations
18.4 Sources and References
18.5 Forecast Scope, Limitations, and Disclaimers
18.6 Detailed Year-by-Year Forecast Outputs
LIST OF TABLES
Table 1. Headline Findings Summary (Base Case)
Table 2. Eleven-Year Forecast Summary: GenAI Hardware Materials Market 2026-2037 (US $B, Base Case)
Table 3. Top Ten Strategic Conclusions Mapped to Stakeholder Type
Table 4. Training vs. Inference Hardware Mix Comparison
Table 5. Silicon Content per 100 MW AI Training Facility (Reference BoM)
Table 6. Cost-per-Token by Model Size and Hardware Configuration 2024-2040 (USD per million output tokens)
Table 7. Sovereign AI Build-Outs by Country 2025-2030
Table 8. AI Accelerator Memory Requirements 2024-2030F
Table 9. US and Chinese Hyperscaler Capex Summary 2021-2026 (US $B)
Table 10. GPU Specifications: NVIDIA Blackwell, Rubin; AMD MI350X, MI450 (2024-2026)
Table 11. Rack-Scale GPU Platform Comparison
Table 12. AI ASIC Specifications: Google, AWS, Microsoft, Meta (2024-2026)
Table 13. AI ASIC Technology Specification Database (All Major Vendors)
Table 14. Chinese Data Center Processor Manufacturer Overview
Table 15. China AI Chip Capability Gap Assessment by Workload Type
Table 16. Semiconductor Process Node Roadmap 2024-2030
Table 17. TSMC Node Roadmap: N3, N2, A16, A14 Specs and Timeline
Table 18. Wafer-Scale Accelerator Yield Economics: Cerebras WSE-3 and Tesla Dojo
Table 19. Incumbent EDA Vendor AI Initiatives vs. Startup Cohort
Table 20. AI-EDA Approaches by Design-Flow Stage
Table 21. AI-EDA Market Forecast 2026-2037
Table 22. HBM Generation Technical Specifications HBM2E to HBM5
Table 23. HBM Bonding Integration Roadmap and Vendor Mapping
Table 24. HBM Market Share by Supplier 2022-2028F (%)
Table 25. HBM Customer Demand Breakdown: NVIDIA, Google, AMD, Hyperscalers 2024-2028F
Table 26. Custom HBM Players, Products, Design Roadmaps
Table 27. Standard vs. Custom HBM Revenue Forecast 2024-2030F (US $M)
Table 28. Near-Memory and In-Memory Computing Landscape
Table 29. Resistive Non-Volatile Memory Technologies
Table 30. Storage-Class Memory Technology Comparison
Table 31. CXL Switch Silicon Vendors and Capability Matrix
Table 32. 3D DRAM Technology Readiness Assessment by Player 2026
Table 33. Advanced Packaging Technology Comparison: 2.5D and 3D Options
Table 34. CoWoS Capacity Forecast by Sub-Variant 2024-2037 (k wafers/month equivalent)
Table 35. TSMC SoIC Variants: Specifications and AI Customer Adoption
Table 36. Comparative Advanced Packaging Roadmap: TSMC vs. Intel vs. Samsung
Table 37. Substrate Suppliers for AI Accelerator Packages
Table 38. Substrate Demand Forecast for AI Packages 2024-2037 (k units/month)
Table 39. Interposer Material Comparison: Silicon TSV vs. Glass vs. Organic RDL
Table 40. Hybrid Bonding Adoption Roadmap for DRAM Applications 2023-2030
Table 41. OSAT Capacity and Revenue Concentration 2024-2030
Table 42. Advanced Packaging Materials Suppliers
Table 43. Migration Trajectory from Copper to Optical Across the Two Network Layers
Table 44. Key Technology Building Blocks for Co-Packaged Optics
Table 45. TSMC Photonics Packaging Capabilities
Table 46. Merchant Photonics Packaging Platform Comparison
Table 47. Optical I/O Chiplet Vendor Comparison
Table 48. AI-Switch Silicon Roadmap with CPO Integration
Table 49. Silicon Photonics Foundry Capability Matrix
Table 50. CPO Supply Chain Critical Materials and Suppliers
Table 51. Photonics Packaging Revenue Forecast for AI Applications 2024-2037 (US $B)
Table 52. Cooling Technologies for High-Performance AI Processors
Table 53. Thermal Interface Material Categories and Suppliers
Table 54. TIM Properties for AI Accelerator Applications
Table 55. TIM Revenue Forecast for AI Datacenter Applications 2024-2037 (US $M)
Table 56. Heat Spreader and Vapor Chamber Suppliers
Table 57. Heat Spreader and Heat Sink Revenue Forecast 2024-2037 (US $M)
Table 58. Cold Plate Suppliers for AI Servers
Table 59. Liquid Cooling Adoption Share in New AI Datacenter Deployments
Table 60. Immersion Cooling Fluid Categories and Suppliers
Table 61. Immersion Cooling System Suppliers
Table 62. Microfluidic Cooling Technology Comparison
Table 63. Facility Liquid Cooling Infrastructure Suppliers
Table 64. AI-Tied Thermal Management Revenue Forecast 2024-2037 (US $B)
Table 65. Power Delivery Hierarchy in AI Servers
Table 66. Comparison of 48V and 800V HVDC Rack Architectures
Table 67. SiC vs. GaN vs. Silicon Power Device Comparison
Table 68. SiC Substrate and Device Suppliers
Table 69. GaN Device Manufacturers and Application Focus
Table 70. AI VRM Controller and Power Stage Suppliers
Table 71. Server Power Supply Unit Suppliers
Table 72. Backside Power Delivery Adoption Roadmap
Table 73. AI Datacenter Power Semiconductor Revenue Forecast 2024-2037 (US $B)
Table 74. The Three Networking Layers in an AI Datacenter
Table 75. AI Switch Silicon Roadmap
Table 76. Optical Transceiver Form Factor and Data Rate Roadmap
Table 77. Optical Transceiver Module Suppliers for AI Datacenters
Table 78. Optical DSP Suppliers and Application Mapping
Table 79. III-V Substrate Materials Suppliers for AI Optical Transceivers
Table 80. NIC, DPU, and SmartNIC Suppliers
Table 81. Cable, Connector, and Fiber Suppliers for AI Datacenters
Table 82. AI-Tied Networking and Optical Revenue Forecast 2024-2037 (US $B)
Table 83. AI Datacenter CAPEX Breakdown (100 MW Training Facility, 2026 Reference)
Table 84. Hyperscaler Power Procurement Strategies (2025 Snapshot)
Table 85. Major Switchgear, Transformer, and Power Infrastructure Suppliers
Table 86. Facility Cooling Infrastructure Suppliers
Table 87. Major AI Datacenter Construction Companies and Operators
Table 88. Construction Engineering and EPC Firms with Major AI Datacenter Practice
Table 89. PUE Targets and Achievement at Major Hyperscalers (2025)
Table 90. AI-Tied Datacenter Construction Supply Chain Revenue Forecast 2024-2037 (US $B)
Table 91. Edge AI NPU Performance by Application Segment
Table 92. Flagship Smartphone AI Processor Comparison (2026)
Table 93. Evolution of Apple Neural Engine AI Performance (2017-2026)
Table 94. AI PC Silicon Platform Comparison (2026)
Table 95. AI PC On-Device LLM Inference Capability (2026)
Table 96. NVIDIA Jetson Product Line (2026)
Table 97. Automotive AI Silicon Platforms (2026)
Table 98. Humanoid Robot Compute Platforms (2026)
Table 99. Edge AI Start-up Landscape
Table 100. Edge AI Memory Suppliers and Categories
Table 101. Edge AI Silicon Revenue Forecast 2024-2037 (US $B)
Table 102. Regional Capture of GenAI Hardware Bill of Materials, 2026 Base Case
Table 103. Taiwan AI Hardware Supply Chain by Capability Layer
Table 104. Korea AI Hardware Supply Chain by Capability Layer
Table 105. Japan AI Hardware Supply Chain by Capability Layer
Table 106. China AI Hardware Supply Chain by Capability Layer
Table 107. Southeast Asia and India AI Hardware Supply Chain
Table 108. United States AI Hardware Supply Chain by Capability Layer
Table 109. Europe and Israel AI Hardware Supply Chain
Table 110. Regional GenAI Hardware BoM Capture by Scenario (% of Global BoM Value)
Table 111. Major US Export Control Actions Affecting AI Hardware (2019-2026)
Table 112. Chinese Wafer-Fab Equipment Companies and Capability Status
Table 113. Major CHIPS Act-Funded Semiconductor Projects
Table 114. Critical Materials Supply Chain Concentration for AI Hardware
Table 115. Top Single-Point-of-Failure Risks in the GenAI Hardware Supply Chain
Table 116. Supply Chain Diversification Scenario Outcomes 2030
Table 117. Lifecycle Carbon Footprint by AI Chip Type
Table 118. AI Carbon Footprint Examples and Mitigation Strategies
Table 119. Estimated Embodied Carbon Across the AI Hardware Hierarchy
Table 120. Water Consumption Profile for AI Hardware Manufacturing and Operations
Table 121. Hyperscaler Renewable Energy and Nuclear Procurement (2025 Snapshot)
Table 122. Lifecycle and End-of-Life Treatment for AI Hardware
Table 123. Major Corporate Carbon Commitments Affecting AI Hardware Procurement
Table 124. Green Manufacturing Initiatives by Major Semiconductor Suppliers
Table 125. Forecast Methodology and Key Assumptions
Table 126. Total GenAI Hardware Market by Major Segment, Base Case (US $B)
Table 127. GenAI Hardware Aggregate Market Across Three Scenarios, 2026-2037 (US $B, excl. construction supply chain)
Table 128. AI Accelerator Silicon Sub-Segment Forecast 2024-2037 (US $B)
Table 129. HBM and AI-Tied Memory Sub-Segment Forecast 2024-2037 (US $B)
Table 130. Advanced Packaging Sub-Segment Forecast 2024-2037 (US $B, AI-tied)
Table 131. Photonics Packaging Sub-Segment Forecast 2024-2037 (US $B)
Table 132. Thermal Management Sub-Segment Forecast 2024-2037 (US $B, AI-tied)
Table 133. Power Delivery (AI Datacenter Tied) Sub-Segment Forecast 2024-2037 (US $B)
Table 134. Networking and Optical (AI-Tied) Sub-Segment Forecast 2024-2037 (US $B)
Table 135. Datacenter Construction Supply Chain Sub-Segment Forecast 2024-2037 (US $B)
Table 136. Edge AI Silicon Sub-Segment Forecast 2024-2037 (US $B)
Table 137. Regional GenAI Hardware BoM Capture Forecast, 2026-2037, Base Case (%)
Table 138. Total GenAI Hardware Demand by Customer Tier, Base Case 2026-2037 (US $B, excl. construction supply chain)
Table 139. The Five Defining Themes: Strategic Implications by Layer
Table 140. The Top 15 Strategic Choke Points in the GenAI Hardware Supply Chain
Table 141. Strategic Tier Classification of GenAI Hardware Sub-Segments
Table 142. Notable GenAI Hardware M&A and Strategic Investments 2020-2026
Table 143. Sensitivity of Base Case 2030 Forecast to Key Assumptions
Table 144. Detailed Year-by-Year Total Forecast, Base Case (US $B, excl. DC construction supply chain)
Table 145. Detailed Year-by-Year Total Forecast Across All Three Scenarios (US $B, excl. DC construction supply chain)
LIST OF FIGURES
Figure 1. Five Compute-Scaling Walls and Their Material Solutions
Figure 2. Generative AI Hardware Materials Value-Chain Layer Map
Figure 3. Base-Case Forecast Stacked-Area Visualisation 2026-2037
Figure 4. Bull, Base, and Bear Scenario Comparison 2026-2037
Figure 5. Asia-Pacific Capture Rate of GenAI Hardware Value 2026-2037
Figure 6. AI Data Centre Silicon Content Map
Figure 7. Inference Token Economics by Model Size
Figure 8. Sovereign AI Capex Pipeline 2024-2030 by Geography
Figure 9. Generative AI Compute Demand Scaling vs. Electrical Interconnect Capacity
Figure 10. AI Accelerator BoM Decomposition: Where the Dollars Go
Figure 11. Annual GenAI-Driven AI Hardware Demand Pool 2024-2030
Figure 12. NVIDIA GPU Architecture Evolution: Volta to Post-Blackwell Timeline
Figure 13. Rack-Scale GPU Architecture: NVL72 and Next-Generation Platforms
Figure 14. Hyperscaler ASIC Roadmap Comparison
Figure 15. Hyperscaler ASIC vs. Merchant GPU Share of Datacenter AI Compute 2024-2037
Figure 16. AI ASIC Start-Up Landscape by Funding Stage
Figure 17. GPU vs. AI ASIC Performance per Watt Comparison 2022-2026
Figure 18. China Semiconductor Capability Map: Node vs. Supply-Chain Layer
Figure 19. China AI Chip Roadmap vs. NVIDIA / AMD: Parity Distance by Generation
Figure 20. Leading-Edge Foundry Roadmap Comparison 2023-2037 (Gantt)
Figure 21. HBM Architecture: Die-Stack Cross-Section
Figure 22. HBM Bandwidth Evolution HBM1 to HBM5
Figure 23. HBM4 Die-to-Wafer Bonding Integration Scheme
Figure 24. HBM Market Share by Supplier 2022-2028F
Figure 25. SK hynix HBM Strategy and Roadmap
Figure 26. Samsung HBM Strategy and Roadmap
Figure 27. Micron HBM Strategy and Roadmap
Figure 28. HBM Customer Demand Breakdown by AI Accelerator
Figure 29. Custom HBM Architecture: Co-Design Concept
Figure 30. Custom HBM Share of Total HBM Bit Demand 2026-2037
Figure 31. Near-Memory vs. PIM Architecture Comparison
Figure 32. CXL Memory Pooling Architecture and Vendor Map
Figure 33. 3D DRAM Concept Architectures
Figure 34. Monolithic Die vs. Chiplet Architecture: Yield and Cost
Figure 35. Chiplet Interconnect Technology Spectrum
Figure 36. CoWoS Integration: GPU + HBM on Silicon Interposer
Figure 37. CoWoS Capacity Expansion Roadmap
Figure 38. OSAT Revenue Concentration by Geography 2024-2037
Figure 39. Compute Demand vs. Interconnect Bandwidth Gap
Figure 40. Photonics Packaging Revenue Forecast for AI Applications 2024-2037
Figure 41. AI Accelerator TDP and Cooling Architecture Trajectory 2022-2037
Figure 42. Liquid Cooling Adoption Trajectory in AI Datacenter Deployments
Figure 43. Power Density at AI Server Rack: From 30 kW to 600 kW per Rack
Figure 44. Wide-Bandgap Power Semiconductor Material Properties Comparison
Figure 45. Edge AI Performance and Power Envelope Map
Figure 46. Total GenAI Hardware Market 2024-2037 by Segment, Base Case
Figure 47. GenAI Hardware Market Bull/Base/Bear Scenarios 2024-2037
Figure 48. Sensitivity of 2030 Forecast to Key Variables