News
IndustryTSMC’s grip on advanced chipmaking will face competitionIndustryCadence joins European Chip Design Platform to support semiconductor startups and SMEsMaking chipsMarc Hijink on ASML’s Culture, Supply Chain, and GeopoliticsProcessorsIntel's post-Nova Lake CPUs take shape as Razor Lake desktop and laptop variants surfaceAI chipsHow Google’s New AI Chip Software Helps It Battle NvidiaIndiaMore IC Packaging Plants Emerge In IndiaIndustryUS Tightens China AI Chip Access as Nvidia, TSMC and Semiconductor Stocks SlideDesignAxelera AI moves into HPC with TitaniaMaking chipsChinese envoy says chip equipment export curbs threaten EU-China trade thawIndiaSEMICON India 2026 Day 2 Sees 25 MoUs, Strategic Collaborations Across Semiconductor Value ChainIndustryTSMC’s grip on advanced chipmaking will face competitionIndustryCadence joins European Chip Design Platform to support semiconductor startups and SMEsMaking chipsMarc Hijink on ASML’s Culture, Supply Chain, and GeopoliticsProcessorsIntel's post-Nova Lake CPUs take shape as Razor Lake desktop and laptop variants surfaceAI chipsHow Google’s New AI Chip Software Helps It Battle NvidiaIndiaMore IC Packaging Plants Emerge In IndiaIndustryUS Tightens China AI Chip Access as Nvidia, TSMC and Semiconductor Stocks SlideDesignAxelera AI moves into HPC with TitaniaMaking chipsChinese envoy says chip equipment export curbs threaten EU-China trade thawIndiaSEMICON India 2026 Day 2 Sees 25 MoUs, Strategic Collaborations Across Semiconductor Value Chain
EveryChip

AI training and inference

Accelerators for training and running neural networks. 129 chips on EveryChip so far.

AI chips train neural networks and run them, a task called inference. Training a large language model takes thousands of accelerators running for weeks; inference runs every time someone uses the model. Nvidia's data centre GPUs have led since the deep-learning revival of 2012, while Google's TPU, AMD's Instinct, Amazon's Trainium and many start-up chips compete. Phones and laptops now carry small AI engines too.

Training and inference

Training adjusts billions of weights by passing data through the network and back, again and again, so it needs huge amounts of arithmetic and memory bandwidth and fast links between chips. Inference runs the finished model, often at lower precision, and is spread across data centres and devices. Many chip designs specialise in one or the other.

Why Nvidia led

In 2012 a neural network called AlexNet, trained on two Nvidia gaming GPUs, won the ImageNet image recognition contest by a wide margin. Nvidia's CUDA software, available since 2007, made its GPUs the default for researchers. Its A100 (2020), H100 (2022) and Blackwell (2024) chips became the main tools of the AI industry, and demand outran supply in 2023 and 2024.

Famous AI training and inference chips

Further reading

DRIVE Thor 🇺🇸 United StatesDRIVE Thor System-on-chip for autonomous vehicles and robotaxisSoC · Arm AMD Instinct MI350X 🇺🇸 United StatesAMD Instinct MI350X Air-cooled AI accelerator using CDNA4 architecture and 3nm process.AI accelerator · GPU architecture · 2025 Colossus MK2 GC200 🇬🇧 United KingdomColossus MK2 GC200 7nm AI processor chip by GraphcoreAI accelerator · Other · 2026 Blackhole 🇺🇸 United StatesBlackhole AI processor with RISC-V cores and Ethernet scalingAI accelerator · RISC-V · 2023 🇺🇸 United StatesCerebras WSE-2 AI accelerator built from an entire silicon waferAI accelerator · Other AMD Instinct MI300A 🇺🇸 United StatesAMD Instinct MI300A Modular APU combining CPU and GPU tiles for high-performance computing.SoC · x86 · 2023 TPU v2 🇺🇸 United StatesTPU v2 Google AI accelerator chip for machine learning trainingAI accelerator · Other · 2019 TPU v3 🇺🇸 United StatesTPU v3 Google AI accelerator chip with water coolingAI accelerator · Other TPU v5p 🇺🇸 United StatesTPU v5p Google AI accelerator chip for large-scale model trainingAI accelerator · Tensor design Google Tensor G5 🇺🇸 United StatesGoogle Tensor G5 Custom mobile processor for Pixel 10 phonesSoC · Arm · 2025 Hanguang 800 🇨🇳 ChinaHanguang 800 AI inference chip by Alibaba for cloud and edge computingAI accelerator · Other · 2019 Meta MTIA v2 🇺🇸 United StatesMeta MTIA v2 Custom AI inference accelerator for Meta ranking modelsAI accelerator · Other · 2024 Biren BR100 🇨🇳 ChinaBiren BR100 AI GPU for data centre compute workloadsGPU · GPU architecture Dimensity 9400 🇹🇼 TaiwanDimensity 9400 Flagship 5G system on a chip for Android smartphonesSoC · Arm · 2024 RNGD 🇰🇷 South KoreaRNGD 150W AI inference accelerator chip by FuriosaAIAI accelerator · Other · 2024 Qualcomm Cloud AI 100 🇺🇸 United StatesQualcomm Cloud AI 100 AI inference accelerator for data centres and edge devicesAI accelerator · VLIW · 2021 Ampere Altra 🇺🇸 United StatesAmpere Altra 80-core Arm server processor for cloud data centresCPU · Arm · 2020 Telum II 🇺🇸 United StatesTelum II Mainframe processor for IBM z17 with AI accelerationCPU · Other AmpereOne 🇺🇸 United StatesAmpereOne Arm-based server CPU with custom cores for cloud data centres.CPU · Arm · 2023 NorthPole 🇺🇸 United StatesNorthPole Brain-inspired AI inference chip by IBM ResearchAI accelerator · Other Trillium 🇺🇸 United StatesTrillium Google’s sixth-generation AI accelerator chip for training and inference.AI accelerator · Tensor design · 2024 Ironwood 🇺🇸 United StatesIronwood Google's seventh-generation AI accelerator for inference workloadsAI accelerator · Other · 2025 Monaka 🇯🇵 JapanMonaka Arm-based data centre CPU with 3D stackingCPU · Arm · 2027 Power11 🇺🇸 United StatesPower11 RISC server processor for enterprise and AI workloadsCPU · Power · 2025 Grace CPU Superchip 🇺🇸 United StatesGrace CPU Superchip Dual-chip Arm module for AI data centresCPU · Arm · 2023 Ascend 910B 🇨🇳 ChinaAscend 910B AI accelerator chip from HuaweiAI accelerator TPU v5e 🇺🇸 United StatesTPU v5e Google AI accelerator for training and inference workloadsAI accelerator · Tensor design GB10 Grace Blackwell S 🇺🇸 United StatesGB10 Grace Blackwell Superchip AI superchip for desktop workstationsSoC · Arm A100 🇺🇸 United StatesA100 Data centre GPU for AI and high-performance computing.GPU · GPU architecture · 2020 Nvidia B300 🇺🇸 United StatesNvidia B300 AI accelerator with dual-die design and 288 GB memoryGPU · GPU architecture SambaNova SN40L 🇺🇸 United StatesSambaNova SN40L AI inference chip with three-tier memory architectureAI accelerator · Other · 2023 AWS Inferentia 🇺🇸 United StatesAWS Inferentia AI inference chip designed by Amazon Web ServicesAI accelerator · Other AMD Instinct MI325X 🇺🇸 United StatesAMD Instinct MI325X AI accelerator with 256GB HBM3E memoryAI accelerator · GPU architecture AMD Instinct MI355X 🇺🇸 United StatesAMD Instinct MI355X AI accelerator using CDNA 4 architecture on a 3nm process.AI accelerator · GPU architecture · 2025 TPU v4 🇺🇸 United StatesTPU v4 Google AI accelerator chip with 3D mesh networkingAI accelerator · Other AWS Trainium 🇺🇸 United StatesAWS Trainium Custom AI accelerator chip for machine learning trainingAI accelerator · Other · 2021 Loihi 2 🇺🇸 United StatesLoihi 2 Second-generation neuromorphic research processor from Intel LabsAI accelerator · Other Groq LPU 🇺🇸 United StatesGroq LPU AI inference accelerator with deterministic dataflow architectureAI accelerator · Tensor design Ascend 910 🇨🇳 ChinaAscend 910 AI training chip with DaVinci cores and HBM2 memoryAI accelerator · Other · 2019 Wormhole 🇺🇸 United StatesWormhole RISC-V AI accelerator with mesh networkingAI accelerator · RISC-V Sohu 🇺🇸 United StatesSohu Transformer-specific AI accelerator chip by Etched.aiAI accelerator · Other IBM Spyre 🇺🇸 United StatesIBM Spyre AI accelerator chip for IBM Z mainframesAI accelerator · Other · 2024 Dimensity 9300 🇹🇼 TaiwanDimensity 9300 All-Big-Core 5G smartphone system on a chipSoC · Arm · 2023 Dimensity 9500 🇹🇼 TaiwanDimensity 9500 Flagship 5G mobile system on a chip with AI and gaming focusSoC · Arm · 2025 ATOM 🇰🇷 South KoreaATOM AI inference system on a chip by RebellionsAI accelerator · Other Nvidia H20 🇺🇸 United States and 1 moreNvidia H20 AI accelerator chip for the Chinese marketGPU · GPU architecture Nvidia L4 🇺🇸 United StatesNvidia L4 Low-profile data centre GPU for AI and videoGPU · GPU architecture GH200 Grace Hopper Sup 🇺🇸 United StatesGH200 Grace Hopper Superchip Combined Arm CPU and Hopper GPU for AI and HPC workloadsCPU · Arm

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the chip of the day, new pages on EveryChip, and the conferences and anniversaries of the week ahead.