News
DesignAdvancing chip design with OpenAI modelsDesignEMASS Launches ECS-Studio Development Suite for ECS-DoT Edge AIIndiaSmart Silicon: Building India’s Semiconductor Capabilities Through AIIndiaTata Electronics flags supply chain, talent gaps in ₹1.18 lakh crore semiconductor pushIndustryTSMC’s grip on advanced chipmaking will face competitionIndustryCadence joins European Chip Design Platform to support semiconductor startups and SMEsMaking chipsEurope plans to catch the next computer chip waveProcessorsAMD CES 2027 Invite Hints at Possible Ryzen Zen 6 "Olympic Ridge" RevealMaking chipsMarc Hijink on ASML’s Culture, Supply Chain, and GeopoliticsProcessorsIntel's post-Nova Lake CPUs take shape as Razor Lake desktop and laptop variants surfaceDesignAdvancing chip design with OpenAI modelsDesignEMASS Launches ECS-Studio Development Suite for ECS-DoT Edge AIIndiaSmart Silicon: Building India’s Semiconductor Capabilities Through AIIndiaTata Electronics flags supply chain, talent gaps in ₹1.18 lakh crore semiconductor pushIndustryTSMC’s grip on advanced chipmaking will face competitionIndustryCadence joins European Chip Design Platform to support semiconductor startups and SMEsMaking chipsEurope plans to catch the next computer chip waveProcessorsAMD CES 2027 Invite Hints at Possible Ryzen Zen 6 "Olympic Ridge" RevealMaking chipsMarc Hijink on ASML’s Culture, Supply Chain, and GeopoliticsProcessorsIntel's post-Nova Lake CPUs take shape as Razor Lake desktop and laptop variants surface
EveryChip

AI accelerators

H100, B200, MI300X, the TPU, Trainium, Gaudi, Cerebras WSE and the NPUs of phones and laptops. 96 chips on EveryChip so far.

An AI accelerator is a chip designed to train or run neural networks, the layered models behind image recognition, speech and large language models. Most of that work is multiplying large tables of numbers, called matrices. Accelerators pack in thousands of multiply units, feed them from fast memory and use low-precision number formats that save power. Nvidia's data centre GPUs, Google's TPU and many start-up chips belong here.

What makes them fast

A neural network layer multiplies a matrix of inputs by a matrix of learned weights. Accelerators have dedicated matrix units, such as Nvidia's tensor cores or the systolic array of Google's TPU, in which numbers flow through a grid of multipliers. They use formats with fewer bits, such as 16-bit, 8-bit and even 4-bit numbers, so each operation costs less energy and more fit on the chip.

Memory and networks matter as much

A large model has billions of weights that must be read again and again. That is why AI accelerators sit beside stacks of High Bandwidth Memory, and why training clusters link thousands of chips with fast networks. Nvidia's H100 of 2022 has 80 billion transistors; its Blackwell B200 joins two dies with 208 billion. Demand for these chips since 2023 has strained supplies of HBM and advanced packaging.

Famous AI accelerator chips

Further reading

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the chip of the day, new pages on EveryChip, and the conferences and anniversaries of the week ahead.