Data centres and servers
Xeon, EPYC, Graviton, H100 and the chips of the cloud. 296 chips on EveryChip so far.
Data centres and cloud servers use the largest and most power-hungry chips: server CPUs with up to a few hundred cores, AI accelerators drawing 700 W to over 1,000 W each, network chips and DPUs, and huge amounts of memory. Intel's Xeon and AMD's Epyc dominate general-purpose servers, while Arm designs such as Amazon's Graviton have grown fast. Nvidia's GPUs lead in AI.
Server CPUs
A server processor is built for many tasks at once and for long, reliable running. It supports large amounts of error-correcting memory, many PCIe lanes for storage and network cards, and two or more sockets on one board. AMD's Epyc, launched in 2017, used chiplets to fit more cores than single-die designs, and took a large share of the market from Intel's Xeon.
Custom cloud chips
The largest cloud companies now design their own chips. Amazon has Graviton CPUs and Trainium and Inferentia AI chips, Google its TPU and Axion CPU, and Microsoft its Cobalt CPU and Maia accelerator. They buy fewer standard parts this way and tune chips to their own software. The power used by AI servers has become a constraint on where data centres can be built.
Famous data centres and servers chips
Still to be written: AWS Graviton.
Further reading
🇺🇸 United StatesClipper
32-bit RISC-like CPU architecture by Fairchild and IntergraphCPU · RISC · 1986
🇺🇸 United StatesDEC Alpha
A 64-bit RISC architecture by Digital Equipment CorporationCPU · RISC · 1992
Photo credits on this page
The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.
- Epyc: Smial ( talk ), FAL, source
- Granite Rapids: Intel Corporation, Public domain, source
- MC88100: Pauli Rautakorpi, CC BY 3.0, source
- Clipper: Unknown author, CC BY-SA 3.0, source
- PA-7100: Konstantin Lanzet (with permission), CC BY-SA 3.0, source
- Tensor Processing Unit: Norman P. Jouppi, George Kurian, Sheng Li, Peter Ma, Rahul Nagarajan,, CC BY 4.0, source
- PA-7200: Thomas Schanz, CC BY-SA 4.0, source
- PA-8000: Thomas Schanz, CC BY-SA 4.0, source
- MC88110: Konstantin Lanzet, GFDL, source
- Alpha 21264: htomari, CC BY-SA 2.0, source
- Alpha 21064: Dirk Oppelt, CC BY-SA 3.0, source
- IBM Power: Henriok, CC0, source
- Hopper: 极客湾Geekerwan, CC BY 3.0, source