News
EveryChip

Data centres and servers

Xeon, EPYC, Graviton, H100 and the chips of the cloud. 296 chips on EveryChip so far.

Data centres and cloud servers use the largest and most power-hungry chips: server CPUs with up to a few hundred cores, AI accelerators drawing 700 W to over 1,000 W each, network chips and DPUs, and huge amounts of memory. Intel's Xeon and AMD's Epyc dominate general-purpose servers, while Arm designs such as Amazon's Graviton have grown fast. Nvidia's GPUs lead in AI.

Server CPUs

A server processor is built for many tasks at once and for long, reliable running. It supports large amounts of error-correcting memory, many PCIe lanes for storage and network cards, and two or more sockets on one board. AMD's Epyc, launched in 2017, used chiplets to fit more cores than single-die designs, and took a large share of the market from Intel's Xeon.

Custom cloud chips

The largest cloud companies now design their own chips. Amazon has Graviton CPUs and Trainium and Inferentia AI chips, Google its TPU and Axion CPU, and Microsoft its Cobalt CPU and Maia accelerator. They buy fewer standard parts this way and tune chips to their own software. The power used by AI servers has become a constraint on where data centres can be built.

Famous data centres and servers chips

Still to be written: AWS Graviton.

Further reading

🇺🇸 United StatesTensor Processing Unit Google custom chip for neural network machine learningAI accelerator · Other · 2015 SambaNova SN40L 🇺🇸 United StatesSambaNova SN40L AI inference chip with three-tier memory architectureAI accelerator · Other · 2023 AWS Inferentia 🇺🇸 United StatesAWS Inferentia AI inference chip designed by Amazon Web ServicesAI accelerator · Other TPU v4 🇺🇸 United StatesTPU v4 Google AI accelerator chip with 3D mesh networkingAI accelerator · Other AWS Trainium 🇺🇸 United StatesAWS Trainium Custom AI accelerator chip for machine learning trainingAI accelerator · Other · 2021 Ascend 910 🇨🇳 ChinaAscend 910 AI training chip with DaVinci cores and HBM2 memoryAI accelerator · Other · 2019 Sohu 🇺🇸 United StatesSohu Transformer-specific AI accelerator chip by Etched.aiAI accelerator · Other IBM Spyre 🇺🇸 United StatesIBM Spyre AI accelerator chip for IBM Z mainframesAI accelerator · Other · 2024 ATOM 🇰🇷 South KoreaATOM AI inference system on a chip by RebellionsAI accelerator · Other Maia 100 🇺🇸 United StatesMaia 100 Microsoft's first in-house AI accelerator chip for Azure cloud.AI accelerator · Other · 2023 Intel Gaudi 3 🇺🇸 United StatesIntel Gaudi 3 AI accelerator chip using Ethernet for scalingAI accelerator · Other · 2024 Inferentia2 🇺🇸 United StatesInferentia2 Second-generation AI inference accelerator from AWSAI accelerator · Other Gaudi 2 🇺🇸 United States and 1 moreGaudi 2 AI training accelerator chip by IntelAI accelerator · Other · 2022 Intel Gaudi 🇺🇸 United StatesIntel Gaudi AI accelerator series from Intel for training and inference workloads.AI accelerator · Other · 2024 Trainium3 🇺🇸 United StatesTrainium3 Fourth-generation AI accelerator chip from AWSAI accelerator · Other · 2025 🇺🇸 United StatesCerebras WSE-3 Turbo Wafer-scale AI processor with 4 trillion transistorsAI accelerator · Other · 2026 Colossus MK2 GC200 🇬🇧 United KingdomColossus MK2 GC200 7nm AI processor chip by GraphcoreAI accelerator · Other · 2026 🇺🇸 United StatesCerebras WSE-2 AI accelerator built from an entire silicon waferAI accelerator · Other TPU v2 🇺🇸 United StatesTPU v2 Google AI accelerator chip for machine learning trainingAI accelerator · Other · 2019 TPU v3 🇺🇸 United StatesTPU v3 Google AI accelerator chip with water coolingAI accelerator · Other Hanguang 800 🇨🇳 ChinaHanguang 800 AI inference chip by Alibaba for cloud and edge computingAI accelerator · Other · 2019 Meta MTIA v2 🇺🇸 United StatesMeta MTIA v2 Custom AI inference accelerator for Meta ranking modelsAI accelerator · Other · 2024 RNGD 🇰🇷 South KoreaRNGD 150W AI inference accelerator chip by FuriosaAIAI accelerator · Other · 2024 Telum II 🇺🇸 United StatesTelum II Mainframe processor for IBM z17 with AI accelerationCPU · Other Ironwood 🇺🇸 United StatesIronwood Google's seventh-generation AI accelerator for inference workloadsAI accelerator · Other · 2025 Ascend 910C 🇨🇳 ChinaAscend 910C AI accelerator chip by Huawei for data centresAI accelerator · Other Trainium2 🇺🇸 United StatesTrainium2 AWS second-generation AI training accelerator chipAI accelerator · Other · 2024 WorldElectrochemical RAM Non-volatile memory for analog deep learning accelerationMemory · Other

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the chip of the day, new pages on EveryChip, and the conferences and anniversaries of the week ahead.