News
EveryChip

Data centres and servers

Xeon, EPYC, Graviton, H100 and the chips of the cloud. 296 chips on EveryChip so far.

Data centres and cloud servers use the largest and most power-hungry chips: server CPUs with up to a few hundred cores, AI accelerators drawing 700 W to over 1,000 W each, network chips and DPUs, and huge amounts of memory. Intel's Xeon and AMD's Epyc dominate general-purpose servers, while Arm designs such as Amazon's Graviton have grown fast. Nvidia's GPUs lead in AI.

Server CPUs

A server processor is built for many tasks at once and for long, reliable running. It supports large amounts of error-correcting memory, many PCIe lanes for storage and network cards, and two or more sockets on one board. AMD's Epyc, launched in 2017, used chiplets to fit more cores than single-die designs, and took a large share of the market from Intel's Xeon.

Custom cloud chips

The largest cloud companies now design their own chips. Amazon has Graviton CPUs and Trainium and Inferentia AI chips, Google its TPU and Axion CPU, and Microsoft its Cobalt CPU and Maia accelerator. They buy fewer standard parts this way and tune chips to their own software. The power used by AI servers has become a constraint on where data centres can be built.

Famous data centres and servers chips

Still to be written: AWS Graviton.

Further reading

Hanguang 800 🇨🇳 ChinaHanguang 800 AI inference chip by Alibaba for cloud and edge computingAI accelerator · Other · 2019 Meta MTIA v2 🇺🇸 United StatesMeta MTIA v2 Custom AI inference accelerator for Meta ranking modelsAI accelerator · Other · 2024 Biren BR100 🇨🇳 ChinaBiren BR100 AI GPU for data centre compute workloadsGPU · GPU architecture RNGD 🇰🇷 South KoreaRNGD 150W AI inference accelerator chip by FuriosaAIAI accelerator · Other · 2024 Qualcomm Cloud AI 100 🇺🇸 United StatesQualcomm Cloud AI 100 AI inference accelerator for data centres and edge devicesAI accelerator · VLIW · 2021 Telum II 🇺🇸 United StatesTelum II Mainframe processor for IBM z17 with AI accelerationCPU · Other Trillium 🇺🇸 United StatesTrillium Google’s sixth-generation AI accelerator chip for training and inference.AI accelerator · Tensor design · 2024 Ironwood 🇺🇸 United StatesIronwood Google's seventh-generation AI accelerator for inference workloadsAI accelerator · Other · 2025 TPU v5p 🇺🇸 United StatesTPU v5p Google AI accelerator chip for large-scale model trainingAI accelerator · Tensor design TPU v5e 🇺🇸 United StatesTPU v5e Google AI accelerator for training and inference workloadsAI accelerator · Tensor design GB10 Grace Blackwell S 🇺🇸 United StatesGB10 Grace Blackwell Superchip AI superchip for desktop workstationsSoC · Arm A100 🇺🇸 United StatesA100 Data centre GPU for AI and high-performance computing.GPU · GPU architecture · 2020 Nvidia B300 🇺🇸 United StatesNvidia B300 AI accelerator with dual-die design and 288 GB memoryGPU · GPU architecture SambaNova SN40L 🇺🇸 United StatesSambaNova SN40L AI inference chip with three-tier memory architectureAI accelerator · Other · 2023 AWS Inferentia 🇺🇸 United StatesAWS Inferentia AI inference chip designed by Amazon Web ServicesAI accelerator · Other AMD Instinct MI325X 🇺🇸 United StatesAMD Instinct MI325X AI accelerator with 256GB HBM3E memoryAI accelerator · GPU architecture AMD Instinct MI355X 🇺🇸 United StatesAMD Instinct MI355X AI accelerator using CDNA 4 architecture on a 3nm process.AI accelerator · GPU architecture · 2025 TPU v4 🇺🇸 United StatesTPU v4 Google AI accelerator chip with 3D mesh networkingAI accelerator · Other Ascend 910C 🇨🇳 ChinaAscend 910C AI accelerator chip by Huawei for data centresAI accelerator · Other ET-SoC-1 🇺🇸 United StatesET-SoC-1 RISC-V system on a chip for AI inferenceAI accelerator · RISC-V Trainium2 🇺🇸 United StatesTrainium2 AWS second-generation AI training accelerator chipAI accelerator · Other · 2024 🇺🇸 United StatesHopper Nvidia datacentre GPU microarchitecture for AI and high-performance computing.GPU · GPU architecture · 2022 WorldElectrochemical RAM Non-volatile memory for analog deep learning accelerationMemory · Other 🇺🇸 United StatesBlackwell Nvidia GPU microarchitecture for AI and gamingGPU · GPU architecture · 2024

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the chip of the day, new pages on EveryChip, and the conferences and anniversaries of the week ahead.