Networking and DPUs
Ethernet switch chips, NICs, BlueField and other DPUs, Tomahawk and the silicon of the data centre network. 9 chips on EveryChip so far.
Networking chips move data between computers. Ethernet controllers and network interface cards connect a server to the network; switch chips at the top of a rack forward packets between hundreds of ports; and data processing units (DPUs) add processor cores to the network card to handle security, storage and virtual networks. In AI data centres the network decides how well thousands of accelerators can work as one machine.
Switch chips and NICs
A data centre switch chip has many high-speed serial links, each carrying hundreds of gigabits a second, and logic that reads each packet's address and sends it to the right port in well under a microsecond. Broadcom's switch chips are widely used, alongside Nvidia's (from Mellanox), Marvell's and Cisco's. A network interface card (NIC) does the same job for one server, handing packets directly to its memory.
DPUs and AI networks
A DPU, such as Nvidia's BlueField, combines a fast NIC with Arm cores and accelerators, so the server's main CPU no longer spends time on encryption, storage traffic or virtual switches. For AI training, InfiniBand and newer Ethernet designs link GPUs with very low delay, and optical transceivers carry the signals over fibre. Co-packaged optics, which put the optics beside the switch chip, are a current area of work.
Famous network chip chips
Further reading
Photo credits on this page
The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.
- Transputer: NobbiP, CC BY-SA 3.0, source
- Am7990: Phiarc, CC BY-SA 4.0, source
- TI-AR7: Raimond Spekking, CC BY-SA 4.0, source