Anniversaries, 22 Mar 2027
Nvidia H100 announced (2022)
On 22 March 2022 Nvidia announced the H100 GPU, built on its Hopper architecture, which became the workhorse of the AI boom.
Announced at Nvidia's GTC conference, the H100 has 80 billion transistors on TSMC's 4N process, HBM3 memory beside the die in TSMC's CoWoS packaging, and tensor cores that added the 8-bit FP8 number format. Its Transformer Engine was built for the kind of neural network behind large language models. Demand after the release of ChatGPT in late 2022 far outstripped supply. Its sale to China was restricted by United States export rules, which led Nvidia to offer cut-down versions there.