Cache
Small, fast memory on the chip that keeps copies of recently used data, so the processor rarely has to wait for slower main memory.
Also: CPU cache, L1 cache, L2 cache, L3 cache, last-level cache
Main memory takes around a hundred nanoseconds to answer, long enough for hundreds of instructions. A cache holds copies of data and instructions the processor has just used or is likely to need, built from fast SRAM next to the cores. Caches come in levels: a small level 1 cache per core answers in a few cycles, a larger level 2 a little slower, and a shared level 3 of tens of megabytes slower still. Programs that reuse data run fast; those that miss the cache often wait. Caches take up a large share of a processor's die.