High Bandwidth Memory (HBM) provides stacked DRAM with much higher bandwidth than DDR
Image: Erik Christensen, CC BY-SA 3.0, via Wikimedia Commons
HBM (High Bandwidth Memory) provides: stacked DRAM with much higher bandwidth than DDR
High Bandwidth Memory (HBM) provides stacked DRAM with much higher bandwidth than DDR
Related concepts
2024–present global memory supply shortage
Global DRAM shortage began in 2024
NVIDIA's H100 has: 80GB HBM3, 3.35TB/s bandwidth, 990 TFLOPS FP16
NVIDIA H100 features: 80GB HBM3, 3.35TB/s bandwidth, 990 TFLOPS FP16
Delay-line memory
CPU speed grows faster than memory speed
NVIDIA's A100 has: 80GB HBM2e, 2TB/s bandwidth, 312 TFLOPS FP16
NVIDIA's A100 features: 80GB HBM2e, 2TB/s bandwidth, 312 TFLOPS FP16
Von Neumann architecture
CPU must fetch both data and instructions from memory
Memory hierarchy
Memory hierarchy levels: registers → L1 → L2 → L3 → RAM → SSD → HDD (each ~10× slower)
One email a day: 5 concepts + the 5 stories that matter →
Swipe through 100 ML concepts daily
Open TickerNews