Definition: High Bandwidth Memory (HBM) is a type of fast, stacked memory used to increase data transfer rates between memory and processors, especially in GPUs.
Explanation
High Bandwidth Memory (HBM) is a memory technology designed to provide significantly higher bandwidth while using less power in a smaller physical footprint compared to traditional memory types like DDR or GDDR. It achieves this by stacking memory chips vertically and connecting them with an ultra-wide interface, allowing GPUs and other processors to access data much faster. HBM is critical in AI and high-performance computing where rapid data movement is essential to keep processors fully utilized.
Example
Modern GPUs use HBM to quickly access large datasets required for AI workloads. For instance, an AI accelerator with HBM can process massive amounts of data in parallel without being bottlenecked by slower memory access, enabling faster training and inference times.
Who This Is For
This term is especially relevant for hardware engineers, AI researchers, system architects, and IT professionals involved in designing or optimizing high-performance computing systems and AI infrastructure.
Related Terms
GPU, DRAM, Storage Class Memory, NAND flash, High Bandwidth Flash, AI accelerator
Also Known As
High Bandwidth Memory