NVIDIA· AI platformInfrastructure

NVIDIA NVLink Fusion Expands With NVHBM Custom High-Bandwidth Memory

NVIDIA announced NVHBM, a custom high-bandwidth memory technology that integrates the memory controller into the HBM stack, delivering up to 30% greater memory bandwidth, 15% lower power consumption, and freeing up to 25% more area on XPU compute die. It expands the NVLink Fusion platform and will be validated by memory partners. Amazon's Annapurna Labs will be the first to work on NVHBM.

From the source

To help hyperscalers and AI innovators build the next generation of semi-custom AI infrastructure, NVIDIA today expanded NVIDIA NVLink Fusion with NVIDIA NVHBM , a next-generation high-bandwidth memory technology that brings higher memory performance and efficiency to XPUs. It will be validated and offered by leading memory partners, extending this advanced memory capability to NVLink Fusion customers. Traditional HBM architectures place the memory controller on the XPU die, consuming valuable silicon area that could otherwise be dedicated to compute. NVHBM, built on the same technology that NVIDIA will use for future GPUs, integrates NVIDIA’s custom memory controller into the HBM base die. By integrating the memory controller into the 3D HBM stack instead of the XPU, NVHBM delivers up to 30% greater memory bandwidth and 15% lower HBM power consumption, and frees up to 25% more area on XPU compute die compared with standard HBM4E.

blogs.nvidia.com