Rambus significantly improves AI performance through 9.6 Gbps HBM3 memory controller IP

Recently, Rambus announced that Rambus HBM3 memory controller IP can now provide up to 9.6 Gbps of performance, which can support the continuous evolution of the HBM3 standard. Compared with the data rate of HBM3 Gen1 6.4 Gbps, the data rate of Rambus HBM3 memory controller is 50% higher, and the total memory throughput is more than 1.2 TB/s. It is suitable for the training of recommendation systems, generative AI, and other demanding data center workloads.  

Neeraj Paliwal, general manager of Rambus IP core department, said: "The big language model requires continuous progress in high-performance memory technology, making HBM3 the preferred memory for AI/ML training. Relying on Rambus's innovation and excellent engineering technology, our HBM3 memory controller IP can provide the industry leading 9.6 Gbps performance."

Soo Kyoum Kim, Vice President of IDC Memory Semiconductor, said, "HBM is a key memory technology for faster and more efficient processing of large AI training and reasoning sets, such as training and reasoning for generative AI. For HBM IP providers like Rambus, continue to improve performance to support leading AI that meets the stringent requirements of the market accelerator Is of great significance. "  

HBM adopts an innovative 2.5D/3D architecture to provide AI accelerators with solutions with high memory bandwidth and low power consumption. With extremely low latency and compact packaging, HBM has become the first choice of AI training hardware.  

Rambus HBM3 memory controller IP is designed for applications that require high memory throughput, low latency, and full programmability. The controller is a highly configurable modular solution that can be customized according to each customer's unique requirements for size and performance. For customers who choose the third party HBM3 PHY, Rambus also provides integration and verification services for HBM3 controllers.

The Rambus HBM3 memory controller is now licensed.

This article is an original article. If it is reproduced, please indicate the source: Rambus significantly improves AI performance through 9.6 Gbps HBM3 memory controller IP https://stor.zol.com.cn/845/8457938.html