Rambus HBM3 Controller IP Gives AI Training a New Boost
As AI continues to grow in reach and complexity, the unrelenting demand for more memory requires the constant advancement of high-performance memory IP solutions. We’re pleased to announce that our HBM3 Memory Controller now enables an industry-leading memory throughput of over 1.23 Terabytes per second (TB/s) for training recommender systems, generative AI and other compute-intensive AI workloads.
According to OpenAI, the amount of compute used in the largest AI training has increased at a rate of 10X per year since 2012, and this is showing no signs of slowing down any time soon! The growth of AI training data sets is being driven by a number of factors. These include complex AI models, vast amounts of online data being produced and made available, as well as a continued desire for more accuracy and robustness of AI models.
OpenAI’s very own ChatGPT, the most talked about large language model (LLM) of this year, is a great example to illustrate the growth of AI data sets. When it was first released to the public in November 2022, GPT-3 was built using 175 billion parameters. GPT-4, released just a few months after, is reported to use upwards of 1.5 trillion parameters. This staggering growth illustrates just how large data sets are becoming in such a short period of time.
Related Semiconductor IP
- HBM3 PHY V2 - TSMC N3E
- HBM3 PHY V2 (Hard) - TSMC N3P
- HBM3 PHY - TSMC N6
- HBM3 PHY - TSMC N5 1.2V
- HBM3 PHY (Hard 1) - TSMC N6
Related Blogs
- Rambus LPDDR5T/5X/5 Controller IP Turbocharges AI Inference Performance to 9.6 Gbps
- PCIe 5.0 Controller IP on FPGAs: Current and Future Use Cases
- Rambus Achieves PCI Express® (PCIe®) 5.0 Compliance for PCIe 5.0 Controller IP and Inspector PCIe 5.0 Interposer with Diagnostic IP
- New CXL 3.1 Controller IP for Next-Generation Data Centers
Latest Blogs
- Why Choose Hard IP for Embedded FPGA in Aerospace and Defense Applications
- Migrating the CPU IP Development from MIPS to RISC-V Instruction Set Architecture
- Quintauris: Accelerating RISC-V Innovation for next-gen Hardware
- Say Goodbye to Limits and Hello to Freedom of Scalability in the MIPS P8700
- Why is Hard IP a Better Solution for Embedded FPGA (eFPGA) Technology?