What's Different About HBM4

Memory bandwidth is limiting the flow of huge datasets that are needed to train AI models. There is much more data to process, store, and retrieve, but the speed at which that data moves through high-bandwidth memory (HBM) stacks is significantly lower than the speed at which data can be processed. Frank Ferro, group director for product management at Cadence, talks with Semiconductor Engineering about the new HBM4 standard, how it compares with HBM3, and what will be needed to meet the insatiable demands of hyperscaler data centers in the future.

×
Semiconductor IP