Scaling AI Infrastructure with Next-Gen Interconnects
April 29, 2025
At the recent IPSoC Conference in Silicon Valley, Aparna Tarde gave a talk on the importance of Next-Gen Interconnects to scale AI infrastructure. Aparna is a Sr. Technical Product Manager at Synopsys. A synthesis of the salient points from her talk follows.
Key Takeaways
- The rapid advancement of AI is reshaping data center infrastructure requirements, demanding immense compute resources and unprecedented memory capacity.
- Efficient XPU-to-XPU communication is crucial, requiring high-bandwidth, low-latency, and energy-efficient interconnects for large-scale compute clusters.
- New communication protocols and interfaces like UALink and Ultra Ethernet are essential for scaling AI performance and accommodating distributed AI models.
- The shift from copper to optical links and the adoption of Co-Packaged Optics (CPO) are key to addressing bandwidth challenges in AI infrastructure.
- Multi-die packaging technologies are becoming mainstream to meet AI workloads' demands for low latency, high bandwidth, and efficient interconnects.
Related Semiconductor IP
- USB 3.0 and PCIe 2.0 Combo PHY
- PCIe PHY and controller solution
- PCIe Controller
- PCIe 4.0 Controller
- PCIe 6.0 PHY, SS SF2A x4 1.2V, N/S for Automotive, ASIL B Random, AEC-Q100 Grade 2
Related Blogs
- Arm and Google Cloud redefine agentic AI infrastructure with Axion processors
- Ultra Ethernet Consortium Set to Enable Scaling of Networking Interconnects for AI and HPC
- Scaling Out Deep Learning (DL) Inference and Training: Addressing Bottlenecks with Storage, Networking with RISC-V CPUs
- The Road to Innovation with Synopsys 224G PHY IP From Silicon to Scale: Synopsys 224G PHY Enables Next Gen Scaling Networks
Latest Blogs
- CDM Dependence on Device Capacitance
- What the Cyber Resilience Act means for the future of chip design
- When Your IP Vendor Has Operated 150,000 Base Stations: Introducing Viettel Semiconductor
- Relationship between architecture and validation in system design
- The Post-Quantum Cryptography Mandate: Building Cryptographically Agile Systems for the Quantum Era