Understanding the Infrastructure Requirements for AI Workloads Artwork

Network Connections

A Podcast About ICT Networks. *Presented by Siemon* Established in 1903, Siemon is an industry leader specializing in the manufacture and innovation of high quality, high-performance network cabling solutions. Headquartered in Connecticut, USA, with global offices, manufacturing and service partners throughout the world, Siemon offers the most comprehensive suite of copper and fiber cabling systems and services available. With over 400 active patents specific to structured cabling, from patch cords to patch panels, Siemon Labs invests heavily in R&D and development of industry standards, underlining the company's long-term commitment to its customers and the industry. www.siemon.com

All Episodes

Network Connections

Understanding the Infrastructure Requirements for AI Workloads

August 26, 2024 • Siemon

On today’s episode we get into the infrastructure required to support AI workloads. We discuss key considerations including bandwidth, the substantial power and cooling requirements of AI infrastructure, and GPUs. We also talk about InfiniBand and Ethernet as network fabrics for AI workloads, cabling considerations, and more.

Episode Guest: Gary Bernstein, Sr. Director of Global Data Center Sales, The Siemon Company

Gary Bernstein is currently Sr. Director of Global Data Center Sales for The Siemon Company, previously he was a Global Data Center Solutions Specialist. He was with Leviton for over fourteen years, serving as a Sr. Director of Product Management and before that he was a Director of Product Marketing with HellermannTyton. He holds a BS in Mechanical Engineering from Arizona State University and continues to learn, most recently earning the NVIDIA Certified Associate – AI in the Data Center certification.

Episode Links:

The Siemon Company

Siemon and AI