Improving AI Inference with AMD EPYC Host CPUs | Signal65 Webcast скачать в хорошем качестве

Improving AI Inference with AMD EPYC Host CPUs | Signal65 Webcast

00:01:00 - The Role of CPUs in AI Compute 00:03:00 - High-Performance CPUs for AI Workloads 00:05:00 - Different CPU Requirements for AI Workloads 00:06:30 - Testing CPU Performance in AI 00:08:00 - Impact of CPU on AI Model Performance 00:10:00 - Trends in AI Performance Bottlenecks 00:11:30 - Financial Benefits of CPU Selection 00:13:00 - Power and Space Efficiency in Data Centers 00:14:30 - Guidance for AI Infrastructure Investment 00:16:00 - AMD's Comprehensive AI Solutions AI performance gains are increasingly determined by what happens before and after the GPU. In this Signal65 webcast, Ryan Shrout, Russ Fellows, and Mitch Lewis are joined by Madhu Rangarajan, Corporate VP, Compute and Enterprise AI Products at AMD, and Curt Waltman, Senior Director, Compute and Enterprise AI Products at AMD, to explore how AMD EPYC processors are improving AI inference performance in enterprise environments. As AI workloads move from experimentation to production, the efficiency and scalability of the host platform become critical. This discussion breaks down how EPYC CPUs support AI acceleration, optimize data movement, and deliver measurable performance improvements in real-world deployments. Key Takeaways: 🔹 Inference is infrastructure-bound: AI performance is heavily influenced by host CPU architecture, not just accelerators. 🔹 Data movement is a bottleneck: Memory bandwidth, I/O, and interconnects significantly impact AI workload efficiency. 🔹 CPU + GPU synergy matters: Optimizing inference requires tight integration between EPYC CPUs and AI accelerators. 🔹 Enterprise AI requires balance: Power efficiency, core density, and scalability determine real-world deployment success. 🔹 Platform-level optimization wins: AI performance is achieved through system-level engineering, not component-level thinking. To understand how EPYC CPUs are shaping AI inference performance in enterprise data centers: https://www.amd.com/en.html Read the Signal65 research paper: https://signal65.com/research/ai/impr... #AMD #AIInference #CPUs #GPUs #Infrastructure #PerformanceAnalysis Disclaimer: Six Five Media is for information and entertainment purposes only. Over the course of this webcast, we may talk about companies that are publicly traded, and we may even reference that fact and their equity share price, but please do not take anything that we say as a recommendation about what you should do with your investment dollars. We are not investment advisors, and we ask that you do not treat us as such.