📡 IEEE Spectrum AI🟢
INDUSTRY
🌍 World
⚡ 43s read
13 Sep 2026
The CPU Comeback Is Upon Us
Earlier this year, leaders at Amazon Web Services delivered a new mandate to their engineers: They need to con...
⚡ Earlier this year, leaders at Amazon Web Services delivered a new mandate to their engineers: They need to conserve CPU cycles at all costs.
Earlier this year, leaders at Amazon Web Services delivered a new mandate to their engineers: They need to conserve CPU cycles at all costs. AWS has reportedly experienced an explosion in wait times for CPU server capacity as AI workloads strain the company’s cloud infrastructure. The issue seemingly took AWS off guard, and for good reason. The AI boom led to a surge in demand for GPUs and, later, memory . CPUs were mostly left out of the story, as their relative lack of parallelization made them a poor fit for AI model inference, the process of running and serving large language models (LLM) to users. But the rise of agentic AI systems, which allow AI models to operate autonomously and call on sub-agents, is changing the narrative. Matt Kimball , vice president and principal data center a