Arm AGI Takes Aim at AMD: Nearly Twice the AI Power in One Server Rack

There is an exciting message from Arm about the data center sector. The recently introduced AGI CPU can offer almost double the performance per server rack compared to AMD’s EPYC 9755 as indicated by benchmarks done by Arm and independently analyzed by Signal65.

The benchmarks were conducted on seven workloads that are relevant to AI agents, including database transactions, web servers, software development, and AI model serving. This is relevant to the scenario where AI agents use tools, seek information, and perform tasks with minimum human involvement.

Arm’s processors won five of seven individual chip tests. They performed particularly well in fastText, where AGI achieved a 97% advantage over AMD. However, AMD remained ahead in MySQL and Milvus throughput.

The bigger difference appeared at rack level. Arm’s modeled results showed an average performance advantage of 1.99 times across all seven workloads.

Why Rack Density Changes the Competition

The power consumption provides a possible explanation for this result. According to Arm’s estimations, a 24 kW rack may contain up to 23 AGI servers of Arm, which is three times the number of AMD servers, 13. This way, operators of data centers would be able to do more AI tasks without increasing the size of their physical facility.

The independent verification done by Signal65 showed an accuracy within 0.5% from the results presented by Arm. Nevertheless, the verification was made only on the basis of tests performed by Arm.

Our Take

We think that the findings from Arm can show a significant change in the way that corporations need to judge server CPUs. The clock speed of the chip is important, but performance-per-watt and performance-per-rack could also be equally important. This could allow data centers to manage their energy costs and run more artificial intelligence agents without taking up more room.

However, it will only be the actual implementation of these systems that will show whether these improvements become sustainable.

Enjoyed this article? Share it with your colleagues and follow our social channels for more technology insights. Explore our other articles to discover how AI is reshaping the hardware behind tomorrow’s digital services.