The Era of 136 Cores: Arm Unveils Its First Processor for Agentic AI

British tech giant Arm has made a major shift from licensing designs to releasing its own product. The AGI CPU processor is a powerful solution designed for complex AI agents and massive data workloads.

Specifications

The new chip is built on the Neoverse V3 architecture and manufactured using a 3 nm process. It features 136 cores, each handling a separate data stream, minimizing latency and performance drops under sustained workloads.

The processor stands out in memory and connectivity:

• Supports up to 6 TB of DDR5-8800 memory per chip.
• Delivers latency under 100 ns with a bandwidth of 6 GB/s per core,
• Includes 96 PCIe Gen 6 lanes and supports the latest CXL 3.0 and AMBA CHI protocols.

Despite its high performance, the chip maintains moderate power consumption with a TDP of 300W, which is critical for dense server rack deployments.

How This Processor Can Reduce Costs

Arm claims that x86 architecture is becoming too expensive for modern AI workloads. According to the company, the AGI CPU allows up to 45,000 cores per rack (with liquid cooling), which is roughly double the capacity of competing solutions.

This level of efficiency could save large data center operators up to $10 billion per gigawatt of power consumption. Arm positions the chip as an ideal “orchestrator,” handling task scheduling and data movement, freeing up specialized AI accelerators.

Early Adoption

Meta is the lead partner, integrating AGI CPU into its infrastructure alongside its MTIA accelerators. Confirmed future adopters include OpenAI, Cloudflare, SAP, and SK Telecom.

Wider deployment of AGI CPU-based systems in data centers is expected in the second half of this year.