Rubin Ultra: A New GPU Chip with 1 TB of Memory

NVIDIA recently announced details about its new Rubin Ultra GPU solution. The company showcased a chip featuring four compute chiplets and 1 TB of memory. The release is currently scheduled for 2027.

Details regarding Rubin Ultra

According to the released information, the new platform will be based on the Kyber architecture, which is expected to significantly enhance performance. The demonstration shows that the Rubin Ultra package utilizes a new packaging technology; however, there is no information yet available on the exact implementation of the GPU. It is also unknown whether the chip has already passed the final stage of development or not.

Since the Rubin Ultra tray is nearly cable-free, server assembly could be significantly simplified. There is a high probability that NVIDIA will sell ready-made tray modules. The company is also introducing a new type of Kyber racks, which will use liquid cooling and feature a vertical layout.

NVIDIA is preparing for significant scaling of Rubin Ultra-based clusters. For example, an NVL576-class-like system can accommodate 12,000 CPU cores and 576 GPUs, forming a single cluster with a performance of up to 15 exaflops (FP4). Thus, full-fledged AI factories capable of processing massive models within a single data center will be available in the very near future.

Hope you found this article helpful - what do you think? Like and subscribe to our blog to get more practical tips and the latest tech news from HostZealot.