Servers with Nvidia’s First Arm Chip are Anticipated in 2023

Nvidia unveiled new graphics processing units intended for use in data centers. The company also announced the imminent release of its Grace and Grace Hopper "superchips". The superchips are aimed at even higher-performance data center use. They will be used to drive the next generation of Artificial Intelligence (AI) and Machine Learning (ML).

The first generation of products using these new chips are now in development from Nvidia's hardware partners including Asus, Foxconn, Gigabyte, QCT, Supermicro, and Wiwynn, according to Nvidia.

The new server portfolio includes configurable, modular, and scalable systems for AI training, inference, and high performance computing, paired with Nvidia's Bluefield-3 data processing units, programmable circuits used for data acceleration not suited for GPUs.

Making efforts to improve data center sustainability Arm's chip architecture in Grace Hopper "Superchips" promise significantly improved efficiency compared to x86 designs, but that doesn't mean Nvidia is sitting still when it comes to "Greening" its current products.

Nvidia said the new cards are the first data center PCIe-based GPU it's made with direct-chip cooling.

"In separate tests, both Equinix and Nvidia found a data center using liquid cooling could run the same workloads as an air-cooled facility while using about 30 percent less energy. Nvidia estimates the liquid-cooled data center could hit 1.15 PUE , far below 1.6 for its air-cooled cousin," said the company.

With the A100 getting the liquid-cooling treatment, Nvidia said that its next target is the H100 Tensor Core GPU, the A100's far more powerful cousin.

"We plan to support liquid cooling in our high-performance data center GPUs and our NVIDIA HGX platforms for the foreseeable future," said Nvidia.

Source: RCR Wireless