Nvidia unveils superchip DGX SuperPOD to power AI

19 Mar 2024

Tech giant Nvidia on Monday unveiled the  Blackwell-Powered DGX SuperPOD, a new family of GPU chips for powering Generative AI supercomputing, in a move to consolidate its hold on AI technology.

The Nvidia DGX SuperPOD chips, powered by NVIDIA GB200 Grace Blackwell Superchips, is capable of processing trillion-parameter models with constant uptime for superscale generative AI training and inference workloads.

With its liquid-cooled rack-scale architecture, DGX SuperPOD can provide 11.5 exaflops of AI supercomputing at FP4 precision and 240 terabytes of fast memory. It is also scalable with additional racks.

The launch of Nvidia’s powerful GPU chips comes at a time when rivals like AMD and Intel are struggling to match the power and efficiency of the company’s H100 chips, launched in 2022.

While Apple, Microsoft and Amazon have also been developing AI chips, none of them could so far match Nvidia’s products or deliver on their promises.

Nvidia said the Blackwell GPUs are four times faster compared to previous generation for AI modelling, adding that they are also 25 times energy-efficient compared to more conventional computing.

Nvidai, however, does not make the chips, but rather gets these manufactured by subcontractors, mainly the Taiwan Semiconductor Manufacturing Co.

Nvidia’s share price rose around 250 per cent over the last 12 months, on the back of its leadership position in AI technology, rising above Amazon, and taking the third spot, behind Microsoft and Apple, in terms of market capitalisation.