When NVIDIA’s founder and CEO Jensen Huang waxed poetic about artificial intelligence in the past, it mostly felt like marketing bluster, the sort of lofty rhetoric we’ve come to expect from an executive with a never-ending supply of leather jackets. But this year, following the hype around OpenAI’s ChatGPT, Microsoft’s revamped Bing and a slew of other competitors, NVIDIA’s AI push finally seems to be leading somewhere.
The company’s GTC (GPU Technology Conference) has always been a platform to promote its hardware for the AI world—now it’s practically a celebration of how well-positioned NVIDIA is to take advantage of this moment.
“We are at the iPhone moment for AI,” Huang said during his GTC keynote this morning. He was quick to point out NVIDIA’s role at the start of this AI wave: he personally brought a DGX AI supercomputer to OpenAI in 2016, hardware that was ultimately used to build ChatGPT. We’ve seen the DGX systems evolve over the years, but it’s remained out of reach for many companies (the DGX A100 sold for $200,000 in 2020, which was half the price of its predecessor!). So what about everyone else?
That’s where NVIDIA’s new DGX Cloud comes in, an (obviously) online way to tap into the power of its AI supercomputers. Starting at a mere $36,999 a month for a single node, its meant to be a more flexible way for companies to scale up their AI needs. DGX Cloud can also work together with on-site DGX devices, since they’re all controlled with NVIDIA’s Base Command software.
NVIDIA says every DGX Cloud instance is powered by eight of its H100 or A100 systems with 60GB of VRAM, bringing the total amount of memory to 640GB across the node. There’s high-performance storage, as you’d expect, as well as low-latency fabric that connects the systems together. That amount of power may make the cloud solution more tempting for existing DGX customers—why spend another $200,000 on a box, when you can do so much more for a lower monthly fee? DGX Cloud will be powered by Oracle’s Cloud Infrastructure to start, but NVIDIA says it will expand to Microsoft Azure next quarter, as well as Google Cloud and other providers “soon.”
Developing…
