Zuckerberg's Meta Is Spending Billions to Buy 350,000 Nvidia H100 GPUs

From PC Mag: Mark Zuckerberg plans on acquiring 350,000 Nvidia H100 GPUs to help Meta build a next-generation AI that possesses human-like intelligence.

Zuckerberg mentioned the figure today as he announced his company’s long-term effort to develop an artificial general intelligence (AGI), or an AI that can learn and be used to perform a variety of tasks.

Meta's CEO envisions the AGI powering a wave of cutting-edge services and devices, such as more powerful digital assistants and augmented reality glasses. “Building the best AI assistants, AIs for creators, AIs for businesses and more, that needs advances in every area of AI,” he said in a video on Instagram.

But to get there, Meta is going to need Nvidia’s H100, an enterprise GPU that’s adept at training large language models. “We’re building an absolutely massive amount of infrastructure to support this,” Zuckerberg said. “By the end of this year, we’re going to have around 350,000 Nvidia H100s. Or around 600,000 H100 equivalents of compute if you include other GPUs.”

View: Full Article