Meet Nvidia's Huge H100 Chip That's Powering Tomorrow's AI

From CNET: Nvidia will begin selling a new AI acceleration chip later this year, part of the company's efforts to secure its leadership in a computing revolution that's powering everything from email auto-dictation to self-driving cars.

The H100 "Hopper" processor, which Nvidia Chief Executive Jensen Huang unveiled in March, is expected to begin shipping next quarter. The processor has a whopping 80 billion transistors and measures 814 square millimeters, which is almost as big as is physically possible with today's chipmaking equipment.

The H100 competes with huge, power-hungry AI processors like AMD's MI250X, Google's TPU v4 and Intel's upcoming Ponte Vecchio. Such chips are goliaths most often found in the preferred environment to train AI systems, data centers packed with racks of computing gear and laced with fat copper power cables.

The new chip embodies Nvidia's evolution from a manufacturer of graphical processing units used for video games to an AI powerhouse. The company did this by adapting GPUs for the particular mathematics of AI like multiplying arrays of numbers. CNET got an exclusive close-up look at the H100 Hopper chips and Nvidia's new Voyager building that will house hardware and software development work.

View: Full Article