Nvidia's latest move in data center technology involves a switch to 100 percent liquid cooling, allowing servers to operate at higher temperatures, which the company claims will reduce water usage to nearly zero.
Liquid Cooling Strategy
Nvidia's Rubin generation reference design for these AI data centers is said to eliminate significant power usage and nearly all water consumption. This comes amid rising concerns about the environmental impact of data centers, including their construction and power generation needs. However, the cost implications of such a transition compared to traditional air-cooled systems remain unaddressed in Nvidia's statements.
Efficiency Through Higher Temperatures
The design allows AI servers to run as hot as 113 degrees Fahrenheit (45 degrees Celsius). This approach is not entirely new, as Amazon has similarly highlighted higher heat tolerances in its mostly air-cooled data centers to improve efficiency. Nvidia's system captures heat directly at the chip, transporting it through liquid loops at higher temperatures, which enables the use of outdoor dry coolers for efficient heat rejection throughout much of the year.
Water Usage Reduction
Josh Parker, Nvidia's head of sustainability, states that the reference design reduces water use from about 2.6 million gallons per megawatt per year in conventional cooling-tower-based systems to nearly zero. This represents up to a 100 percent reduction in water usage, a significant saving for large-scale operators.
Industry Adoption
While financial details are scarce, Nvidia asserts that cloud providers and data center operators are transitioning to the Rubin design. The move reflects a broader industry trend towards more sustainable data center operations, though challenges related to construction and energy sourcing remain.
Source: https://www.theverge.com/tech/954139/nvidia-data-centers-rubin-liquid-cooling
