How GPUs Quietly Ate the Datacenter

If you want to know where the next decade of the internet is being built, follow the substations. The new datacenter is not in Virginia anymore. It is in northeastern Mississippi, on a thousand-acre lot that used to be a paper mill. It is in west Texas, on land that used to be ranch, next to a 230-kilovolt line that used to feed cattle pumps.

The buildings themselves are unremarkable — concrete tilt-up, no signage, no windows, the same beige aesthetic the industry has settled on. What is unremarkable on the outside is exotic on the inside: rack after rack of GPUs running at thermal limits, drawing four to ten kilowatts each, packed in the kind of dense rows that would have been considered reckless a decade ago.

The new geography of compute

For thirty years, the constraints on a datacenter were land, fiber, and tax incentive. Power was assumed. Today, power is the only thing that matters. The shortlist of places that can host a one-gigawatt facility — and the AI workload is, increasingly, a one-gigawatt workload — is short, and getting shorter.

We don’t plan capacity in megawatts anymore. We plan it in years.

Water, surprisingly, matters

The new generation of GPUs runs hot enough that air-cooling is no longer the default. Direct-to-chip liquid cooling — the kind of plumbing you used to see in mainframes — is back, and it is pulling water consumption back onto the list of metrics that matter. A medium-sized AI facility can use as much water in a day as a small town.

This is why a non-trivial number of the next-generation datacenters are being built next to wastewater treatment plants, lakes, and rivers. It is also why some of them are being slow-walked through county commissions whose members did not realize, six months ago, that they were going to be making decisions about cluster economics.

What I expected to find, and didn’t

• Almost no GPUs idle. Utilization is the new occupancy.
• Cooling water that is, in many cases, the bottleneck before power.
• A surprising amount of low-tech security: dogs, fences, retired soldiers.
• Almost no humans on the floor. Datacenters are the most automated buildings on earth.

The thing nobody told me, and which surprised me most, is how quiet they are. From a distance, a one-gigawatt site is a hum. From the parking lot, it is a wash of white noise that sounds, for some reason, like the ocean. Up close, in the hot aisle, it is a hurricane that speaks in industrial fans.

I left wondering how long this version of compute can last. Probably not very long. The buildings are designed to be torn down and rebuilt every six years now. The towns hosting them are negotiating decade-long power contracts. Somewhere in the gap between those two timelines is where the next argument lives.