Subscribe
Share
Share
Embed
Living Life in the Digital Age - Living Life with Technology past, present and future. Find me at https://www.lifeat100Mhz.com - Produced by Dave Bunyard - earthdrifter@gmail.com Cover Photo: Charles Sharp Crawford in a Cole car at the Indianapolis speedway in 1910.
Einstein said that a mind expanded can never go back. Well, AI is here. And as people become more comfortable with it, it will expand. And data centers are needed for that expansion. Data centers are ATMs to tech executives.
Dave Bunyard:They make a lot of money. So if they are going to ask to be a part of your community, make them do it right by making it worthwhile for everyone. Require them to be good stewards to the neighborhood. In this episode of Life at 100MHz, here are some ideas that city councils could force upon data centers.
Sam:You know, it's funny, every time you type a prompt into an AI or like ask an image generator to create a picture of a cat riding a skateboard on Mars, there is this expectation of just instant invisible magic.
Delilah:Oh, absolutely. It just happens.
Sam:Right. You hit enter, the progress bar blinks and bam, there it is. Uh-huh. But what you really don't see is the actual physical toll that that digital request just took on the real world.
Delilah:Yeah. People don't think about it.
Sam:They don't because your prompt requires very real physical water to evaporate and, know, very real physical power to burn. So today for this deep dive, we are looking at this fascinating cache of architectural and policy blueprints concerning the water energy AI nexus.
Delilah:Which is such a critical topic right now.
Sam:It really is. Our mission here is to figure out how we can actually build this massive power hungry future of AI
Delilah:Right.
Sam:Without completely draining our own local towns dry.
Delilah:Yeah. Because it is a completely invisible transaction to the user. I mean, think of the cloud as being up in the sky. Right? Like, it's weightless and infinite.
Sam:It's just floating up there.
Delilah:Exactly. But the cloud is actually incredibly heavy. It runs dangerously hot, and honestly, it is overwhelmingly thirsty. So, as AI pushes modern computing to its absolute physical limits, we can no longer afford to just blindly consume technology.
Sam:We have to manage it.
Delilah:We do. We have to responsibly manage the earth, the water, and the electrical grids that actually fuel it. And really, the core theme across all these blueprints we looked at is stewardship.
Sam:Okay. Let's unpack this. Because to really understand that philosophy of stewardship, I feel like we have to start with the hard nuts and bolts engineering happening inside these buildings.
Delilah:Oh, for sure. The scale is wild.
Sam:It's insane. AI chips, like the ones powering the latest large language models, are pulling just absolute massive amounts of power. We're talking over 100 kilowatts per server rack.
Delilah:Yeah, which is just unprecedented.
Sam:And obviously, that creates a staggering heat problem.
Delilah:Right, and historically data centers have dealt with heat by using massive cooling towers.
Sam:Those giant fans on the roofs.
Delilah:Exactly. They rely on evaporative cooling, which means they literally evaporate millions of gallons of municipal drinking water just to reject that server heat into the atmosphere.
Sam:Millions of gallons.
Delilah:Millions. And, I mean, in a world where water scarcity is, you know, a growing reality for everyone, pouring millions of gallons of clean drinking water into the sky just to cool down a computer is well, it's a luxury we simply can't afford anymore.
Sam:Okay. So as someone looking at this from the outside, just have to ask. Mhmm. If these server racks are getting so unimaginably hot, why don't we just freeze them?
Delilah:Freeze them?
Sam:Yeah. Like, why not pump liquid nitrogen through these servers and just keep the whole entire system on ice?
Delilah:I mean, it sounds like the ultimate cooling hack.
Sam:Right? Yeah. Just freeze it.
Delilah:But physics actually gets in the way of that very quickly. Using liquid nitrogen creates three massive engineering nightmares.
Sam:Okay, what's the first one?
Delilah:First is thermal shock. So, silicon chips are made of lots of different materials. You've got the silicon die, the copper traces, the fiberglass substrates.
Sam:And they all react differently to cold.
Delilah:Exactly. They all expand and contract at completely different rates. So if you hit them with cryogenic temperatures like negative 196 degrees Celsius, the rapid uneven contraction causes physical cracking. Oh, wow. Yeah.
Delilah:The chip literally shatters.
Sam:So freezing the brain literally breaks the brain?
Delilah:Basically. Yeah. And the second issue is condensation.
Sam:Like when a cold glass sweats in the summer.
Delilah:Precisely. If you run a liquid nitrogen pipe through a standard server room, the ambient humidity in the air will just instantly freeze against the pipes. You would actually create an actual snowstorm inside the data center.
Sam:Wait. Really? A snowstorm?
Delilah:A literal snowstorm. And that freezing humidity would eventually drip into the electronics and cause catastrophic short circuit.
Sam:Okay. So that's two strikes against liquid nitrogen.
Delilah:Right. And finally, there's the energy tax. It takes a massive, massive amount of electricity just to liquefy nitrogen in the first place.
Sam:Oh, because it's a gas normally.
Delilah:Right. You would spend significantly more energy running the refrigeration plant to create the liquid nitrogen than you would ever save in cooling the servers. I mean, it defeats the entire purpose of efficiency.
Sam:Okay. So if turning the data center into a cryogenic freezer is completely off the table, what are the actual solutions here? Because looking at the sources they point heavily toward moving away from traditional air conditioning and adopting two specific liquid
Delilah:Right.
Sam:And the first one feels like a total blast from the past which is immersion cooling.
Delilah:Yeah, this is so cool. What's fascinating here is how tech history kind of repeats itself when it's pushed to the brink.
Sam:Like the eighties supercomputers.
Delilah:Exactly. Back in the nineties, the legendary Cray-two supercomputer used a dielectric fluid. It was a brand called Florinert to cool its densely packed circuits.
Sam:And they just dumped the whole thing in there.
Delilah:They fully submerged the computer in this nonconductive liquid, and modern data centers are returning to that exact concept today.
Sam:That is wise.
Delilah:They are taking entire server blades and just dropping them into vats of synthetic, nonconductive fluid.
Sam:So the fluid is actually touching the chips?
Delilah:Directly touching them. It absorbs heat instantly without causing short circuits and crucially without evaporating any water into the sky.
Sam:Wait, okay, hold on. If the entire server is deep underwater, well, fluid, in a vat of synthetic chemicals, what happens when a single hard drive fails?
Delilah:Oh, like for maintenance?
Sam:Yeah, does an IT technician have to like roll up their sleeves, reach into a tank of chemicals and just fish it out because that sounds like an absolute maintenance nightmare for a facility running thousands of these machines.
Delilah:Oh, it would be a nightmare if it were just like an open pool, but modern engineering has kind of solved for that.
Sam:How so?
Delilah:These aren't just open bathtubs. They use these automated hoist systems to lift the server blades out of the vat and the fluid itself is chemically designed to drip off and flash dry almost instantly.
Sam:Oh, so it just evaporates off the board?
Delilah:Right. So the technician can swap components safely without getting covered in goo.
Sam:That's amazing. It's basically like a high-tech sensory deprivation tank. Like instead of fans blasting turbulent air across the room, the chips are just floating in this incredibly calm engineered liquid that just silently pulls the heat away from their skin.
Delilah:That is actually a perfect way to visualize it. I love that. Thanks.
Sam:But there's another method, right?
Delilah:Yeah. The other major liquid method is called direct to chip or DTC cooling.
Sam:Okay. How does that differ?
Delilah:So instead of dunking the whole motherboard in that sensory deprivation tank, engineers are pumping a water glycol mix through these microscopic channels inside tiny metal cold plates.
Sam:And the plates just sit on the chips?
Delilah:Exactly. They are attached directly to the CPUs and GPUs. It acts just like a high performance radiator in a sports car.
Sam:Oh, I see.
Delilah:It pulls the extreme heat directly from the processor before it ever even has a chance to warm up the ambient air inside the server chassis.
Sam:Okay. So we are completely submerging servers or pumping glycol through these microscopic radiators just to survive the heat crisis. But I guess my question is, what is physically happening inside that chip to generate a 100 kilowatts of raw heat to begin with? Why is it so hot?
Delilah:Ah, okay. So we are fighting a physical phenomenon called joule heating.
Sam:Joule heating.
Delilah:Yeah. At its core, modern computing still relies on electrons moving through copper wires.
Sam:Sure. Electricity.
Delilah:Right. But electrons have mass. When you force billions of them through a tiny copper trace on a motherboard, they collide with the atoms in the metal.
Sam:Like cars bumping into each other on a highway.
Delilah:Exactly. Those collisions create intense friction and vibration. And in the physical world, vibration equals heat.
Sam:Got it.
Delilah:So we are hitting what the industry calls the interconnect wall. As we pack more and more transistors onto a single AI chip, we are shoving more of these massive electrons through increasingly microscopic copper pipes.
Sam:It just gets hotter and hotter.
Delilah:It becomes an inescapable thermal bottleneck.
Sam:Okay, well here's a wild hair of an idea for you.
Delilah:Let's hear it.
Sam:If friction and heat are the main enemy here, right? And say an old incandescent light bulb gets blazing hot while a modern LED light barely gets warm. Uh-huh. Can we just build a computer completely out of light and fiber optics instead of copper?
Delilah:It's so funny you say that because validating that analogy is crucial. You are describing the absolute holy grail of modern computer engineering right now.
Sam:Wait. Really?
Delilah:Yes. Because photons, which are particles of light, have no mass and no electrical charge.
Sam:Okay.
Delilah:So when light moves through a fiber optic cable, it doesn't bump into atoms. There's virtually no friction, which means almost zero heat.
Sam:So why aren't we doing it? Like, why isn't my laptop running on lasers right now?
Delilah:Well, because of what we call the logic gate problem.
Sam:The logic gate problem.
Delilah:Right. To make a computer compute, you need transistors to act as switches, you know, the the ones and zeros.
Sam:Right. Binary.
Delilah:Electrons are great for this because they have an electrical charge, so you can easily use a magnetic field to stop them or let pass.
Sam:You can control them.
Delilah:Exactly. But photons don't naturally interact with each other. If you cross two beams of light in free space, they don't crash. They just pass right through one another like ghosts.
Sam:Oh, like two flashlight beams. They just overlap.
Delilah:Exactly. You still need electrons to do the actual switching, the actual math. If you tried to force photons to interact to do math today, the energy required would create way more heat than you'd ever save.
Sam:Ah, okay. So we can't put fiber optics directly inside the CPU's brain to do the math itself.
Delilah:Not yet.
Sam:But the blueprints show engineers are doing the next best thing with a technology called silicon photonics. Yes. And apparently they are taking microscopic lasers and mounting them right next to the CPU.
Delilah:Yeah, it's brilliant. The CPU does its complex math electrically, utilizing those heavy electrons for the heavy lifting, but the exact fraction of a second it needs to send that data to another component, a photonic engine converts that electrical signal to a pulse of light.
Sam:Just instantly?
Delilah:Instantly. We call this optical IO or input output.
Sam:Okay. And this shift from copper to light, it's completely changing the physical architecture of how a data center is built.
Delilah:It doesn't like flips it on its head.
Sam:Yeah. Because in these new greenfield sites, they are abandoning the traditional layout of just endless long rows of servers. Right. Instead, they are moving to this pod and hub architecture.
Delilah:Exactly. Because optical signals can travel much further and faster than electrical signals over copper without degrading at all.
Sam:Right.
Delilah:And that simple fact means you no longer need to keep all your delicate networking gear crammed into the exact same boiling hot rack as your massive AI processors.
Sam:You are effectively decoupling the heavy lifting from the communication.
Delilah:Precisely.
Sam:So you have these ultra dense compute pods filled with nothing but liquid cooled GPUs. Yeah. And because of the dense silicon and the liquid cooling hardware, these specific racks are incredibly heavy. We're talking like 3,000 to 4,000 pounds per rack.
Delilah:They are absolute behemoths.
Sam:Yeah. Developers actually have to pour reinforced concrete floor slabs just to hold them up without the floor caving in.
Delilah:Yeah. And then physically separated from those heavy liquid filled compute pods, you have a centralized optical hub.
Sam:Where the networking lives.
Delilah:Right. Where all your delicate networking switches live in a highly controlled, cool environment.
Sam:And connecting the two are these massive overhead fiber super highways.
Delilah:Yeah. The fiber highways are amazing.
Sam:And the blueprint specified they're using OStwo single mode fiber for this.
Delilah:Yes.
Sam:And there's a very specific physical reason for that, right? Because multimode fiber allows light to sort of bounce around off the walls of the cable, which scrambles the signal over longer distances.
Delilah:Exactly. It gets messy.
Sam:But single mode forces the laser into one incredibly narrow perfectly straight path. It doesn't bounce, it doesn't degrade, and it allows them to physically separate the heavy thinking in the pods from the networking in the hub.
Delilah:It's an absolute marvel of physical engineering. Mean, inside of the building is neatly divided into liquid on the bottom and light speed lasers on the top.
Sam:But pumping thousands of gallons of fluid and firing millions of microscopic lasers, that still requires an unbelievable amount of electricity.
Delilah:Oh absolutely.
Sam:Which generates its own massive external heat profile. We haven't really eliminated the energy problem, have we? We've just sort of moved it outside the building.
Delilah:That's a great way to put it.
Sam:So how do these facilities actually generate that juice and keep the building itself from melting down without draining the local municipal reservoir?
Delilah:Well this is where we look at how the building interacts with the earth beneath it.
Sam:Okay.
Delilah:The gold standard right now for cooling the facility while conserving water is geothermal. Specifically, a closed loop geo exchange system.
Sam:Geo exchange.
Delilah:Right. So instead of a cooling tower evaporating municipal water into the sky, engineers drill hundreds of boreholes, like 300 to 500 feet deep into the earth.
Sam:Just straight down into the dirt.
Delilah:Straight down. And they circulate a sealed fluid through those pipes using the earth's crust as a massive stable heat sink.
Sam:And it uses no water?
Delilah:It uses near zero water because it's a closed loop.
Sam:Okay hold on. If a closed loop geothermal system is the gold standard and it uses almost zero water, why isn't every single new data center mandating this right now? Like why isn't this the law?
Delilah:Geology and a critical physical limitation called thermal saturation.
Sam:Thermal saturation, okay, what's that?
Delilah:Think of the ground beneath us like a sponge, but instead of holding water, it holds thermal energy.
Sam:Okay, I'm with you.
Delilah:A residential home might dump a little heat into the ground during the day, but it rests at night, giving the ground time to dissipate that heat outward. Sure. A data center never rests. It dumps massive amounts of thermal energy twenty four hours a day, three sixty five days a year.
Sam:Oh. So if you don't map that out perfectly you run into real trouble. Major trouble. Because the blueprints show that developers have to run highly specific thermal conductivity tests on the local soil because clay absorbs heat completely differently than solid granite does.
Delilah:Exactly. And if you miscalculate, the ground around your boreholes will literally overheat. It becomes thermally saturated. Just like a sponge that is totally full of water can't absorb a single drop more, saturated ground can't absorb any more heat. Your cooling efficiency just plummets to zero.
Sam:So you can't just drill holes and hope the dirt figures it out.
Delilah:No, absolutely not.
Sam:To avoid saturating the ground, the sources outline a hybrid approach.
Delilah:Right.
Sam:You use geothermal to handle the baseline cooling, say 60 to 70% of the load. And then for the extreme peaks, you use something called adiabatic cooling.
Delilah:Yeah. Adiabatic cooling is brilliant. It operates like a giant dry fan for most of the year. But during the absolute peak heat of summer, it trickles a tiny, tiny amount of water over these evaporative pads.
Sam:And the physics of that are just fascinating because when that small amount of water evaporates, it absorbs latent heat from the air. Right. It forces a phase change that instantly drops the air temperature by like 10 or 15 degrees before it even hits the servers. Yep. It's a brilliant compromise that saves immense amounts of water without boiling the ground beneath the building.
Delilah:It really is. And we see that same philosophy of conservation in their circular resource methods too.
Sam:Oh, right. The circular stuff.
Delilah:Yeah. To run those adiabatic coolers, advanced facilities are utilizing rainwater harvesting. They're turning their massive flat roofs into blue roof catchments.
Sam:Like giant rain barrels.
Delilah:Basically. Or they are using reclaimed water.
Sam:It's basically.
Delilah:Taking municipal sewage effluent and filtering it through commercial reverse osmosis systems, which basically uses high pressure to push dirty water through a microscopic membrane leaving all the impurities behind. It means they never touch the city's clean drinking water supply.
Sam:And we see the circularity on the power side as well. Right? Definitely. Because if you've ever had your neighborhood experience a brownout on a hot July afternoon just because everyone was running their air conditioning, imagine dropping a facility that requires a 100 times that power into your town.
Delilah:It would completely crash the grid.
Sam:Right. So to prevent crashing the local utility grid, data centers are building on-site microgrids. We're talking commercial scale solar arrays, wind turbines, and massive battery energy storage systems or BSS.
Delilah:Yeah, BSS. The batteries essentially act as a localized insurance policy. The data center becomes what they call a prosumer.
Sam:Prosumer.
Delilah:Right. Producing its own energy, the excess and really taking the strain off the community grid.
Sam:Okay. But let's be real for a second. All of these closed loop geothermal fields, reverse osmosis plants, massive battery arrays, they cost an absolute fortune in upfront capital expenditure.
Delilah:Oh, hundreds of millions.
Sam:Right. And developers or businesses looking at the bottom line. If I am building a billion dollar data center, why on earth would I voluntarily spend tens of millions of dollars extra just to protect the town's water supply?
Delilah:Well, the short answer is they won't do it voluntarily. Right. And that is exactly where engineering meets local policy. And it is arguably the most critical shift happening in the AI boom right now. How do local municipalities enforce stewardship on trillion dollar tech giants?
Delilah:Think of the early nineteen hundreds oil booms in places like Texas or Pennsylvania.
Sam:Oh, sure.
Delilah:A massive resource is discovered, companies rush in, build infrastructure overnight, extract the value, and then they just leave the local town to deal with the polluted water and bust roads once the boom moves on.
Sam:Right. The classic boom and bust.
Delilah:The AI data center rush has the exact same energy right now.
Sam:So put yourself in the shoes of a local city council member or, you know, just an active citizen listening to this right now. A tech giant comes to your town and says, hey, we want to build a massive AI facility here. What leverage do you actually have?
Delilah:Municipalities hold the ultimate trump card, which is zoning.
Sam:Zoning.
Delilah:They can use conditional use permits CUPs, which basically means, yes, you can build here, but only if you meet our strict environmental rules.
Sam:Oh, like that.
Delilah:And they tie those permits to community benefit CBAs, which are legally binding contracts forcing the developer to invest in the town's infrastructure.
Sam:And the key here, according to the blueprints we looked at, is to mandate performance, not dictate specific technology.
Delilah:Exactly.
Sam:You don't tell their world class engineers what brand of cooler to buy, you give them hard, unyielding metrics.
Delilah:Right. You write into the zoning code that any new data center must achieve a PUE power usage effectiveness of 1.35 or lower.
Sam:Okay. What does 1.35 mean in context?
Delilah:Good question. To put that in perspective, a decade ago, data centers were running at a PUE of two point o, meaning for every watt of computing, they wasted a full watt on cooling.
Sam:Oh, wow. Half the energy was wasted.
Delilah:Exactly. So 1.35 forces them to be ruthlessly efficient with their overhead. And you also mandate they hit a WUE water usage effectiveness of 0.3 liters per kilowatt hour or lower.
Sam:And how they hit those numbers is up to them.
Delilah:Right. Geothermal immersion, whatever. Just hit the numbers.
Sam:But if I'm a developer, my immediate threat is gonna be fine. Your rules are too strict. We'll just take our billions of dollars and build in the next county over.
Delilah:Oh, threaten that all the time.
Sam:Or I'll argue that these environmental regulations are going to stall the global growth of artificial intelligence. How does a local town council rebut that kind of pressure?
Delilah:You reframe the argument. You move it from green industry to future proofing versus legacy thinking.
Sam:Okay. Like that phrasing.
Delilah:You look the developer in the eye and say, we are actually helping you build a better asset. Yes. Geothermal bore holes and microgrids cost way more upfront, but they drastically lower the total cost of ownership of the OptEx over the thirty year life of the facility.
Sam:And from the community side, you argue that sustainable builds protect the town from that boom and bust cycle.
Delilah:Yeah.
Sam:If a severe drought hits five years from now, a water neutral data center won't be competing with local citizens for a shrinking drinking water supply.
Delilah:Exactly. It protects everyone's infrastructure. And this leverage doesn't just apply to new greenfield sites either.
Sam:Oh, Oh, right. What about the old ones?
Delilah:The policy blueprints detail how towns can handle older sites through sunset clauses.
Sam:Because you can't just shut down a legacy data center overnight and kill local jobs. But a town can give them a five to ten year window to hit these modern sustainability points. You tell the operator, look, add a battery storage system or switch your evaporative cooling methods by 2035 or you lose your municipal tax abatements.
Delilah:Exactly. It creates a clear long term financial incentive for operators to modernize their tech, phasing out massive water and power waste without shocking the local economy.
Sam:Well we've gone from the microscopic shattering of silicon under liquid nitrogen to lasers pulsing down single mode fiber optics all the way to municipal zoning debates.
Delilah:It's all connected, and I think it comes back to a really profound quote found in our sources today. Einstein said, A mind expanded can never go back.
Sam:Such a great quote.
Delilah:It perfectly captures the AI boom we are living through. The technological expansion is irreversible, we can't stop it. But we also can't afford to just passively consume it. Local governments, everyday citizens, we all have to step up as stewards of our shared utilities.
Sam:So the next time you hear about a massive data center project being proposed in your county, you aren't just a bystander. You now possess the exact vocabulary acronyms like WUE, concepts like Thermal Saturation, the protective necessity of microgrids to actually stand up at the next town hall and ask the hard necessary questions.
Delilah:Absolutely, because the infrastructure built today will dictate the resource security of those communities for the next three decades.
Sam:I want to leave you with a final thought to chew on. Throughout this deep dive, we've talked about how our digital brains, this artificial intelligence, require physical systems that eerily mimic biological ones. We are building facilities that circulate specialized liquid to keep their cores from overheating, much like blood. We are moving away from rigid copper wires to pulsing births of light through optical fiber acting almost exactly like a central nervous system.
Delilah:It's a fascinating parallel, mean the machine is literally mimicking the organic.
Sam:So if a data center requires fluid circulation, a nervous system and a constant massive intake of energy and water just to stay functional, at what point does it start functioning less like a simple machine and more like a living breathing organism? And if it is an organism, is it a symbiotic part of your city? Or a parasite that your local resources are being forced to sustain?
Delilah:Now that is a question worth taking to a town hall.
Sam:Something to think about the next time you ask an AI to write a poem or generate an image. Thanks for taking this deep dive with us.
Dave Bunyard:There are zoning laws if you want to build a hair salon, restaurant, and other specific types of businesses. City Councils should create zoning laws specifically for data centers. They will need to get their WUE or water efficiency to less than 0.3 liters per kilowatt hour and PUE or energy efficiency less than 1.35. This will require them to use geothermal, rainwater harvesting, solar, liquid cooling for servers, and whatever else that makes sense in your area. This is not about climate change.
Dave Bunyard:This is about how there is simply not enough water and power for everyone in the community and the data center. Water must be reused or conserved better. Additional power sources must be created. If you want to go further, the data center could provide financial support for local parks, public facilities, or local charities as well. Check my website at life100mhz.com.
Dave Bunyard:This is Dave Bunyard. Thanks for listening.