Using GPT-4 to generate 100 words consumes up to 3 bottles of water — AI data centers also raise power and water bills for nearby residents
Net-zero emission goals went out the window with AI.
Research conducted by the University of California, Riverside shared by The Washington Post on Wednesday highlighted the high costs of using generative AI. It turns out AI requires pretty heavy water consumption — used to cool the servers that generate the data — even when it's just generating text. This is, of course, in addition to the severe electric grid toll.
The research noted that the exact water usage varies depending on state and proximity to data center, with lower water use corresponding to cheaper electricity and higher electricity use. Texas had the lowest water usage at an estimated 235 milliliters needed to generate one 100-word email, while Washington demanded a whopping 1,408 milliliters per email — which is about three 16.9oz water bottles.
This may not sound like a lot, but remember that these figures add up fairly quickly, especially when users are using GPT-4 multiple times a week (or multiple times a day) — and this is just for plain text.
Data centers are shown to be heavy consumers of water and electricity, which also drives up the power and water bills of residents in the towns where these data centers are being built. For example, Meta needed to use 22 million liters of water to train its LLaMA-3 model — about how much water is needed to grow 4,439 pounds of rice, or, as researchers noted, "about what 164 Americans consume in a year."
The electric cost of GPT-4 is also quite high. If one out of 10 working Americans use GPT-4 once a week for a year (so, 52 queries total by 17 million people), the corresponding power demands of 121,517 MWh would be equal to the electricity consumed by every single household in Washington D.C. (an estimated 671,803 people) for twenty days. That's nothing to scoff at, especially since it's an unrealistically light use case for GPT-4's target audience.
The Washington Post included quotes from OpenAI, Meta, Google, and Microsoft representatives, most of which reaffirmed commitment to reducing environmental demand rather than giving actual courses of action.
Microsoft rep Craig Cincotta stated that the company will be "working toward data center cooling methods that will eliminate water consumption completely," which sounds nice but is vague on how. The AI profit motive has clearly taken priority over environmental goals set by these companies in the past, so even this quote should be taken with a grain of salt until we see actual improvements.
Stay On the Cutting Edge: Get the Tom's Hardware Newsletter
Get Tom's Hardware's best news and in-depth reviews, straight to your inbox.
Christopher Harper has been a successful freelance tech writer specializing in PC hardware and gaming since 2015, and ghostwrote for various B2B clients in High School before that. Outside of work, Christopher is best known to friends and rivals as an active competitive player in various eSports (particularly fighting games and arena shooters) and a purveyor of music ranging from Jimi Hendrix to Killer Mike to the Sonic Adventure 2 soundtrack.
-
Findecanor Even data centres that use "renewable energy" use energy that could have been used for something actually useful.Reply -
coolitic This sounds like a highly suspicious figure; it's not like the water you use for cooling is just "consumed", and even when it evaporates, it collects back into the system.Reply -
Gururu The only solution is to make those companies pay higher water bills for city water or to generate their own clean water supply. Costs I am sure customers will love to endure. Unfortunately these companies likely getting huge subsidies to put their companies in certain locations, possibly including utility discounts. I wouldn’t be so sure all of this wouldn’t be considered and covered in negotiations, so in the end the water usage is paid for appropriately so that it can be replaced.Reply -
AcostaJA I suscribe other' pior opinions, the study figures are opinionated at least, or madeup seeking an political headline, I'm familiar with GPU (ai) servers farms, some of them even dont use water but direct air or submerged hardware in cooling oil (the most modern), and those on liquid cooling use filtered water mixed with additives to avoid clogging intrisically being closed circuits, so if any water is spent is only when filling the circuits, nothing is wasted during its operation as the biased "study" poisonously suggest.Reply
Datacenters expent tons of energy, but often they generate its own energy by solar panels, while this is something all we want to improve by a number of interest, the truth is often this power comes from renewable sources as solar, nuclear on wind or combination, much cleaner than a single rockstar concert tour.
I'm dissaponted to read how some Universities waste money on untrue narratives often hiding political pursuits, also dissapont when free media replicate this naratives, politicians calls on censorship (or 'missinfo-hate' speech correction), I want politicians calling on accouintability on faked or biased 'studies' presented as 'science' or backed by scientist wich is worst, they know are biased and cares nothing on truth but their political goals. -
Pierce2623
If I go by the liters per hour rating on my pump, my AIO doesn’t even run three bottles of water through the radiator in the time it takes to generate 100 words in a LLM like LLama or Mistral , even if I use no GPU offloading.coolitic said:This sounds like a highly suspicious figure; it's not like the water you use for cooling is just "consumed", and even when it evaporates, it collects back into the system. -
AcostaJA
As powering a rockstar plane (in a year a single private Jet expend on Fuel more than Facebook on Training LLAMA3), or a politician rally? and that are not biased figures, nither comes from renewable (carbon neutral) sources LMFAOFindecanor said:Even data centres that use "renewable energy" use energy that could have been used for something actually useful. -
m3city Wait, no data given in football fields (more like hand-egg for me..) or swimming pools? How can I relate to this.Reply -
anoldnewb
Training the models is very energy intensive. Inferencing via a trained model consumes orders of magnitude less energy.Pierce2623 said:If I go by the liters per hour rating on my pump, my AIO doesn’t even run three bottles of water through the radiator in the time it takes to generate 100 words in a LLM like LLama or Mistral , even if I use no GPU offloading. -
anoldnewb
1. How does the data center get the cold air or water to run through the loops? If they use a cooling tower then some of the water that i s sprayed down in the tower is lost to evaporation.AcostaJA said:I suscribe other' pior opinions, the study figures are opionated at least, or madeup seeking an political headline, I'm familiar with GPU (ai) servers farms, some of them even dont use water but direct air or submerged hardware in cooling oil (the most modern), and those on liquid cooling use filtered water mixed with additives to avoid clogging intrisically being closed circuits, so if any water is spent is only when filling the circuits, nothing is wasted during its operation as the biased "study" poisonously suggest.
Datacenters expent tons of energy, but often they generate its own energy by solar panels, while this is something all we want to improve by a number of interest, the truth is often this power comes from renewable sources as solar, nuclear on wind or combination, much cleaner than a single rockstar concert tour.
I'm dissaponted to read how some Universities waste money on untrue narratives often hiding political pursuits, also dissapont when free media replicate this naratives, politicians calls on censorship (or 'missinfo-hate' speech correction), I want politicians calling on accouintability on faked or biased 'studies' presented as 'science' or backed by scientist wich is worst, they know are biased and cares nothing on truth but their political goals.
2. Do solar powered data centers run at night? Could the wind or nuclear power be used for something else besides a data center? -
AcostaJA
Cold air comes from the environment, the liquid running on the loops comes from factories where is processed (is very similar to car coolant but there is no concentrate to dilute, all the liquid is sourced from manufaturers to ensure purity), spraying down water on the cooling towers may actual evaporate some water, but im knowledge there are no data center using this cooling method, and often they sell the datacenter heath to reheat utility water so ti wont frozze on pipes on its way to serve commuinities (thats why most datacenter are located at cool places).anoldnewb said:1. How does the data center get the cold air or water to run through the loops? If they use a cooling tower then some of the water that i s sprayed down in the tower is lost to evaporation.
Datacenters solar powered run at night on Betteries like Tesla's super packs, yes nuclear power could be used on something different, whats on Politicians planes fuel or Some Signer , a single Executive Jet fliying 800h (typical per NBAA) a year burns more energy than a tipical datacenter training AI models, if we need to shutdown somthing, I'm at the progress side.anoldnewb said:2. Do solar powered data centers run at night? Could the wind or nuclear power be used for something else besides a data center?
A Single Business Jet, America has hundred of them serving politicians, hollywood stars and rich people as Elon Musk or Bill Gates, a single Business Jet polute more than a typical datacenter, like Xai newest or openAI's, not to name Facebook (meta) which are the most modest and the few that shares AI models with the comunity.
And we have passenger Jets, why you dont travel by eletric train on your next vacation or sail on a boat?