The Energy Cost of Technology: Data Centers, AI, and the Sustainability Question

The Carbon Footprint That’s Growing Alongside the Industry

The tech industry has marketed itself as a clean alternative to traditional industries — data is weightless, software doesn’t emit exhaust, digital transformation is often framed as inherently more sustainable than physical processes. The energy reality of modern computing infrastructure is considerably more complicated: data centers currently consume approximately 1–2% of global electricity, a figure that was growing modestly before the AI boom and is now projected to grow significantly faster as AI training and inference workloads expand.

The International Energy Agency projects data center electricity consumption to roughly double between 2022 and 2026 across major markets, driven primarily by AI infrastructure investment. The major technology companies’ sustainability claims must be evaluated in the context of this growth — renewable energy purchasing commitments, carbon offset programs, and efficiency improvements are all real, but the baseline demand they’re offsetting is expanding faster than the sustainable supply.

AI Training vs. AI Inference: The Two Energy Phases

AI energy consumption occurs in two distinct phases with different characteristics. Training — the process of creating a model by processing vast amounts of data to optimize billions of parameters — is extremely energy-intensive but occurs once per model (with some ongoing fine-tuning). Training a large language model requires significant GPU cluster time, measurable in weeks or months, with power consumption that can be equivalent to hundreds of households’ annual usage for a single training run.

Inference — actually using the model to generate responses to queries — is where the ongoing energy cost of AI services lives. Each query to an AI chatbot, each image generation, each AI-powered search result requires running the model on hardware. As usage scales to millions of daily users and billions of queries, the aggregate inference energy cost exceeds training costs significantly. The AI services that are currently most actively deployed at scale — conversational AI, search AI features, image generation — are inference-heavy in their operational energy profile.

The Water Cooling Dimension

AI data centers have a cooling requirement that’s receiving increasing attention: the dense GPU clusters used for AI training and inference generate substantial heat that requires cooling infrastructure. Data centers in most climates use water cooling as an efficient heat removal method, consuming significant quantities of water in the process. Microsoft reported that its global data center water consumption increased substantially in 2022–2023, explicitly attributing part of the increase to AI infrastructure.

Water consumption matters most in water-stressed regions where data center siting decisions intersect with local water availability. The concentration of data center development in the US Southwest, where water scarcity is an ongoing challenge, has prompted regulatory attention and community opposition in some cases. The location of AI data centers is increasingly a sustainability decision with genuine water resource implications alongside the energy considerations.

The Efficiency Improvements That Offset Some Growth

The computing efficiency improvements that have historically reduced per-computation energy cost are real and continuing. Model efficiency improvements — smaller models that achieve comparable results to larger predecessors, architectural improvements that require fewer computations for equivalent outputs, quantization techniques that run models with lower numerical precision without significant quality loss — are active research areas where progress has been meaningful.

The hardware side shows similar trends: dedicated AI accelerator chips (from Nvidia, AMD, Google TPUs, and custom designs at major cloud providers) are significantly more energy-efficient for AI inference workloads than the general-purpose GPUs used in early AI deployments. Each hardware generation provides efficiency improvements that reduce the energy cost per unit of AI capability, though the growth in total AI usage has so far grown faster than these efficiency gains.

Evaluating Tech Industry Sustainability Claims

The major technology companies have made highly publicized sustainability commitments — 100% renewable energy targets, carbon neutral and carbon negative claims, substantial investment in renewable energy development. Evaluating these claims requires some framework: ‘100% renewable energy’ often refers to renewable energy certificates (RECs) that match electricity consumption with renewable generation on an annual, portfolio basis rather than on a moment-by-moment basis (the actual electrons powering the server at 2am on a cold winter night may be from a coal plant; the annual accounting still shows 100% renewable).

The more meaningful commitments are real-time 24/7 matching of consumption with local renewable generation (Google has been the furthest along on this approach), direct renewable energy project development rather than purchasing certificates, and operational efficiency targets that reduce total consumption rather than just offset it. As AI infrastructure investment grows, the gap between marketing commitments and operational reality in tech industry sustainability deserves consistent scrutiny rather than acceptance at face value.

Related Article