As computational demands continue to rise, assessing the environmental footprint of AI requires moving beyond energy and water consumption to include the material demands of specialized hardware. This study quantifies the material footprint of AI training by linking computational workloads to physical hardware needs. The elemental composition of the Nvidia A100 SXM 40 GB graphics processing unit (GPU) was analyzed using inductively coupled plasma optical emission spectroscopy, which identified 32 elements. The results show that AI hardware consists of about 90% heavy metals and only trace amounts of precious metals. The elements copper, iron, tin, silicon, and nickel dominate the GPU composition by mass. In a multi-step methodology, we integrate these measurements with computational throughput per GPU across varying lifespans, accounting for the computational requirements of training specific AI models at different training efficiency regimes. Scenario-based analyses reveal that, depending on Model FLOPs Utilization (MFU) and hardware lifespan, training GPT-4 requires between 1,174 and 8,800 A100 GPUs, corresponding to the extraction and eventual disposal of up to 7 tons of toxic elements. Combined software and hardware optimization strategies can reduce material demands: increasing MFU from 20% to 60% lowers GPU requirements by 67%, while extending lifespan from 1 to 3 years yields comparable savings; implementing both measures together reduces GPU needs by up to 93%. Our findings highlight that incremental performance gains, such as those observed between GPT-3.5 and GPT-4, come at disproportionately high material costs. The study underscores the necessity of incorporating material resource considerations into discussions of AI scalability, emphasizing that future progress in AI must align with principles of resource efficiency and environmental responsibility.
24 de febr. 2026
From Efficiency Gains to Rebound Effects: The Problem of Jevons' Paradox in AI's Polarized Environmental Debate
Dr. Sasha Luccioni Projects
- Evaluating the carbon emissions of AI models – my longstanding project is getting a better idea of how much carbon is emitted by AI models and what are the factors that influence it - see my “BLOOM” and “Counting Carbon” articles.
- Stable Diffusion Bias Explorer – a demo for exploring the biases in text-to-image models like Stable Diffusion and Dall-E 2.
- The Data Measurements Tool – a tool for exploring and analyzing common datasets used for training and evaluating Machine Learning models.
- This Climate Does Not Exist – in which we use Generative Adversarial Networks (GANs) to visualize the potential future impacts of climate change.
- CodeCarbon – I am contributing to creating a calculator to quantify the CO2 emissions produced during the training of AI algorithms.
- Big Science – BigScience is a one-year long research workshop on very large language models as used and studied in the field of Natural Language Processing and more generally Artifical Intelligence research. I am co-chairing the carbon footprint working group within the project.
Measuring the environmental impact of delivering AI at Google Scale
The transformative power of AI is undeniable - but as user adoption accelerates, so does the need to understand and mitigate the environmental impact of AI serving. However, no studies have measured AI serving environmental metrics in a production environment. This paper addresses this gap by proposing and executing a comprehensive methodology for measuring the energy usage, carbon emissions, and water consumption of AI inference workloads in a large-scale, AI production environment. Our approach accounts for the full stack of AI serving infrastructure - including active AI accelerator power, host system energy, idle machine capacity, and data center energy overhead. Through detailed instrumentation of Google's AI infrastructure for serving the Gemini AI assistant, we find the median Gemini Apps text prompt consumes 0.24 Wh of energy - a figure substantially lower than many public estimates. We also show that Google's software efficiency efforts and clean energy procurement have driven a 33x reduction in energy consumption and a 44x reduction in carbon footprint for the median Gemini Apps text prompt over one year. We identify that the median Gemini Apps text prompt uses less energy than watching nine seconds of television (0.24 Wh) and consumes the equivalent of five drops of water (0.26 mL). While these impacts are low compared to other daily activities, reducing the environmental impact of AI serving continues to warrant important attention. Towards this objective, we propose that a comprehensive measurement of AI serving environmental metrics is critical for accurately comparing models, and to properly incentivize efficiency gains across the full AI serving stack.
8 de febr. 2026
Sam Altman Admits That Saying “Please” and “Thank You” to ChatGPT Is Wasting Millions of Dollars in Computing Power
4 de febr. 2026
21 de gen. 2026
How Much Energy Does It Take to Store 1 Terabyte of Data in the Cloud?
https://www.ecoflow.com/us/blog/energy-cost-cloud-storage?
A common estimate for the total energy consumption of 1 TB of data in a typical cloud storage service is between 40 and 70 kWh per year
16 de des. 2025
14 de nov. 2025
13 de nov. 2025
12 de nov. 2025
4 de nov. 2025
https://cartography-of-generative-ai.net/
https://cartography-of-generative-ai.net/