The paper examines the environmental costs of developing and using AI models, with a focus on energy efficiency and how those costs are measured. It reports that inference is the main source of energy use over a model’s lifetime, accounting for about 90%, and that estimates can differ by up to 2.4 times depending on which parts of the system are included in the calculation.

The review also identifies limited environmental reporting: more than 84% of AI models released since 2022 provide no information about their environmental impact. It highlights 4-bit quantization, a method that uses less numerical detail in a model, as one approach that could reduce emissions by up to 55% without affecting accuracy in the results discussed by the paper.