The Environmental Impacts of Language Model Training Keep Rising Now is the Time to Catch Impacts on the Rebound

Recent Machine Learning (ML) approaches have shown increased performance on benchmarks at the cost of escalating compute demands. Hardware, algorithmic and carbon optimizations have been proposed to curb energy use and environmental impacts. We estimate the environmental impacts associated with trai