🧵 The growing use of Large Language Models (LLMs) has raised economic and environmental concerns about their resource inefficiency in inference. Even after training, serving LLMs to each user among millions of users requires substantial energy and water for cooling to […]
[Original post on mas.to]
