English

A Survey on the Green Development of Large Models: From Resource-Efficient Architectures to Hardware-Software Co-Design

Machine Learning 2026-07-10 v1 Computers and Society

Abstract

The rapid expansion of large-scale AI models has led to significant performance breakthroughs across diverse domains, yet it has also raised critical concerns regarding computational costs, energy consumption, and environmental sustainability. This survey provides a comprehensive overview of the green development of large models, emphasizing resource-efficient architectures and full-stack hardware-software co-design. We systematically review recent advances in efficient model construction, including attention operator optimization, linear-complexity architectures, and model sparsification and merging, as well as training and deployment strategies such as data-efficient learning, parameter-efficient fine-tuning, and computational compression. Beyond algorithmic improvements, we explore energy-efficient AI hardware, including mainstream AI chips, memory optimization, cross-platform deployment, and sustainable infrastructure. Furthermore, we examine how large models are being applied to sustainability-critical domains such as DeepSeek, remote sensing interpretation, national-scale infrastructure, and global initiatives. Finally, we discuss key challenges and future directions, highlighting the need for continual learning paradigms, memory-centric hardware, and standardized evaluation protocols. This survey aims to offer a holistic roadmap toward sustainable, scalable, and socially responsible development of large models. Paper homepage: https://cje.ejournal.org.cn/article/doi/10.23919/cje.2025.00.438

Keywords

Cite

@article{arxiv.2607.09084,
  title  = {A Survey on the Green Development of Large Models: From Resource-Efficient Architectures to Hardware-Software Co-Design},
  author = {Linhui Xiao and Guiping Cao and Mingyue Guo and Xianchao Guan and Fan Yang and Ming Tao and Xin Li and Yuxin Peng and Yaowei Wang},
  journal= {arXiv preprint arXiv:2607.09084},
  year   = {2026}
}

Comments

This paper has been accepted by CJE (2026), paper homepage: https://cje.ejournal.org.cn/article/doi/10.23919/cje.2025.00.438