English
Related papers

Related papers: SEALing the Gap: A Reference Framework for LLM Inf…

200 papers

Large Language Models, particularly decoder-only generative models such as GPT, are increasingly used to automate Software Engineering tasks. These models are primarily guided through natural language prompts, making prompt engineering a…

Software Engineering · Computer Science 2026-01-06 Alexander Korn , Lea Zaruchas , Chetan Arora , Andreas Metzger , Sven Smolka , Fanyu Wang , Andreas Vogelsang

The shift from cloud-hosted Large Language Models (LLMs) to locally deployed open-source Small Language Models (SLMs) has democratized AI-assisted coding; however, it has also decentralized the environmental footprint of AI. While prompting…

Software Engineering · Computer Science 2026-04-06 Md Afif Al Mamun , Sayan Nath , Gias Uddin , Novarun Deb

Context: The emergence of Large Language Models (LLMs) has significantly transformed Software Engineering (SE) by providing innovative methods for analyzing software repositories. Objectives: Our objective is to establish a practical…

Software Engineering · Computer Science 2024-12-13 Vincenzo de Martino , Joel Castaño , Fabio Palomba , Xavier Franch , Silverio Martínez-Fernández

Carbon footprint accounting is crucial for quantifying greenhouse gas emissions and achieving carbon neutrality.The dynamic nature of processes, accounting rules, carbon-related policies, and energy supply structures necessitates real-time…

Information Retrieval · Computer Science 2024-08-21 Haijin Wang , Mianrong Zhang , Zheng Chen , Nan Shang , Shangheng Yao , Fushuan Wen , Junhua Zhao

Large Language Models (LLMs) have propelled groundbreaking advancements across several domains and are commonly used for text generation applications. However, the computational demands of these complex models pose significant challenges,…

The carbon footprint associated with large language models (LLMs) is a significant concern, encompassing emissions from their training, inference, experimentation, and storage processes, including operational and embodied carbon emissions.…

Computation and Language · Computer Science 2024-01-22 Ahmad Faiz , Sotaro Kaneda , Ruhan Wang , Rita Osi , Prateek Sharma , Fan Chen , Lei Jiang

Reliable causal inference is essential for making decisions in high-stakes areas like medicine, economics, and public policy. However, it remains unclear whether large language models (LLMs) can handle rigorous and trustworthy statistical…

Artificial Intelligence · Computer Science 2026-05-13 Jin Du , Li Chen , Xun Xian , An Luo , Fangqiao Tian , Ganghua Wang , Charles Doss , Xiaotong Shen , Jie Ding

Large Language Models (LLMs) have demonstrated exceptional performance in general knowledge and reasoning tasks across various domains. However, their effectiveness in specialized scientific fields like Chemical and Biological Engineering…

Artificial Intelligence · Computer Science 2025-05-20 Gaurab Sarkar , Sougata Saha

Large language models (LLMs) require substantial computational resources, leading to significant carbon emissions and operational costs. Although training is energy-intensive, the long-term environmental burden arises from inference,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-05 Kolichala Rajashekar , Nafiseh Sharghivand , Radu Prodan , Reza Farahani

In recent years, Large Language Models (LLM) such as ChatGPT, CoPilot, and Gemini have been widely adopted in different areas. As the use of LLMs continues to grow, many efforts have focused on reducing the massive training overheads of…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-30 Hayden Moore , Sirui Qi , Ninad Hogade , Dejan Milojicic , Cullen Bash , Sudeep Pasricha

How does a cause lead to an effect, and which intermediate causal steps explain their connection? This work scrutinizes the mechanistic causal reasoning capabilities of large language models (LLMs) to answer these questions through the task…

Artificial Intelligence · Computer Science 2026-03-19 Liesbeth Allein , Nataly Pineda-Castañeda , Andrea Rocci , Marie-Francine Moens

Large language models (LLMs) offer powerful capabilities but come with significant environmental impact, particularly in carbon emissions. Existing studies benchmark carbon emissions but lack a standardized basis for comparison across…

Machine Learning · Computer Science 2025-05-30 Yanran Wu , Inez Hua , Yi Ding

Growing concerns about climate change and sustainability are driving manufacturers to take significant steps toward reducing their carbon footprints. For these manufacturers, a first step towards this goal is to identify the environmental…

Computation and Language · Computer Science 2025-02-12 Steffen Castle , Julian Moreno Schneider , Leonhard Hennig , Georg Rehm

As large language models (LLMs) witness increasing deployment in complex, high-stakes decision-making scenarios, it becomes imperative to ground their reasoning in causality rather than spurious correlations. However, strong performance on…

Artificial Intelligence · Computer Science 2026-02-24 Yuzhe Wang , Yaochen Zhu , Jundong Li

Large Language Models (LLMs) are increasingly required to generate structured, machine-readable outputs for downstream systems. While recent benchmarks have focused on evaluating the structural correctness of such outputs, the environmental…

Artificial Intelligence · Computer Science 2026-01-21 Elio Masciari , Vincenzo Moscato , Enea Vincenzo Napolitano , Gian Marco Orlando , Marco Perillo , Diego Russo

Large Language Model (LLM) agents are increasingly improved through interaction, yet most self-evolution methods adapt either the policy or the learning environment in isolation. We identify this structural gap as \emph{Agent-Environment…

Computation and Language · Computer Science 2026-05-26 Yihao Hu , Zhihao Wen , Xiujin Liu , Pan Wang , Xin Zhang , Wei Wu

Software Engineering (SE) research involving the use of Large Language Models (LLMs) has introduced several new challenges related to rigour in benchmarking, contamination, replicability, and sustainability. In this paper, we invite the…

Software Engineering · Computer Science 2026-01-21 David Williams , Max Hort , Maria Kechagia , Aldeida Aleti , Justyna Petke , Federica Sarro

Time series forecasting aims to model temporal dependencies among variables for future state inference, holding significant importance and widespread applications in real-world scenarios. Although deep learning-based methods have achieved…

Machine Learning · Computer Science 2026-05-21 Zesen Wang , Lijuan Lan , Yonggang Li

Large Language Models (LLMs) are increasingly used in empirical software engineering (ESE) to automate or assist annotation tasks such as labeling commits, issues, and qualitative artifacts. Yet the reliability and reproducibility of such…

Software Engineering · Computer Science 2026-01-27 Mia Mohammad Imran , Tarannum Shaila Zaman

Large Language Models (LLMs) have become an integral part of many real-world workflows. However, LLMs consume a lot of energy, which becomes a large concern in the scale of the demand for these tools. As LLMs become integrated into…

Software Engineering · Computer Science 2026-05-01 Katelyn Crumpacker , Dimitrios Nikolopoulos