English
Related papers

Related papers: Evaluating the Environmental Impact of using SLMs …

200 papers

Large Language Models (LLMs) (e.g., ChatGPT) have shown impressive performance in code generation. LLMs take prompts as inputs, and Chain-of-Thought (CoT) prompting is the state-of-the-art prompting technique. CoT prompting asks LLMs first…

Software Engineering · Computer Science 2023-09-08 Jia Li , Ge Li , Yongmin Li , Zhi Jin

Large language models (LLMs) and prompt engineering hold significant potential for advancing computer programming education through personalized instruction. This paper explores this potential by investigating three critical research…

Artificial Intelligence · Computer Science 2024-07-09 Tianyu Wang , Nianjun Zhou , Zhixiong Chen

Context. Nowadays, 83% of software developers use Large Language Models (LLMs) to generate code. LLMs recently became essential to increase the productivity of software developers and decrease the time and cost of software development.…

Software Engineering · Computer Science 2024-05-07 Vlad-Andrei Cursaru , Laura Duits , Joel Milligan , Damla Ural , Berta Rodriguez Sanchez , Vincenzo Stoico , Ivano Malavolta

The rapid adoption of large language models (LLMs) has raised concerns about their substantial energy consumption, especially when deployed at industry scale. While several techniques have been proposed to address this, limited empirical…

Software Engineering · Computer Science 2026-01-07 Pelin Rabia Kuran , Rumbidzai Chitakunye , Vincenzo Stoico , Ilja Heitlager , Justus Bogner

Instruction-tuned Language Models ILMs have become essential components of modern AI systems, demonstrating exceptional versatility across a wide range of natural language and reasoning tasks. Among their most impactful applications is code…

Software Engineering · Computer Science 2026-02-19 Saima Afrin , Zaiyu Cheng , Tushar Sharma , Alexander Serebrenik , Massimiliano Di Penta , Antonio Mastropaolo

This Monte Carlo simulation examines how prompt engineering strategies shape the quality of large language model (LLM)--generated personality assessment items within the AI-GENIE framework for generative psychometrics. Item pools targeting…

Artificial Intelligence · Computer Science 2026-03-18 Lara Lee Russell-Lasalandra , Hudson Golino

Recently, large language models (LLMs) have been successfully applied to many fields, showing outstanding comprehension and reasoning capabilities. Despite their great potential, LLMs usually require dedicated pre-training and fine-tuning…

Networking and Internet Architecture · Computer Science 2024-12-31 Hao Zhou , Chengming Hu , Dun Yuan , Ye Yuan , Di Wu , Xi Chen , Hina Tabassum , Xue Liu

Large language models (LLMs) are increasingly recognized for their exceptional generative capabilities and versatility across various tasks. However, the high inference costs associated with these models have not received adequate…

Computation and Language · Computer Science 2025-03-18 Soham Poddar , Paramita Koley , Janardan Misra , Sanjay Podder , Niloy Ganguly , Saptarshi Ghosh

The rapid growth of artificial intelligence (AI), particularly Large Language Models (LLMs), has raised concerns regarding its global environmental impact that extends beyond greenhouse gas emissions to include consideration of hardware…

Artificial Intelligence · Computer Science 2025-01-28 Clément Desroches , Martin Chauvin , Louis Ladan , Caroline Vateau , Simon Gosset , Philippe Cordier

Interaction with Large Language Models (LLMs) is primarily carried out via prompting. A prompt is a natural language instruction designed to elicit certain behaviour or output from a model. In theory, natural language prompts enable…

Human-Computer Interaction · Computer Science 2024-03-15 Michael Desmond , Michelle Brachman

Code snippet adaptation is a fundamental activity in the software development process. Unlike code generation, code snippet adaptation is not a "free creation", which requires developers to tailor a given code snippet in order to fit…

Software Engineering · Computer Science 2024-11-26 Tanghaoran Zhang , Yue Yu , Xinjun Mao , Shangwen Wang , Kang Yang , Yao Lu , Zhang Zhang , Yuxin Zhao

Large Language Models (LLMs) have shown prominent performance in various downstream tasks and prompt engineering plays a pivotal role in optimizing LLMs' performance. This paper, not only as an overview of current prompt engineering…

Computation and Language · Computer Science 2024-09-18 Haochen Li , Jonathan Leung , Zhiqi Shen

Large Language Models (LLMs) are gaining popularity among software engineers. A crucial aspect of developing effective code generation LLMs is to evaluate these models using a robust benchmark. Evaluation benchmarks with quality issues can…

Software Engineering · Computer Science 2024-09-05 Mohammed Latif Siddiq , Simantika Dristi , Joy Saha , Joanna C. S. Santos

In recent years,Large Language Models (LLMs) have significantly improved in generating high-quality code, enabling their integration into developers' Integrated Development Environments (IDEs) as code assistants. These assistants, such as…

Software Engineering · Computer Science 2024-11-20 Tristan Coignion , Clément Quinton , Romain Rouvoy

Testing plays a pivotal role in ensuring software quality, yet conventional Search Based Software Testing (SBST) methods often struggle with complex software units, achieving suboptimal test coverage. Recent works using large language…

Software Engineering · Computer Science 2024-04-04 Gabriel Ryan , Siddhartha Jain , Mingyue Shang , Shiqi Wang , Xiaofei Ma , Murali Krishna Ramanathan , Baishakhi Ray

Context: AI-assisted tools are increasingly integrated into software development workflows, but their reliance on large language models (LLMs) introduces substantial computational and energy costs. Understanding and reducing the energy…

Software Engineering · Computer Science 2026-02-06 Lola Solovyeva , Fernando Castor

The groundbreaking capabilities of Large Language Models (LLMs) offer new opportunities for enhancing human-computer interaction through emotion-adaptive Artificial Intelligence (AI). However, deliberately controlling the sentiment in these…

Computation and Language · Computer Science 2026-02-09 Kerstin Sahler , Sophie Jentzsch

Small Language Models (SLMs) offer computational efficiency and accessibility, yet a systematic evaluation of their performance and environmental impact remains lacking. We introduce SLM-Bench, the first benchmark specifically designed to…

Computation and Language · Computer Science 2025-09-05 Nghiem Thanh Pham , Tung Kieu , Duc-Manh Nguyen , Son Ha Xuan , Nghia Duong-Trung , Danh Le-Phuoc

As the performance of artificial intelligence systems has dramatically increased, so too has the environmental impact of creating these systems. While many model developers release estimates of the power consumption and carbon emissions…

Computers and Society · Computer Science 2025-03-11 Jacob Morrison , Clara Na , Jared Fernandez , Tim Dettmers , Emma Strubell , Jesse Dodge

The rapid adoption of artificial intelligence (AI) and machine learning (ML) has generated growing interest in understanding their environmental impact and the challenges associated with designing environmentally friendly ML-enabled…

Software Engineering · Computer Science 2024-10-15 Heli Järvenpää , Patricia Lago , Justus Bogner , Grace Lewis , Henry Muccini , Ipek Ozkaya