English
Related papers

Related papers: A Survey on Large Language Models for Software Eng…

200 papers

Large language models (LLMs) have demonstrated impressive performance across a wide range of Natural Language Processing (NLP) tasks. However, ensuring their effectiveness across multiple languages presents unique challenges. Multilingual…

Computation and Language · Computer Science 2025-05-20 Shubham Vatsal , Harsh Dubey , Aditi Singh

Reproducibility is a cornerstone of scientific progress, yet its state in large language model (LLM)-based software engineering (SE) research remains poorly understood. This paper presents the first large-scale, empirical study of…

Software Engineering · Computer Science 2025-12-02 Mohammed Latif Siddiq , Arvin Islam-Gomes , Natalie Sekerak , Joanna C. S. Santos

Large Language Models (LLMs) have seen great advance in both academia and industry, and their popularity results in numerous open-source frameworks and techniques in accelerating LLM pre-training, fine-tuning, and inference. Training and…

Performance · Computer Science 2023-12-04 Longteng Zhang , Xiang Liu , Zeyu Li , Xinglin Pan , Peijie Dong , Ruibo Fan , Rui Guo , Xin Wang , Qiong Luo , Shaohuai Shi , Xiaowen Chu

In the short period since the release of ChatGPT, large language models (LLMs) have changed the software engineering research landscape. While there are numerous opportunities to use LLMs for supporting research or software engineering…

Software Engineering · Computer Science 2025-02-05 Stefan Wagner , Marvin Muñoz Barón , Davide Falessi , Sebastian Baltes

Software testing is a critical component in the software engineering field and is important for software engineering education. Thus, it is vital for academia to continuously improve and update educational methods to reflect the current…

Software Engineering · Computer Science 2025-10-28 Tuan-Phong Ngo , Bao-Ngoc Duong , Tuan-Anh Hoang , Joshua Dwight , Ushik Shrestha Khwakhali

The rise of Artificial Intelligence (AI)-and particularly Large Language Models (LLMs) for code-has reshaped Software Engineering (SE) by enabling the automation of tasks such as code generation, bug detection, and repair. However, these…

Software Engineering · Computer Science 2025-08-18 Saima Afrin , Md Zahidul Haque , Antonio Mastropaolo

Context. Large language models (LLMs) are increasingly applied to code-generating tasks (CGTs) in software engineering. While reported results are promising, the broader effects of such application and their integration into real-world…

Software Engineering · Computer Science 2026-05-26 Muslim Chochlov , Michael English , Jim Buckley

Large Language Models (LLMs) possess substantial reasoning capabilities and are increasingly applied to optimization tasks, particularly in synergy with evolutionary computation. However, while recent surveys have explored specific aspects…

Neural and Evolutionary Computing · Computer Science 2026-01-08 Yisong Zhang , Ran Cheng , Guoxing Yi , Kay Chen Tan

Since 2009, the deep learning revolution, which was triggered by the introduction of ImageNet, has stimulated the synergy between Machine Learning (ML)/Deep Learning (DL) and Software Engineering (SE). Meanwhile, critical reviews have…

Software Engineering · Computer Science 2020-08-14 Simin Wang , Liguo Huang , Jidong Ge , Tengfei Zhang , Haitao Feng , Ming Li , He Zhang , Vincent Ng

Hydro-Science and Engineering (Hydro-SE) is a critical and irreplaceable domain that secures human water supply, generates clean hydropower energy, and mitigates flood and drought disasters. Featuring multiple engineering objectives,…

Large Language Models (LLMs) have emerged as powerful tools capable of understanding and generating human-like text, offering transformative potential across diverse domains. The Security Operations Center (SOC), responsible for…

Cryptography and Security · Computer Science 2025-09-23 Ali Habibzadeh , Farid Feyzi , Reza Ebrahimi Atani

Recent progress in Large Language Models (LLMs) has substantially advanced the automation of software engineering (SE) tasks, enabling complex activities such as code generation and code summarization. However, the black-box nature of LLMs…

Software Engineering · Computer Science 2025-12-24 Antonio Vitale , Khai-Nguyen Nguyen , Denys Poshyvanyk , Rocco Oliveto , Simone Scalabrino , Antonio Mastropaolo

Language is essentially a complex, intricate system of human expressions governed by grammatical rules. It poses a significant challenge to develop capable AI algorithms for comprehending and grasping a language. As a major approach,…

Large Language Models (LLMs) represent an advanced evolution of earlier, simpler language models. They boast enhanced abilities to handle complex language patterns and generate coherent text, images, audios, and videos. Furthermore, they…

Cryptography and Security · Computer Science 2024-03-01 Jun Huang , Jiawei Zhang , Qi Wang , Weihong Han , Yanchun Zhang

Large Language Models (LLMs) are widely used in software engineering to generate, complete, translate, and fix code, improving developer productivity. While most research focuses on the energy consumption and carbon emissions of model…

Software Engineering · Computer Science 2026-04-15 Sabiya Banu Masthan Ali , Oussema Kirmani , Aroosa Hameed , Syed Muhammad Danish , Gautam Srivastava

Large Language Models (LLMs) promise to automate data engineering on tabular data, offering enterprises a valuable opportunity to cut the high costs of manual data handling. But the enterprise domain comes with unique challenges that…

Databases · Computer Science 2025-11-18 Jan-Micha Bodensohn , Ulf Brackmann , Liane Vogel , Anupam Sanghi , Carsten Binnig

Large Language Models (LLMs) for code have gained significant attention recently. They can generate code in different programming languages based on provided prompts, fulfilling a long-lasting dream in Software Engineering (SE), i.e.,…

Software Engineering · Computer Science 2024-03-19 Florian Tambon , Arghavan Moradi Dakhel , Amin Nikanjam , Foutse Khomh , Michel C. Desmarais , Giuliano Antoniol

Recent advancements in large language models (LLMs) have significantly enhanced their coding capabilities. However, existing benchmarks predominantly focused on simplified or isolated aspects of coding, such as single-file code generation…

Computation and Language · Computer Science 2024-12-17 Bowen Li , Wenhan Wu , Ziwei Tang , Lin Shi , John Yang , Jinyang Li , Shunyu Yao , Chen Qian , Binyuan Hui , Qicheng Zhang , Zhiyin Yu , He Du , Ping Yang , Dahua Lin , Chao Peng , Kai Chen

Recently, tool learning with large language models (LLMs) has emerged as a promising paradigm for augmenting the capabilities of LLMs to tackle highly complex problems. Despite growing attention and rapid advancements in this field, the…

Computation and Language · Computer Science 2024-11-05 Changle Qu , Sunhao Dai , Xiaochi Wei , Hengyi Cai , Shuaiqiang Wang , Dawei Yin , Jun Xu , Ji-Rong Wen

Artificial intelligence (AI) has a profound impact on traditional education. In recent years, large language models (LLMs) have been increasingly used in various applications such as natural language processing, computer vision, speech…

Computation and Language · Computer Science 2024-05-24 Hanyi Xu , Wensheng Gan , Zhenlian Qi , Jiayang Wu , Philip S. Yu