English
Related papers

Related papers: What Types of Code Review Comments Do Developers M…

200 papers

This paper provides a comprehensive review of the current methods and metrics used to evaluate the performance of Large Language Models (LLMs) in code generation tasks. With the rapid growth in demand for automated software development,…

Software Engineering · Computer Science 2025-03-05 Liguo Chen , Qi Guo , Hongrui Jia , Zhengran Zeng , Xin Wang , Yijiang Xu , Jian Wu , Yidong Wang , Qing Gao , Jindong Wang , Wei Ye , Shikun Zhang

Identifying and addressing security issues during the early phase of the development lifecycle is critical for mitigating the long-term negative impacts on software systems. Code review serves as an effective practice that enables…

Software Engineering · Computer Science 2025-10-31 Fang Liu , Simiao Liu , Yinghao Zhu , Xiaoli Lian , Li Zhang

The increasing use of Large Language Models (LLMs) in software development has garnered significant attention from researchers evaluating the capabilities and limitations of LLMs for code generation. However, much of the research focuses on…

Software Engineering · Computer Science 2025-11-10 Xiao Yu , Lei Liu , Xing Hu , Jin Liu , Xin Xia

The paper explores the performance of LLMs in the context of multi-dimensional analytic writing assessments, i.e. their ability to provide both scores and comments based on multiple assessment criteria. Using a corpus of literature reviews…

Computation and Language · Computer Science 2025-06-03 Zhengxiang Wang , Veronika Makarova , Zhi Li , Jordan Kodner , Owen Rambow

Code comments are important for program comprehension, development, and maintenance tasks. Given the varying standards for code comments, and their unstructured or semi-structured nature, developers get easily confused (especially novice…

Software Engineering · Computer Science 2023-04-26 Pooja Rani , Mathias Birrer , Sebastiano Panichella , Mohammad Ghafari , Oscar Nierstrasz

It is known that user-centered approaches to requirements engineering in general lead to a better suited product for the end-users. LLM4RE provides promising approaches to support the requirements elicitation process (e.g. classification of…

Software Engineering · Computer Science 2026-05-14 Cedric Wellhausen , Laura Reinhardt , Kurt Schneider

Code review is critical for ensuring software quality and maintainability. With the rapid growth in software scale and complexity, code review has become a bottleneck in the development process because of its time-consuming and…

Software Engineering · Computer Science 2026-02-24 Yuxin Zhang , Yuxia Zhang , Zeyu Sun , Yanjie Jiang , Hui Liu

Background: Feedback as one of the most influential factors for learning has been subject to a great body of research. It plays a key role in the development of educational technology systems and is traditionally rooted in deterministic…

Artificial Intelligence · Computer Science 2024-12-05 Dominic Lohr , Hieke Keuning , Natalie Kiesler

Smart contract comment generation has gained traction as a means to improve code comprehension and maintainability in blockchain systems. However, evaluating the quality of generated comments remains a challenge. Traditional metrics such as…

Artificial Intelligence · Computer Science 2025-07-29 Fatou Ndiaye Mbodji

The increasing development of LLMs in code generation has drawn significant attention among researchers. To enhance LLM-based code generation ability, current efforts are predominantly directed towards collecting high-quality datasets and…

Software specifications are essential for many Software Engineering (SE) tasks such as bug detection and test generation. Many existing approaches are proposed to extract the specifications defined in natural language form (e.g., comments)…

Software Engineering · Computer Science 2025-02-11 Danning Xie , Byungwoo Yoo , Nan Jiang , Mijung Kim , Lin Tan , Xiangyu Zhang , Judy S. Lee

Large Language Models (LLMs) are widely used to support software developers in tasks such as code generation, optimization, and documentation. However, their ability to improve existing programming answers in a human-like manner remains…

Software Engineering · Computer Science 2026-01-27 Suborno Deb Bappon , Saikat Mondal , Chanchal K. Roy , Kevin Schneider

While code review is central to the software development process, it can be tedious and expensive to carry out. In this paper, we investigate whether and how Large Language Models (LLMs) can aid with code reviews. Our investigation focuses…

Software Engineering · Computer Science 2024-03-14 Rasmus Ingemann Tuffveson Jensen , Vali Tawosi , Salwa Alamir

Large Language Models (LLMs) are nowadays extensively used for various types of software engineering tasks, primarily code generation. Previous research has shown how suitable prompt engineering could help developers in improving their code…

Large Language Models (LLMs) have become powerful tools for automated code generation. However, these models often overlook critical security practices, which can result in the generation of insecure code that contains…

Software Engineering · Computer Science 2025-07-01 Hao Yan , Swapneel Suhas Vaidya , Xiaokuan Zhang , Ziyu Yao

Summarizing software artifacts is an important task that has been thoroughly researched. For evaluating software summarization approaches, human judgment is still the most trusted evaluation. However, it is time-consuming and fatiguing for…

Software Engineering · Computer Science 2024-09-04 Abhishek Kumar , Sonia Haiduc , Partha Pratim Das , Partha Pratim Chakrabarti

The rapid rise of Large Language Models (LLMs) has changed software development, with tools like Copilot, JetBrains AI Assistant, and others boosting developers' productivity. However, developers now spend more time reviewing code than…

Software Engineering · Computer Science 2024-07-08 Agnia Sergeyuk , Olga Lvova , Sergey Titov , Anastasiia Serova , Farid Bagirov , Timofey Bryksin

Large Language Models (LLMs) are increasingly relevant in Software Engineering research and practice, with Automated Bug Fixing (ABF) being one of their key applications. ABF involves transforming a buggy method into its fixed equivalent. A…

Software Engineering · Computer Science 2026-02-02 Antonio Vitale , Emanuela Guglielmi , Simone Scalabrino , Rocco Oliveto

LLMs are increasingly embedded in programming workflows, from code generation to automated code review. Yet, how gendered communication styles interact with LLM-assisted programming and code review remains underexplored. We present a…

Software Engineering · Computer Science 2026-03-26 Lynn Janzen , Üveys Eroglu , Dorothea Kolossa , Pia Knöferle , Sebastian Möller , Vera Schmitt , Veronika Solopova

Context: Code reviews are essential for maintaining software quality, yet many human review comments suffer from issues such as redundancy, vagueness, or lack of constructiveness. These types of comments may slow down feedback and obscure…

Software Engineering · Computer Science 2026-04-28 Semih Çağlar , Şükrü Eren Gökırmak , Eray Tüzün