English
Related papers

Related papers: On Assessing the Relevance of Code Reviews Authore…

200 papers

Providing constructive feedback to paper authors is a core component of peer review. With reviewers increasingly having less time to perform reviews, automated support systems are required to ensure high reviewing quality, thus making the…

Computation and Language · Computer Science 2025-09-23 Abdelrahman Sadallah , Tim Baumgärtner , Iryna Gurevych , Ted Briscoe

AI tools, particularly large language modules, have recently proven their effectiveness within learning management systems and online education programmes. As feedback continues to play a crucial role in learning and assessment in schools,…

Human-Computer Interaction · Computer Science 2024-10-17 Ievgeniia Kuzminykh , Tareita Nawaz , Shihao Shenzhang , Bogdan Ghita , Jeffery Raphael , Hannan Xiao

This paper describes an approach to improve code comments along different quality axes by rewriting those comments with customized Artificial Intelligence (AI)-based tools. We conduct an empirical study followed by grounded theory…

Software Engineering · Computer Science 2025-05-15 Maria Dhakal , Chia-Yi Su , Robert Wallace , Chris Fakhimi , Aakash Bansal , Toby Li , Yu Huang , Collin McMillan

Large-scale language models, like ChatGPT, have garnered significant media attention and stunned the public with their remarkable capacity for generating coherent text from short natural language prompts. In this paper, we aim to conduct a…

Computation and Language · Computer Science 2024-12-11 Dongqi Liu , Vera Demberg

The recent success of large language models (LLMs) has shown great potential to develop more powerful conversational recommender systems (CRSs), which rely on natural language conversations to satisfy user needs. In this paper, we embark on…

Computation and Language · Computer Science 2024-06-21 Xiaolei Wang , Xinyu Tang , Wayne Xin Zhao , Jingyuan Wang , Ji-Rong Wen

The rapid development of the Internet has profoundly changed human life. Humans are increasingly expressing themselves and interacting with others on social media platforms. However, although artificial intelligence technology has been…

Computation and Language · Computer Science 2024-07-11 Haochen Xue , Chong Zhang , Chengzhi Liu , Fangyu Wu , Xiaobo Jin

This paper investigates the quality of source code comments automatically generated by Large Language Models (LLMs). While AI-based comment generation has emerged as a promising solution to reduce developers' documentation effort, prior…

Software Engineering · Computer Science 2025-12-02 Ian Guelman , Arthur Gregório Leal , Laerte Xavier , Marco Tulio Valente

Although peer code review is widely adopted in both commercial and open source development, existing studies suggest that such code reviews often contain a significant amount of non-useful review comments. Unfortunately, to date, no tools…

Software Engineering · Computer Science 2018-07-13 Mohammad Masudur Rahman , Chanchal K. Roy , Raula G. Kula

User comments on online programming platforms such as Stack Overflow play a vital role in maintaining the correctness and relevance of shared code examples. However, the majority of comments express gratitude or clarification, while only a…

Software Engineering · Computer Science 2026-04-27 Mehedi Hasan Shanto , Muhammad Asaduzzaman , Alioune Ngom

Since its launch in November 2022, ChatGPT has gained popularity among users, especially programmers who use it as a tool to solve development problems. However, while offering a practical solution to programming problems, ChatGPT should be…

Software Engineering · Computer Science 2023-08-08 Phuong T. Nguyen , Juri Di Rocco , Claudio Di Sipio , Riccardo Rubei , Davide Di Ruscio , Massimiliano Di Penta

Automated code review comment generation (RCG) aims to assist developers by automatically producing natural language feedback for code changes. Existing approaches are primarily either generation-based, using pretrained language models, or…

Software Engineering · Computer Science 2025-06-16 Hyunsun Hong , Jongmoon Baik

This study explores how generative artificial intelligence, specifically ChatGPT, can assist in the evaluation of laboratory reports in Experimental Physics. Two interaction modalities were implemented: an automated API-based evaluation and…

Physics Education · Physics 2026-03-24 Marcos Abreu , Álvaro Suárez , Cecilia Stari , Arturo C. Marti

This study explores how generative artificial intelligence, specifically ChatGPT, can assist in the evaluation of laboratory reports in Experimental Physics. Two interaction modalities were implemented: an automated API-based evaluation and…

Physics Education · Physics 2025-10-21 Marcos Abreu , Álvaro Suárez , Cecilia Stari , Arturo C. Marti

We systematically study the quality of 4,066 ChatGPT-generated code implemented in two popular programming languages, i.e., Java and Python, for 2,033 programming tasks. The goal of this work is three folds. First, we analyze the…

Software Engineering · Computer Science 2023-12-18 Yue Liu , Thanh Le-Cong , Ratnadira Widyasari , Chakkrit Tantithamthavorn , Li Li , Xuan-Bach D. Le , David Lo

After the launch of ChatGPT v.4 there has been a global vivid discussion on the ability of this artificial intelligence powered platform and some other similar ones for the automatic production of all kinds of texts, including scientific…

Computation and Language · Computer Science 2024-04-16 Javier J. Sanchez-Medina

Qualitative research, renowned for its in-depth exploration of complex phenomena, often involves time-intensive analysis, particularly during the coding stage. Existing software for qualitative evaluation frequently lacks automatic coding…

Human-Computer Interaction · Computer Science 2024-07-23 He Zhang , Chuhao Wu , Jingyi Xie , Fiona Rubino , Sydney Graver , ChanMin Kim , John M. Carroll , Jie Cai

Code review is a critical software engineering practice where developers review code changes before integration to ensure code quality, detect defects, and improve maintainability. In recent years, AI agents that can understand code…

Software Engineering · Computer Science 2026-03-18 Suzhen Zhong , Shayan Noei , Ying Zou , Bram Adams

Evaluating the quality of academic journal articles is a time consuming but critical task for national research evaluation exercises, appointments and promotion. It is therefore important to investigate whether Large Language Models (LLMs)…

Digital Libraries · Computer Science 2024-12-02 Mike Thelwall

Good comments help developers understand software faster and provide better maintenance. However, comments are often missing, generally inaccurate, or out of date. Many of these problems can be avoided by automatic comment generation. This…

Software Engineering · Computer Science 2018-10-17 Sergey Matskevich , Colin S. Gordon