English
Related papers

Related papers: AI-Assisted Code Review as a Scaffold for Code Qua…

200 papers

The integration of AI assistants, especially through the development of Large Language Models (LLMs), into computer science education has sparked significant debate. An emerging body of work has looked into using LLMs in education, but few…

Human-Computer Interaction · Computer Science 2024-05-06 Wenhan Lyu , Yimeng Wang , Tingting , Chung , Yifan Sun , Yixuan Zhang

LLMs are increasingly employed both as judges for evaluating open-ended outputs and as co-creation partners in AI-assisted programming; yet rigorous evaluation in human-AI co-creation settings remains underdeveloped as judgments must be…

Software Engineering · Computer Science 2026-05-01 Md Faizul Ibne Amin , Yutaka Watanobe , Daniel M. Muepu , Haruto Suzuki , Kenta Nanaumi , Md Mostafizer Rahman

Autonomous coding agents are reshaping software development by creating pull requests (PRs) on GitHub, referred to as agentic PRs. In parallel, the review process is also becoming autonomous, thereby making reviewer bots key actors in the…

Software Engineering · Computer Science 2026-04-28 Syeda Kaneez Fatima , Yousuf Abrar , Abdul Rehman Tahir , Amelia Nawaz , Shamsa Abid , Abdul Ali Bangash

While prior work has examined the generation capabilities of Agentic AI systems, little is known about how reviewers respond to AI-authored code in practice. In this paper, we present a large-scale empirical study of code review dynamics in…

Software Engineering · Computer Science 2026-01-28 Md. Asif Haider , Thomas Zimmermann

We evaluate the effectiveness of LLM-Tutor, a large language model (LLM)-powered tutoring system that combines an AI-based proof-review tutor for real-time feedback on proof-writing and a chatbot for mathematics-related queries. Our…

The increasing use of Generative Artificial Intelligence (GAI) tools in education highlights the need to understand their influence on individuals' thinking processes and agency. This research explored 20 university students' interaction…

Human-Computer Interaction · Computer Science 2024-12-02 Tianlong Zhong , Gaoxia Zhu , Kang You Lim , Yew Soon Ong

Large Language Models (LLMs) are becoming increasingly competent across various domains, educators are showing a growing interest in integrating these LLMs into the learning process. Especially in software engineering, LLMs have…

Software Engineering · Computer Science 2025-02-04 Agrawal Naman , Ridwan Shariffdeen , Guanlin Wang , Sanka Rasnayaka , Ganesh Neelakanta Iyer

Organizations have widely deployed generative AI tools, yet productivity gains remain uneven, suggesting that how people use AI matters as much as whether they have access. We conducted a field experiment with 388 employees at a Fortune 500…

General Economics · Economics 2026-04-21 Alex Farach , Alexia Cambon , Lev Tankelevitch , Connie Hsueh , Rebecca Janssen

Large Language Models (LLMs) increasingly automate software engineering tasks. While recent studies highlight the accelerated adoption of ``AI as a teammate'' in Open Source Software (OSS), developer interaction patterns remain…

Software Engineering · Computer Science 2026-01-21 Haoyu Gao , Peerachai Banyongrakkul , Hao Guan , Mansooreh Zahedi , Christoph Treude

Peer review remains the central quality-control mechanism of science, yet its ability to fulfill this role is increasingly strained. Empirical studies document serious shortcomings: long publication delays, escalating reviewer burden…

The rapid adoption of AI powered coding assistants like ChatGPT and other coding copilots is transforming programming education, raising questions about assessment practices, academic integrity, and skill development. As educators seek…

Computers and Society · Computer Science 2025-05-29 Santiago Berrezueta-Guzman , Stephan Krusche , Stefan Wagner

Large Language Models (LLMs) represent a leap in artificial intelligence, excelling in tasks using human language(s). Although the main focus of general-purpose LLMs is not code generation, they have shown promising results in the domain.…

Software Engineering · Computer Science 2024-01-30 Sanka Rasnayaka , Guanlin Wang , Ridwan Shariffdeen , Ganesh Neelakanta Iyer

Timely and high-quality feedback is essential for effective learning in programming courses; yet, providing such support at scale remains a challenge. While AI-based systems offer scalable and immediate help, their responses can…

Computers and Society · Computer Science 2026-01-27 Tung Phung , Heeryung Choi , Mengyan Wu , Christopher Brooks , Sumit Gulwani , Adish Singla

Large Language Model (LLM) Agents are advancing quickly, with the increasing leveraging of LLM Agents to assist in development tasks such as code generation. While LLM Agents accelerate code generation, studies indicate they may introduce…

Software Engineering · Computer Science 2026-01-30 Haoming Huang , Pongchai Jaisri , Shota Shimizu , Lingfeng Chen , Sota Nakashima , Gema Rodríguez-Pérez

Code review is a common process that is used by developers, in which a reviewer provides useful comments or points out defects in the submitted source code changes via pull request. Code review has been widely used for both industry and…

Software Engineering · Computer Science 2019-12-23 JingKai Siow , Cuiyun Gao , Lingling Fan , Sen Chen , Yang Liu

Over the past decade, modern code review (MCR) has been established as a cornerstone of software quality assurance and a vital channel for knowledge transfer within development teams. However, the manual inspection of increasingly complex…

Software Engineering · Computer Science 2026-03-03 Zezhou Yang , Cuiyun Gao , Zhaoqiang Guo , Zhenhao Li , Kui Liu , Xin Xia , Yuming Zhou

Code review is essential for maintaining software quality but often time-consuming and cognitively demanding, especially in industrial environments. Recent advancements in language models (LMs) have opened new avenues for automating core…

Software Engineering · Computer Science 2025-10-24 Igli Begolli , Meltem Aksoy , Daniel Neider

We present a comprehensive real-world evaluation of AI-assisted software development tools deployed at enterprise scale. Over one year, 300 engineers across multiple teams integrated an in-house AI platform (DeputyDev) that combines code…

Automated Code Review (ACR) is crucial for software quality, yet existing benchmarks often fail to reflect real-world complexities, hindering the evaluation of modern Large Language Models (LLMs). Current benchmarks frequently focus on…

Software Engineering · Computer Science 2025-09-03 Zhengran Zeng , Ruikai Shi , Keke Han , Yixin Li , Kaicheng Sun , Yidong Wang , Zhuohao Yu , Rui Xie , Wei Ye , Shikun Zhang

With the rapid adoption of AI tools in learning contexts, it is vital to understand how these systems shape users' reading processes and cognitive engagement. We collected and analyzed text from 124 sessions with AI tools, in which students…

Human-Computer Interaction · Computer Science 2025-04-22 Yue Fu , Alexis Hiniker