English
Related papers

Related papers: Comparing AI Coding Agents: A Task-Stratified Anal…

200 papers

Despite the widespread availability of generative AI tools in software engineering, developer adoption remains uneven. This unevenness is problematic because it hampers productivity efforts, frustrates management's expectations, and creates…

Frontier coding agents read configuration files (CLAUDE$.$md, AGENTS$.$md, Cursor Rules) at session start and are expected to follow the conventions inside them. Practitioners assume that structural choices (file size, instruction position,…

Software Engineering · Computer Science 2026-05-12 Damon McMillan

We present a two-stage pipeline for AI-assisted improvement of published algorithm implementations. In the first stage, a large language model with research capabilities identifies recently published algorithms satisfying explicit…

Software Engineering · Computer Science 2026-04-16 Worasait Suwannik

The rapid advancements in Generative AI (GenAI) tools, such as ChatGPT and GitHub Copilot, are transforming software engineering by automating code generation tasks. While these tools improve developer productivity, they also present…

Software Engineering · Computer Science 2024-09-04 Alyssia Chen , Timothy Huo , Yunhee Nam , Dan Port , Anthony Peruma

A persistent challenge in accessible computing is ensuring developers produce web UI code that supports assistive technologies. Despite numerous specialized accessibility tools, novice developers often remain unaware of them, leading to…

Human-Computer Interaction · Computer Science 2025-02-18 Peya Mowar , Yi-Hao Peng , Jason Wu , Aaron Steinfeld , Jeffrey P. Bigham

Recent work has shown that prompting language models with code-like representations of natural language leads to performance improvements on structured reasoning tasks. However, such tasks comprise only a small subset of all natural…

Computation and Language · Computer Science 2023-04-27 Li Zhang , Liam Dugan , Hainiu Xu , Chris Callison-Burch

This study examines the impact of GitHub Copilot on a large sample of Copilot users (n=934,533). The analysis shows that users on average accept nearly 30% of the suggested code, leading to increased productivity. Furthermore, our research…

General Economics · Economics 2023-06-28 Thomas Dohmke , Marco Iansiti , Greg Richards

The rise of AI conversational agents has broadened opportunities to enhance human capabilities across various domains. As these agents become more prevalent, it is crucial to investigate the impact of different affective abilities on their…

Human-Computer Interaction · Computer Science 2023-10-20 Javier Hernandez , Jina Suh , Judith Amores , Kael Rowan , Gonzalo Ramos , Mary Czerwinski

We study whether state-of-the-art AI coding agents, given the same data and research question, produce the same empirical results. Deploying 150 autonomous Claude Code agents to independently test six hypotheses about market quality trends…

Artificial Intelligence · Computer Science 2026-03-20 Ruijiang Gao , Steven Chong Xiao

Although recent developments in generative AI have greatly enhanced the capabilities of conversational agents such as Google's Gemini (formerly Bard) or OpenAI's ChatGPT, it's unclear whether the usage of these agents aids users across…

Human-Computer Interaction · Computer Science 2024-04-03 Crystal Qian , James Wexler

The integration of AI agents as coding assistants into software development has raised questions about the long-term viability of AI agent-generated code. A prevailing hypothesis within the software engineering community suggests this code…

Software Engineering · Computer Science 2026-01-26 Musfiqur Rahman , Emad Shihab

AI-powered coding assistants are rapidly becoming fixtures in professional IDEs, yet their sustained influence on everyday development remains poorly understood. Prior research has focused on short-term use or self-reported perceptions,…

Software Engineering · Computer Science 2026-03-31 Agnia Sergeyuk , Eric Huang , Dariia Karaeva , Anastasiia Serova , Yaroslav Golubev , Iftekhar Ahmed

Code review is central to software engineering education but hard to scale in capstone projects due to tight deadlines, uneven peer feedback, and limited prior experience. We investigate an LLM-as-reviewer integrated directly into GitHub…

Software Engineering · Computer Science 2026-04-28 Eduardo Oliveira , Michael Fu , Patanamon Thongtanunam , Sonsoles López-Pernas , Mohammed Saqr

Context: AI-assisted code generation tools have become increasingly prevalent in software engineering, offering the ability to generate code from natural language prompts or partial code inputs. Notable examples of these tools include…

Software Engineering · Computer Science 2023-10-24 Burak Yetiştiren , Işık Özsoy , Miray Ayerdem , Eray Tüzün

Software Engineering 3.0 marks a paradigm shift in software development, in which AI coding agents are no longer just assistive tools but active contributors. While prior empirical studies have examined productivity gains and acceptance…

Software Engineering · Computer Science 2026-05-14 Daniel Ogenrwot , John Businge

Generative AI is directional: it performs well in some task directions and poorly in others. Knowledge work is directional and endogenous as well: workers can satisfy the same job requirements with different mixes of tasks. We develop a…

General Economics · Economics 2026-02-18 Miklos Koren , Zsofia Barany , Ulrich Wohak

In recent years, AI-based software engineering has progressed from pre-trained models to advanced agentic workflows, with Software Development Agents representing the next major leap. These agents, capable of reasoning, planning, and…

Software Engineering · Computer Science 2024-12-30 Zhi Chen , Lingxiao Jiang

Conversational agents have been gaining increasing popularity in recent years. Influenced by the widespread adoption of task-oriented agents such as Apple Siri and Amazon Alexa, these agents are being deployed into various applications to…

Human-Computer Interaction · Computer Science 2024-01-17 Christopher Clarke , Karthik Krishnamurthy , Walter Talamonti , Yiping Kang , Lingjia Tang , Jason Mars

AI coding assistants have proliferated rapidly, yet structured pedagogical frameworks for learning these tools remain scarce. Developers face a gap between tool documentation and practical mastery, relying on fragmented resources such as…

Computers and Society · Computer Science 2026-05-01 Zain Naboulsi

Claude Code's auto mode is the first deployed permission system for AI coding agents, using a two-stage transcript classifier to gate dangerous tool calls. Anthropic reports a 0.4% false positive rate and 17% false negative rate on…

Software Engineering · Computer Science 2026-04-29 Zimo Ji , Zongjie Li , Wenyuan Jiang , Yudong Gao , Shuai Wang