English
Related papers

Related papers: Testing with AI Agents: An Empirical Study of Test…

200 papers

Generative AI coding tools are relatively new, and their impact on developers extends beyond traditional coding metrics, influencing beliefs about work and developers' roles in the workplace. This study aims to illuminate developers'…

Software Engineering · Computer Science 2024-10-25 Jenna Butler , Jina Suh , Sankeerti Haniyur , Constance Hadley

The use of Generative AI (GenAI) tools in software development has raised questions about their impact on productivity, code quality, and developer practices. Prior research presents mixed findings, with objective analyses identifying…

Software Engineering · Computer Science 2026-05-12 Mark Looi

The integration of generative AI tools like ChatGPT into software engineering workflows opens up new opportunities to boost productivity in tasks such as unit test engineering. However, these AI-assisted workflows can also significantly…

Software Engineering · Computer Science 2025-10-14 Baris Ardic , Quentin Le Dilavrec , Andy Zaidman

AI coding assistants are now widely used in software development. Software developers increasingly integrate AI-generated code into their codebases to improve productivity. Prior studies have shown that AI-generated code may contain code…

Software Engineering · Computer Science 2026-04-28 Yue Liu , Ratnadira Widyasari , Yanjie Zhao , Ivana Clairine Irsan , Junkai Chen , David Lo

Agentic AI and Multi-Agent Systems are poised to dominate industry and society imminently. Powered by goal-driven autonomy, they represent a powerful form of generative AI, marking a transition from reactive content generation into…

Software Engineering · Computer Science 2025-12-29 Brian Bowers , Smita Khapre , Jugal Kalita

AI coding assistants are now central to professional software development, yet their impact on how developers think about and practice security remains poorly understood. While prior work has documented vulnerability rates in AI-generated…

Context: The rapid adoption of AI-assisted code generation tools, such as large language models (LLMs), is transforming software development practices. While these tools promise significant productivity gains, concerns regarding the…

Software Engineering · Computer Science 2026-03-27 Vehid Geruslu , Zulfiyya Aliyeva , Eray Tüzün

Developers now have access to a growing array of increasingly autonomous AI tools for software development. While many studies examine copilots that provide chat assistance or code completions, evaluations of coding agents -- which can…

Software Engineering · Computer Science 2025-09-16 Valerie Chen , Ameet Talwalkar , Robert Brennan , Graham Neubig

Agent-based models play an important role in simulating complex emergent phenomena and supporting critical decisions. In this context, a software fault may result in poorly informed decisions that lead to disastrous consequences. The…

Software Engineering · Computer Science 2021-03-19 Andrew G. Clark , Neil Walkinshaw , Robert M. Hierons

Software testing is a crucial phase in the software development lifecycle (SDLC), ensuring that products meet necessary functional, performance, and quality benchmarks before release. Despite advancements in automation, traditional methods…

Software Engineering · Computer Science 2026-03-10 Mohammad Baqar , Rajat Khanda

Context: The rise of Artificial Intelligence (AI) in software engineering has led to the development of AI-powered test automation tools, promising improved efficiency, reduced maintenance effort, and enhanced defect-detection. However, a…

Software Engineering · Computer Science 2025-05-02 Vahid Garousi , Nithin Joy , Zafar Jafarov , Alper Buğra Keleş , Sevde Değirmenci , Ece Özdemir , Ryan Zarringhalami

We present a comprehensive real-world evaluation of AI-assisted software development tools deployed at enterprise scale. Over one year, 300 engineers across multiple teams integrated an in-house AI platform (DeputyDev) that combines code…

The advancement of natural language processing (NLP) has been significantly boosted by the development of transformer-based large language models (LLMs). These models have revolutionized NLP tasks, particularly in code generation, aiding…

Computation and Language · Computer Science 2024-05-27 Dong Huang , Jie M. Zhang , Michael Luck , Qingwen Bu , Yuhao Qing , Heming Cui

AI coding agents are increasingly contributing to software development, yet their impact on mobile development has received little empirical attention. In this paper, we present the first category-level empirical study of agent-generated…

Software Engineering · Computer Science 2026-02-13 Muhammad Ahmad Khan , Hasnain Ali , Muneeb Rana , Muhammad Saqib Ilyas , Abdul Ali Bangash

Software logging is essential for maintaining and debugging complex systems, yet it remains unclear how AI coding agents handle this non-functional requirement. While prior work characterizes human logging practices, the behaviors of AI…

Software Engineering · Computer Science 2026-04-13 Youssef Esseddiq Ouatiti , Mohammed Sayagh , Hao Li , Ahmed E. Hassan

As AI code assistants become increasingly integrated into software development workflows, understanding how their code compares to human-written programs is critical for ensuring reliability, maintainability, and security. In this paper, we…

Software Engineering · Computer Science 2025-09-01 Domenico Cotroneo , Cristina Improta , Pietro Liguori

AI-based coding agents are increasingly integrated into software development workflows, collaborating with developers to create pull requests (PRs). Despite their growing adoption, the role of human-agent collaboration in software testing…

Software Engineering · Computer Science 2026-01-30 Roberto Milanese , Francesco Salzano , Angelica Spina , Antonio Vitale , Remo Pareschi , Fausto Fasano , Mattia Fazzini

Robotic code needs to be verified to ensure its safety and functional correctness, especially when the robot is interacting with people. Testing real code in simulation is a viable option. However, generating tests that cover rare…

Artificial Intelligence · Computer Science 2016-12-13 Dejanira Araiza-Illan , Anthony G. Pipe , Kerstin Eder

In recent years, AI-based software engineering has progressed from pre-trained models to advanced agentic workflows, with Software Development Agents representing the next major leap. These agents, capable of reasoning, planning, and…

Software Engineering · Computer Science 2024-12-30 Zhi Chen , Lingxiao Jiang

In the first half of 2025, coding agents have emerged as a category of development tools that have very quickly transitioned to the practice. Unlike ''traditional'' code completion LLMs such as Copilot, agents like Cursor, Claude Code, or…

Software Engineering · Computer Science 2026-04-09 Romain Robbes , Théo Matricon , Thomas Degueule , Andre Hora , Stefano Zacchiroli