English
Related papers

Related papers: Testing with AI Agents: An Empirical Study of Test…

200 papers

The increasing use of Generative Artificial Intelligence (GAI) tools in education highlights the need to understand their influence on individuals' thinking processes and agency. This research explored 20 university students' interaction…

Human-Computer Interaction · Computer Science 2024-12-02 Tianlong Zhong , Gaoxia Zhu , Kang You Lim , Yew Soon Ong

Simulation-based verification is beneficial for assessing otherwise dangerous or costly on-road testing of autonomous vehicles (AV). This paper addresses the challenge of efficiently generating effective tests for simulation-based AV…

Multiagent Systems · Computer Science 2020-08-31 Greg Chance , Abanoub Ghobrial , Severin Lemaignan , Tony Pipe , Kerstin Eder

Practice tests for high-stakes assessment are intended to build test familiarity, and reduce construct-irrelevant variance which can interfere with valid score interpretation. Generative AI-driven, automated item generation (AIG) scales the…

Computers and Society · Computer Science 2025-08-26 Jill Burstein , Ramsey Cardwell , Ping-Ling Chuang , Allison Michalowski , Steven Nydick

With generative AI becoming widespread, the existence of AI-based programming assistants for developers is no surprise. Developers increasingly use them for their work, including generating code to fulfil the data protection requirements…

Software Engineering · Computer Science 2025-06-17 Kashumi Madampe , John Grundy , Nalin Arachchilage

The use of generative AI (GenAI) tools has fundamentally transformed software development. Central to this shift is prompt engineering, the practice of crafting textual prompts to guide GenAI tools in generating useful content. Although…

Software Engineering · Computer Science 2026-01-26 Daniel Otten , Trevor Stalnaker , Nathan Wintersgill , Oscar Chaparro , Denys Poshyvanyk

The testing phase is an essential part of software development, but manually creating test cases can be time-consuming. Consequently, there is a growing need for more efficient testing methods. To reduce the burden on developers, various…

Software Engineering · Computer Science 2025-12-15 Sasara Shimizu , Yoshiki Higo

Automated test generation (ATG), which aims to reduce the cost of manual test suite development, has been investigated for decades and has produced countless techniques based on a variety of approaches: symbolic analysis, search-based,…

Software Engineering · Computer Science 2026-05-26 Rangeet Pan , Tyler Stennett , Raju Pavuluri , Nate Levin , Alessandro Orso , Saurabh Sinha

AI research agents can now generate research ideas, design experiments, run code, and draft papers, raising the possibility of large-scale AI-assisted scientific discovery. Many current agent frameworks explicitly encourage the generation…

Computation and Language · Computer Science 2026-05-28 Yixuan Tang , Yi Yang

Agentic AI coding tools increasingly automate software development tasks. Developers can configure these tools through versioned repository-level artifacts such as Markdown and JSON files. We present a systematic analysis of configuration…

As AI systems gain increasing autonomy and execution capability, the number of discovered security vulnerabilities continues to rise. However, many of these vulnerabilities are not fundamentally novel, but instead reflect recurring classes…

Cryptography and Security · Computer Science 2026-05-27 Kevin Eykholt , Dhilung Kirat , Xiaokui Shu , Jiyong Jang , Frederico Araujo , Ian Molloy

AI coding agents increasingly modify real software repositories and make dependency decisions, including adding, removing, or updating third-party packages. These choices can materially affect security posture and maintenance burden, yet…

Software Engineering · Computer Science 2026-02-02 Tanmay Singla , Berk Çakar , Paschal C. Amusuo , James C. Davis

The ongoing shortage of skilled developers, particularly in security-critical software development, has led organizations to increasingly adopt AI-powered development tools to boost productivity and reduce reliance on limited human…

Software Engineering · Computer Science 2026-03-18 Nadine Jost , Benjamin Berens , Manuel Karl , Stefan Albert Horstmann , Martin Johns , Alena Naiakshina

In recent years, the rise of AI-assisted code-generation tools has significantly transformed software development. While code generators have mainly been used to support conventional software development, their use will be extended to…

Software Engineering · Computer Science 2024-12-17 Simon Torka , Sahin Albayrak

Artificial Intelligence (AI) is making a significant impact in multiple areas like medical, military, industrial, domestic, law, arts as AI is capable to perform several roles such as managing smart factories, driving autonomous vehicles,…

Software Engineering · Computer Science 2022-01-17 Zubair Khaliq , Sheikh Umar Farooq , Dawood Ashraf Khan

Programming is essential to modern scientific research, yet most scientists report inadequate training for the software development their work demands. Generative AI tools capable of code generation may support scientific programmers, but…

Software Engineering · Computer Science 2026-04-13 Gabrielle O'Brien , Alexis Parker , Nasir Eisty , Jeffrey Carver

Measuring developer productivity is a topic that has attracted attention from both academic research and industrial practice. In the age of AI coding assistants, it has become even more important for both academia and industry to understand…

Software Engineering · Computer Science 2026-02-04 Valerie Chen , Jasmyn He , Behnjamin Williams , Jason Valentino , Ameet Talwalkar

Automating science laboratories enables faster, safer, more accurate, and more reproducible execution of protocols, accelerating the discovery and testing of new materials, drugs, and more. However, setting up and running autonomous labs…

Artificial Intelligence · Computer Science 2026-05-19 Angelos Angelopoulos , James F. Cahoon , Ron Alterovitz

AI-powered software tools are widely used to assist software engineers. However, there is still a need to understand the productivity benefits of such tools for software engineers. In addition to short-term benefits, there is a question of…

Software Engineering · Computer Science 2025-06-24 Giorgio Amasanti , Jasmin Jahic

As autonomous coding agents see rapid adoption, their evaluation has primarily focused on task completion rates holding the target codebase fixed. This leaves a critical question unanswered: does the structural and stylistic quality, or…

Software Engineering · Computer Science 2026-05-20 Priyansh Trivedi , Olivier Schmitt

Over-reliance on AI systems can undermine users' critical thinking and promote complacency, a risk intensified by the emergence of agentic AI systems that operate with minimal human involvement. In software engineering, agentic coding…

Human-Computer Interaction · Computer Science 2026-03-19 Carlos Rafael Catalan , Lheane Marie Dizon , Patricia Nicole Monderin , Emily Kuang