English
Related papers

Related papers: Suggestions on Test Suite Improvements with Automa…

200 papers

Among the many different kinds of program repair techniques, one widely studied family of techniques is called test suite based repair. However, test suites are in essence input-output specifications and are thus typically inadequate for…

Software Engineering · Computer Science 2022-02-03 Zhongxing Yu , Matias Martinez , Benjamin Danglot , Thomas Durieux , Martin Monperrus

Background: Test suites are frequently used to quantify relevant software attributes, such as quality or productivity. Problem: We have detected that the same response variable, measured using different test suites, yields different…

Software Engineering · Computer Science 2022-04-26 Oscar Dieste , Fernando Uyaguari , Sira Vegas , Natalia Juristo

Software developed using modern agile practices delivers a stream of software versions that require continuous regression testing rather than testing once close to the delivery or maintenance phase, as assumed by classical…

Software Engineering · Computer Science 2025-11-05 Suddhasvatta Das , Kevin Gary

As Large Language Models shift the programming toward human-guided ''vibe coding'', agentic coding tools increasingly rely on models to self-diagnose and repair their own subtle faults -- a capability central to autonomous software…

Software Engineering · Computer Science 2026-03-18 Srijan Bansal , Jiao Fangkai , Yilun Zhou , Austin Xu , Shafiq Joty , Semih Yavuz

Model transformations are the cornerstone of Model-Driven Engineering, and provide the essential mechanisms for manipulating and transforming models. Checking whether the output of a model transformation is correct is a manual and…

Software Engineering · Computer Science 2018-05-01 Javier Troya , Sergio Segura , Antonio Ruiz-Cortés

Mutation testing is the state-of-the-art technique for assessing the fault-detection capacity of a test suite. Unfortunately, mutation testing consumes enormous computing resources because it runs the whole test suite for each and every…

Software Engineering · Computer Science 2018-10-10 Sten Vercammen , Mohammad Ghafari , Serge Demeyer , Markus Borg

The modern code review process is an integral part of the current software development practice. Considerable effort is given here to inspect code changes, find defects, suggest an improvement, and address the suggestions of the reviewers.…

Software Engineering · Computer Science 2021-10-27 Md. Khairul Islam , Toufique Ahmed , Rifat Shahriyar , Anindya Iqbal , Gias Uddin

Test case prioritization focuses on finding a suitable order of execution of the test cases in a test suite to meet some performance goals like detecting faults early. It is likely that some test cases execute the program parts that are…

Software Engineering · Computer Science 2025-08-27 S. Panda , D. Munjal , D. P. Mohapatra

In the software development process, model transformation is increasingly assimilated. However, systems being developed with model transformation sometimes grow in size and become complex. Meanwhile, the performance of model transformation…

Software Engineering · Computer Science 2020-04-21 Vijayshree Vijayshree , Markus Frank , Steffen Becker

Testing symptomatic individuals for a disease can deliver treatment resources, if tests' results turn positive, which speeds up their treatment and might also decrease individuals' contacts to other ones. An imperfect test, however, might…

Populations and Evolution · Quantitative Biology 2015-06-25 Daniel A. M. Villela

Testing software is often costly due to the need of mass-producing test cases and providing a test oracle for it. This is often referred to as the oracle problem. One method that has been proposed in order to alleviate the oracle problem is…

Machine Learning · Computer Science 2020-02-19 Adrian Wildandyawan , Yasuharu Nishi

Test effectiveness refers to the capability of a test suite in exposing faults in software. It is crucial to be aware of factors that influence this capability. We aim at inferring the causal relationship between the two factors (i.e.,…

Software Engineering · Computer Science 2023-03-20 Alireza Aghamohammadi , Seyed-Hassan Mirian-Hosseinabadi

Theorem provers has been used extensively in software engineering for software testing or verification. However, software is now so large and complex that additional architecture is needed to guide theorem provers as they try to generate…

Software Engineering · Computer Science 2021-01-11 Jianfeng Chen , Xipeng Shen , Tim Menzies

Architectural smells such as God Class, Cyclic Dependency, and Hub-like Dependency degrade software quality and maintainability. Existing tools detect such smells but rarely suggest how to fix them. This paper explores the use of…

Software Engineering · Computer Science 2025-07-22 Samal Nursapa , Anastassiya Samuilova , Alessio Bucaioni , Phuong T. Nguyen

The regression test selection problem--selecting a subset of a test-suite given a change--has been studied widely over the past two decades. However, the problem has seen little attention when constrained to high-criticality developments…

Software Engineering · Computer Science 2016-06-16 Andrew V. Jones

Metamorphic testing is a well known approach to tackle the oracle problem in software testing. This technique requires the use of source test cases that serve as seeds for the generation of follow-up test cases. Systematic design of test…

Software Engineering · Computer Science 2018-02-22 Prashanta Saha , Upulee Kanewala

Understanding how software defects manifest and evolve in production environments is critical for improving reliability. While previous research has largely focused on pre-release defects, the nature of residual faults, i.e., those escaping…

Software Engineering · Computer Science 2026-04-30 Domenico Cotroneo , Giuseppe De Rosa , Cristina Improta , Benedetta Gaia Varriale

Testing has become an indispensable activity of software development, yet writing good and relevant tests remains a quite challenging task. One well-known problem is that it often is impossible or unrealistic to test for every outcome, as…

Programming Languages · Computer Science 2017-08-18 Dimitri Racordon , Didier Buchs

Context: Developers design test suites to automatically verify that software meets its expected behaviors. Many dynamic analysis techniques are performed on the exploitation of execution traces from test cases. However, in practice, there…

Software Engineering · Computer Science 2015-06-08 Jifeng Xuan , Benoit Cornu , Matias Martinez , Benoit Baudry , Lionel Seinturier , Martin Monperrus

Test or prove? These two approaches to software verification have long been presented as opposites. One is dynamic, the other static: a test executes the program, a proof only analyzes the program text. A different perspective is emerging,…

Software Engineering · Computer Science 2026-02-10 Li Huang , Bertrand Meyer , Manuel Oriol