English
Related papers

Related papers: Time-based Repair for Asynchronous Wait Flaky Test…

200 papers

Ensuring the reliability and resilience of modern web applications remains a critical challenge due to increasing system complexity and dynamic runtime environments. This study proposes a modular self-healing framework based on the…

Software Engineering · Computer Science 2026-05-20 Sales Aribe , Rov Japheth Oracion

Modern embedded Linux devices, such as routers, IP cameras, and IoT gateways, rely on complex software stacks where numerous daemons interact to provide services. Testing these devices is crucial from a security perspective since vendors…

Cryptography and Security · Computer Science 2025-09-23 Alessio Izzillo , Riccardo Lazzeretti , Emilio Coppa

Asynchronous iterative methods tolerate straggling processors by allowing workers to proceed with stale data, but at a cost: the iterates become inconsistent, potentially degrading convergence. We investigate whether convergence…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-28 Evan Coleman , Masha Sosonkina

Flaky tests can make automated software testing unreliable due to their unpredictable behavior. These tests can pass or fail on the same code base on multiple runs. However, flaky tests often do not refer to any fault, even though they can…

Software Engineering · Computer Science 2025-10-31 Hasnain Iqbal , Zerina Begum , Kazi Sakib

Like classical software, quantum software systems rely on automated testing. However, their inherently probabilistic outputs make them susceptible to quantum flakiness -- tests that pass or fail inconsistently without code changes. Such…

Software Engineering · Computer Science 2026-03-11 Janakan Sivaloganathan , Ainaz Jamshidi , Andriy Miranskyy , Lei Zhang

A flaky test yields inconsistent results upon repetition, posing a significant challenge to software developers. An extensive study of their presence and characteristics has been done in classical computer software but not quantum computer…

Software Engineering · Computer Science 2025-01-14 Lei Zhang , Andriy Miranskyy

Background: Test flakiness is identified as a major issue that compromises the regression testing process of complex software systems. Flaky tests manifest non-deterministic behaviour, send confusing signals to developers, and break their…

Software Engineering · Computer Science 2021-04-16 Sarra Habchi , Maxime Cordy , Mike Papadakis , Yves Le Traon

Automated program repair (APR) techniques are effective in fixing inevitable defects in software, enhancing development efficiency and software robustness. However, due to the difficulty of generating precise specifications, existing APR…

Software Engineering · Computer Science 2025-10-17 Xu He , Shu Wang , Kun Sun

Automated regression testing is a cornerstone of modern software development, often contributing directly to code review and Continuous Integration (CI). Yet some tests suffer from flakiness, where their outcomes vary non-deterministically.…

Software Engineering · Computer Science 2026-05-29 Tao Xiao , Dong Wang , Shane McIntosh , Hideaki Hata , Yasutaka Kamei

Software updates, including bug repair and feature additions, are frequent in modern applications but they often leave test suites outdated, resulting in undetected bugs and increased chances of system failures. A recent study by Meta…

Software Engineering · Computer Science 2025-03-20 Shanto Rahman , Sachit Kuhar , Berk Cirisci , Pranav Garg , Shiqi Wang , Xiaofei Ma , Anoop Deoras , Baishakhi Ray

Due to the importance of Android app quality assurance, many automated GUI testing tools have been developed. Although the test algorithms have been improved, the impact of GUI rendering has been overlooked. On the one hand, setting a long…

Software Engineering · Computer Science 2023-02-28 Sidong Feng , Mulong Xie , Chunyang Chen

E2E web test suites are prone to test dependencies due to the heterogeneous multi-tiered nature of modern web apps, which makes it difficult for developers to create isolated program states for each test case. In this paper, we present the…

Software Engineering · Computer Science 2019-10-11 Matteo Biagiola , Andrea Stocco , Ali Mesbah , Filippo Ricca , Paolo Tonella

Non-deterministic test behavior, or flakiness, is common and dreaded among developers. Researchers have studied the issue and proposed approaches to mitigate it. However, the vast majority of previous work has only considered…

Software Engineering · Computer Science 2023-10-10 Martin Gruber , Muhammad Firhard Roslan , Owain Parry , Fabian Scharnböck , Phil McMinn , Gordon Fraser

Asynchrony has become an inherent element of JavaScript, as an effort to improve the scalability and performance of modern web applications. To this end, JavaScript provides programmers with a wide range of constructs and features for…

Programming Languages · Computer Science 2019-01-14 Thodoris Sotiropoulos , Benjamin Livshits

Continuous integration at scale is costly but essential to software development. Various test optimization techniques including test selection and prioritization aim to reduce the cost. Test batching is an effective alternative, but…

Software Engineering · Computer Science 2023-08-28 Emad Fallahzadeh , Amir Hossein Bavand , Peter C. Rigby

We introduce a novel approach for testing static typing implementations based on the concept of API-driven program synthesis. The idea is to synthesize type-intensive but small and well-typed programs by leveraging and combining application…

Programming Languages · Computer Science 2023-11-09 Thodoris Sotiropoulos , Stefanos Chaliasos , Zhendong Su

Static analyzers can reason about the properties and behaviors of programs and detect various issues without executing them. Hence, they should extract the necessary information to understand the analyzed program well. Annotation has been a…

Software Engineering · Computer Science 2024-02-23 Huaien Zhang , Yu Pei , Shuyun Liang , Shin Hwei Tan

Test-based automated program repair has been a prolific field of research in software engineering in the last decade. Many approaches have indeed been proposed, which leverage test suites as a weak, but affordable, approximation to program…

Flaky tests pass and fail non-deterministically when run on the same version of code. Although many techniques have been proposed to detect, debug, and repair flaky tests, reproducing their failures remains a major challenge due to their…

Software Engineering · Computer Science 2026-05-22 Suzzana Rafi , Mahbub-Ul-Hoque Sumon , Md Erfan , Maruf Morshed Khan , August Shi , Wing Lam

Flaky tests, tests that pass or fail nondeterministically without changes to code or environment, pose a serious threat to software reliability. While classical software engineering has developed a rich body of dynamic and static techniques…

Software Engineering · Computer Science 2025-12-29 Dongchan Kim , Hamidreza Khoramrokh , Lei Zhang , Andriy Miranskyy