English
Related papers

Related papers: A Practical Framework for Flaky Failure Triage in …

200 papers

This manuscript describes the software package SCOUT, which analyzes, characterizes, and corrects one-dimensional signals. Specifically, it allows to check and correct for stationarity, detect spurious samples, check for normality, check…

Data Analysis, Statistics and Probability · Physics 2019-11-07 Richard Semaan , Vikas Yadav

Cloud computing systems fail in complex and unforeseen ways due to unexpected combinations of events and interactions among hardware and software components. These failures are especially problematic when they are silent, i.e., not…

Software Engineering · Computer Science 2023-01-19 Domenico Cotroneo , Luigi De Simone , Pietro Liguori , Roberto Natella

Spreadsheet programs, artifacts developed by non-programmers, are used for a variety of important tasks and decisions. Yet a significant proportion of them have severe quality problems. To address this issue, our previous work presented an…

Software Engineering · Computer Science 2024-12-31 Yirsaw Ayalew , Roland Mittermeir

In principle, Continuous Integration (CI) pipeline failures provide valuable feedback to developers on code-related errors. In practice, however, pipeline jobs often fail intermittently due to non-deterministic tests, network outages,…

Software Engineering · Computer Science 2026-04-07 Henri Aïdasso , Francis Bordeleau , Ali Tizghadam

Background. Automated test execution is an important activity to gather information about the quality of a software project. So-called flaky tests, however, negatively affect this process. Such tests fail seemingly at random without changes…

Software Engineering · Computer Science 2026-03-02 Alexander Berndt , Zoltán Nochta , Thomas Bach

Learning causal relationships between variables from data is a fundamental research area with many applications across disciplines. Most existing causal discovery algorithms rely on the assumptions that (i) the underlying system is acyclic,…

Machine Learning · Computer Science 2026-05-19 Alpar Turkoglu , Muralikrishnna G. Sethuraman , Faramarz Fekri

The software industry is experiencing a surge in the adoption of Continuous Integration (CI) practices, both in commercial and open-source environments. CI practices facilitate the seamless integration of code changes by employing automated…

Software Engineering · Computer Science 2024-05-17 Hajer Mhalla , Mohamed Aymen Saied

Resilient algorithms in high-performance computing are subject to rigorous non-functional constraints. Resiliency must not increase the runtime, memory footprint or I/O demands too significantly. We propose a task-based soft error detection…

Software Engineering · Computer Science 2021-11-01 Philipp Samfass , Tobias Weinzierl , Anne Reinarz , Michael Bader

Software engineering agents are increasingly deployed in evaluable engineering environments, yet post-failure recovery remains costly, manual, and ad hoc. Existing systems expose traces or generate follow-up feedback, but they do not…

Software Engineering · Computer Science 2026-05-12 Chenyu Zhao , Shenglin Zhang , Yihang Lin , Wenwei Gu , Zhimin Chen , Yongqian Sun , Dan Pei , Chetan Bansal , Saravan Rajmohan , Minghua Ma

Failure indexing is a longstanding crux in software testing and debugging, the goal of which is to automatically divide failures (e.g., failed test cases) into distinct groups according to the culprit root causes, as such multiple faults in…

Software Engineering · Computer Science 2023-11-03 Yi Song , Xihao Zhang , Xiaoyuan Xie , Songqiang Chen , Quanming Liu , Ruizhi Gao

Distributed training is essential for scaling the training of large neural network models, such as large language models (LLMs), across thousands of GPUs. However, the complexity of distributed training programs makes them particularly…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-07 Haitian Jiang , Shaowei Zhu , Zhen Zhang , Zhenyu Song , Xinwei Fu , Zhen Jia , Yida Wang , Jinyang Li

Flaky tests are tests that can non-deterministically pass or fail, even in the absence of code changes.Despite being a source of false alarms, flaky tests often remain in test suites once they are detected, as they also may be relied upon…

Software Engineering · Computer Science 2024-01-30 Abdulrahman Alshammari , Paul Ammann , Michael Hilton , Jonathan Bell

While cloud-native microservice architectures have revolutionized software development, their inherent operational complexity makes failure Root Cause Analysis (RCA) a critical yet challenging task. Numerous data-driven RCA models have been…

Software Engineering · Computer Science 2025-12-24 Aoyang Fang , Songhan Zhang , Yifan Yang , Haotong Wu , Junjielong Xu , Xuyang Wang , Rui Wang , Manyi Wang , Qisheng Lu , Pinjia He

Non-deterministically behaving test cases cause developers to lose trust in their regression test suites and to eventually ignore failures. Detecting flaky tests is therefore a crucial task in maintaining code quality, as it builds the…

Software Engineering · Computer Science 2023-03-21 Martin Gruber , Michael Heine , Norbert Oster , Michael Philippsen , Gordon Fraser

Context: As Industrial Cyber-Physical Systems (ICPS) become more connected and widely-distributed, often operating in safety-critical environments, we require innovative approaches to detect and diagnose the faults that occur in them.…

Software Engineering · Computer Science 2021-01-15 Barry Dowdeswell , Roopak Sinha , Stephen G. MacDonell

Software-defined networking offers numerous benefits against the legacy networking systems through simplifying the process of network management and reducing the cost of network configuration. Currently, the management of failures in the…

Networking and Internet Architecture · Computer Science 2019-04-02 Ali Malik , Benjamin Aziz , Mo Adda , Chih-Heng Ke

Continuous Integration (CI) is a development practice where developers frequently integrate code into a common codebase. After the code is integrated, the CI server runs a test suite and other tools to produce a set of reports (e.g., output…

Software Engineering · Computer Science 2021-07-20 Thomas Durieux , Claire Le Goues , Michael Hilton , Rui Abreu

Many-core accelerators are essential for high-performance deep learning, but their performance is undermined by widespread fail-slow failures. Detecting such failures on-chip is challenging, as prior methods from distributed systems are…

Hardware Architecture · Computer Science 2026-02-26 Junchi Wu , Xinfei Wan , Zhuoran Li , Yuyang Jin , Guangyu Sun , Yun Liang , Diyu Zhou , Youwei Zhuo

Noise and artifacts during computed tomography (CT) scans are a fundamental challenge affecting disease diagnosis. However, current methods either involve excessively long reconstruction times or rely on data-driven models for optimization,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Guoquan Wei , Liu Shi , Shaoyu Wang , Mohan Li , Cunfeng Wei , Qiegen Liu

Safety-critical designs need to ensure reliable operations under hostile conditions with a certain degree of confidence. The continuously higher complexity of these designs makes them more susceptible to the risk of failure. ISO26262…

Software Engineering · Computer Science 2022-04-29 Endri Kaja , Nicolas Gerlin , Luis Rivas , Monideep Bora , Keerthikumara Devarajegowda , Wolfgang Ecker