English
Related papers

Related papers: Automated Fix Detection Given Flaky Tests

200 papers

In this paper, we propose to utilize Automated Machine Learning to adaptively search a neural architecture for deepfake detection. This is the first time to employ automated machine learning for deepfake detection. Based on our explored…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Ping Liu , Yuewei Lin , Yang He , Yunchao Wei , Liangli Zhen , Joey Tianyi Zhou , Rick Siow Mong Goh , Jingen Liu

A number of exciting advances have been made in automated fact-checking thanks to increasingly larger datasets and more powerful systems, leading to improvements in the complexity of claims which can be accurately fact-checked. However,…

Computation and Language · Computer Science 2020-11-10 Neema Kotonya , Francesca Toni

Background: Test flakiness is identified as a major issue that compromises the regression testing process of complex software systems. Flaky tests manifest non-deterministic behaviour, send confusing signals to developers, and break their…

Software Engineering · Computer Science 2021-04-16 Sarra Habchi , Maxime Cordy , Mike Papadakis , Yves Le Traon

Flaky tests are a common problem in software testing. They produce inconsistent results when executed multiple times on the same code, invalidating the assumption that a test failure indicates a software defect. Recent work on LLM-based…

Software Engineering · Computer Science 2026-01-15 Alexander Berndt , Thomas Bach , Rainer Gemulla , Marcus Kessel , Sebastian Baltes

The role of regression testing in software testing is crucial as it ensures that any new modifications do not disrupt the existing functionality and behaviour of the software system. The desired outcome is for regression tests to yield…

Software Engineering · Computer Science 2025-06-09 Xin Sun , Daniel Ståhl , Kristian Sandahl

The current article is an interdisciplinary attempt to decipher automatic program repair processes. The review is done by the manner typical to human science known as diffraction. We attempt to spot a gap in the literature of self-healing…

Software Engineering · Computer Science 2020-11-06 S. Amirhossein Mousavi , Donya Azizi Babani , Francesco Flammini

Detecting factual errors in textual information, whether generated by large language models (LLM) or curated by humans, is crucial for making informed decisions. LLMs' inability to attribute their claims to external knowledge and their…

Computation and Language · Computer Science 2023-10-27 Farima Fatahi Bayat , Kun Qian , Benjamin Han , Yisi Sang , Anton Belyi , Samira Khorshidi , Fei Wu , Ihab F. Ilyas , Yunyao Li

Modern automated program repair (APR) is well-tuned to finding and repairing bugs that introduce observable erroneous behavior to a program. However, a significant class of bugs does not lead to such observable behavior (e.g.,…

Software Engineering · Computer Science 2022-11-09 Omar I. Al-Bataineh , Leon Moonen

Prior research has extensively studied flaky tests in various domains, such as web applications, mobile applications, and other open-source projects in a range of multiple programing languages, including Java, Javascript, Python, Ruby, and…

Software Engineering · Computer Science 2025-02-06 Tom Schroeder , Minh Phan , Yang Chen

This paper describes AutoFix, an automatic debugging technique that can fix faults in general-purpose software. To provide high-quality fix suggestions and to enable automation of the whole debugging process, AutoFix relies on the presence…

Software Engineering · Computer Science 2014-05-22 Yu Pei , Carlo A. Furia , Martin Nordio , Yi Wei , Bertrand Meyer , Andreas Zeller

Developers always wish to ensure that their latest changes to the code base do not break existing functionality. If test cases fail, they expect these failures to be connected to the submitted changes. Unfortunately, a flaky test can be the…

Software Engineering · Computer Science 2021-09-10 Azeem Ahmad , Ola Leifler , Kristian Sandahl

This paper considers the problem of fault detection and isolation (FDI) for switched affine models. We first study the model invalidation problem and its application to guaranteed fault detection. Novel and intuitive optimization-based…

Optimization and Control · Mathematics 2017-10-03 Farshad Harirchi , Sze Zheng Yong , Necmiye Ozay

We define a new subclass of nondeterministic finite automata for prefix-closed languages called Flanked Finite Automata (FFA). We show that this class enjoys good complexity properties while preserving the succinctness of nondeterministic…

Formal Languages and Automata Theory · Computer Science 2015-09-23 Florent Avellaneda , Silvano Dal Zilio , Jean-Baptiste Raclet

Automated debugging techniques have the potential to reduce developer effort in debugging, and have matured enough to be adopted by industry. However, one critical issue with existing techniques is that, while developers want rationales for…

Software Engineering · Computer Science 2023-04-06 Sungmin Kang , Bei Chen , Shin Yoo , Jian-Guang Lou

Quality control at each stage of production in textile industry has become a key factor to retaining the existence in the highly competitive global market. Problems of manual fabric defect inspection are lack of accuracy and high time…

Computer Vision and Pattern Recognition · Computer Science 2014-05-26 Md. Tarek Habib , Rahat Hossain Faisal , M. Rokonuzzaman , Farruk Ahmed

Flaky tests (tests with non-deterministic outcomes) can be problematic for testing efficiency and software reliability. Flaky tests in test suites can also significantly delay software releases. There have been several studies that attempt…

Software Engineering · Computer Science 2022-07-05 Negar Hashemi , Amjed Tahir , Shawn Rasheed

This document presents the artifact associated with the ICSE SEIP 25 paper titled On the Diagnosis of Flaky Job Failures: Understanding and Prioritizing Failure Categories. The original paper identifies and analyzes 46 distinct categories…

Software Engineering · Computer Science 2025-03-18 Henri Aïdasso

Non-deterministically passing and failing test cases, so-called flaky tests, have recently become a focus area of software engineering research. While this research focus has been met with some enthusiastic endorsement from industry, prior…

Software Engineering · Computer Science 2022-04-11 Martin Gruber , Gordon Fraser

Fabricating experimental pictures in research work is a serious academic misconduct, which should better be detected in the reviewing process. However, due to large number of submissions, the detection whether a picture is fabricated or…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Binrui Shen , Qiang Niu , Shengxin Zhu

Despite the proven applicability of the statistical methods in automatic fault localization, these approaches are biased by data collected from different executions of the program. This biasness could result in unstable statistical models…

Software Engineering · Computer Science 2017-12-12 Farid Feyzi , Saeed Parsa