English
Related papers

Related papers: Debugging Flaky Tests using Spectrum-based Fault L…

200 papers

Flaky tests can make automated software testing unreliable due to their unpredictable behavior. These tests can pass or fail on the same code base on multiple runs. However, flaky tests often do not refer to any fault, even though they can…

Software Engineering · Computer Science 2025-10-31 Hasnain Iqbal , Zerina Begum , Kazi Sakib

In Spectrum-Based Fault Localization (SBFL), a suspiciousness score is assigned to each code element based on test coverage and test outcomes. The scores are then used to rank the code elements relative to each other in order to aid the…

Software Engineering · Computer Science 2021-08-26 Qusay Idrees Sarhan , Bela Vancsics , Arpad Beszedes

Software crashes due to its increasing complexity. Once a crash happens, a crash report could be sent to software developers for investigation upon user permission. Because of the large number of crash reports and limited information,…

Software Engineering · Computer Science 2014-04-17 Liang Gong , Hongyu Zhang , Hyunmin Seo , Sunghun Kim

Despite the proven applicability of the statistical methods in automatic fault localization, these approaches are biased by data collected from different executions of the program. This biasness could result in unstable statistical models…

Software Engineering · Computer Science 2017-12-12 Farid Feyzi , Saeed Parsa

Software failures remain a major challenge in modern software development, and identifying the code elements responsible for failures is a time-consuming debugging task. While extensive research has focused on fault localization in the…

Software Engineering · Computer Science 2026-05-11 Golnaz Gharachorlu , Mahsa Panahandeh , Lionel C. Briand , Ruifeng Gao , Ruiyuan Wan

Providing timely and personalized guidance for students' programming assignments, offers significant practical value for helping students complete assignments and enhance their learning. In recent years, various automated Fault Localization…

Software Engineering · Computer Science 2025-10-01 Fang Liu , Tianze Wang , Li Zhang , Zheyu Yang , Jing Jiang , Zian Sun

Non-deterministic test behavior, or flakiness, is common and dreaded among developers. Researchers have studied the issue and proposed approaches to mitigate it. However, the vast majority of previous work has only considered…

Software Engineering · Computer Science 2023-10-10 Martin Gruber , Muhammad Firhard Roslan , Owain Parry , Fabian Scharnböck , Phil McMinn , Gordon Fraser

The software development process is characterized by an iterative cycle of continuous functionality implementation and debugging, essential for the enhancement of software quality and adaptability to changing requirements. This process…

Software Engineering · Computer Science 2024-11-27 Yihao Qin , Shangwen Wang , Yan Lei , Zhuo Zhang , Bo Lin , Xin Peng , Liqian Chen , Xiaoguang Mao

Fault Localization (FL) aims to automatically localize buggy lines of code, a key first step in many manual and automatic debugging tasks. Previous FL techniques assume the provision of input tests, and often require extensive program…

Software Engineering · Computer Science 2023-10-04 Aidan Z. H. Yang , Ruben Martins , Claire Le Goues , Vincent J. Hellendoorn

This paper presents FauxPy, a fault localization tool for Python programs. FauxPy supports seven well-known fault localization techniques in four families: spectrum-based, mutation-based, predicate switching, and stack trace fault…

Software Engineering · Computer Science 2024-04-30 Mohammad Rezaalipour , Carlo A. Furia

Finding and fixing bugs are time-consuming activities in software development. Spectrum-based fault localization aims to identify the faulty position in source code based on the execution trace of test cases. Failing test cases and their…

Software Engineering · Computer Science 2018-07-06 Jifeng Xuan , Martin Monperrus

Over the past decade, Deep Learning (DL) has become an integral part of our daily lives. This surge in DL usage has heightened the need for developing reliable DL software systems. Given that fault localization is a critical task in…

Software Engineering · Computer Science 2024-11-14 Mohammad Mehdi Morovati , Amin Nikanjam , Foutse Khomh

Regression testing aims to prevent code changes from breaking existing features. Flaky tests negatively affect regression testing because they result in test failures that are not necessarily caused by code changes, thus providing an…

Software Engineering · Computer Science 2024-10-01 Alexander Berndt , Sebastian Baltes , Thomas Bach

In a buggy configurable system, configuration-dependent bugs cause the failures in only certain configurations due to unexpected interactions among features. Manually localizing configuration-dependent faults in configurable systems could…

Software Engineering · Computer Science 2019-11-20 Son Nguyen

A flaky test yields inconsistent results upon repetition, posing a significant challenge to software developers. An extensive study of their presence and characteristics has been done in classical computer software but not quantum computer…

Software Engineering · Computer Science 2025-01-14 Lei Zhang , Andriy Miranskyy

Flaky tests pose a significant issue for software testing. A test with a non-deterministic outcome may undermine the reliability of the testing process, making tests untrustworthy. Previous research has identified test order dependency as…

Software Engineering · Computer Science 2025-01-23 Negar Hashemi , Amjed Tahir , Shawn Rasheed , August Shi , Rachel Blagojevic

Flaky tests that non-deterministically pass or fail waste developer time and slow release cycles. While large language models (LLMs) show promise for automatically repairing flaky tests, existing approaches like FlakyDoctor fail in…

Software Engineering · Computer Science 2025-11-19 Chengpeng Li , Farnaz Behrang , August Shi , Peng Liu

Spreadsheet programs, artifacts developed by non-programmers, are used for a variety of important tasks and decisions. Yet a significant proportion of them have severe quality problems. To address this issue, our previous work presented an…

Software Engineering · Computer Science 2024-12-31 Yirsaw Ayalew , Roland Mittermeir

Debugging is one of the most time-consuming and expensive tasks in software development and circuit design. Several formula-based fault localisation (FBFL) methods have been proposed, but they fail to guarantee a set of diagnoses across all…

Software Engineering · Computer Science 2025-12-03 Pedro Orvalho , Marta Kwiatkowska , Mikoláš Janota , Vasco Manquinho

Although empirical studies have confirmed the effectiveness of spectrum-based fault localization (SBFL) techniques, their performance may be degraded due to presence of some undesired circumstances such as the existence of coincidental…

Software Engineering · Computer Science 2018-07-06 Farid Feyzi , Saeed Parsa