English
Related papers

Related papers: FlaKat: A Machine Learning-Based Categorization Fr…

200 papers

Machine-vision-based defect classification techniques have been widely adopted for automatic quality inspection in manufacturing processes. This article describes a general framework for classifying defects from high volume data batches…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Wenbo Sun , Raed Al Kontar , Judy Jin , Tzyy-Shuh Chang

Reliable application of machine learning-based decision systems in the wild is one of the major challenges currently investigated by the field. A large portion of established approaches aims to detect erroneous predictions by means of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Paul F. Jaeger , Carsten T. Lüth , Lukas Klein , Till J. Bungert

Federated Learning (FL) has emerged as a powerful paradigm for training machine learning models in a decentralized manner, preserving data privacy by keeping local data on clients. However, evaluating the robustness of these models against…

Fault detection is crucial for ensuring the safety and reliability of modern industrial systems. However, a significant scientific challenge is the lack of rigorous risk control and reliable uncertainty quantification in existing diagnostic…

Artificial Intelligence · Computer Science 2025-08-05 Mingchen Mei , Yi Li , YiYao Qian , Zijun Jia

Debugging is one of the most time-consuming and expensive tasks in software development. Several formula-based fault localization (FBFL) methods have been proposed, but they fail to guarantee a set of diagnoses across all failing tests or…

Software Engineering · Computer Science 2025-09-08 Pedro Orvalho , Mikoláš Janota , Vasco Manquinho

Flaky tests are a common problem in software testing. They produce inconsistent results when executed multiple times on the same code, invalidating the assumption that a test failure indicates a software defect. Recent work on LLM-based…

Software Engineering · Computer Science 2026-01-15 Alexander Berndt , Thomas Bach , Rainer Gemulla , Marcus Kessel , Sebastian Baltes

Fault localization is a practical research topic that helps developers identify code locations that might cause bugs in a program. Most existing fault localization techniques are designed for imperative programs (e.g., C and Java) and rely…

Software Engineering · Computer Science 2021-02-23 Guolong Zheng , ThanhVu Nguyen , Simón Gutiérrez Brida , Germán Regis , Marcelo F. Frias , Nazareno Aguirre , Hamid Bagheri

This paper considers an ML inspired approach to hypothesis testing known as classifier/classification-accuracy testing ($\mathsf{CAT}$). In $\mathsf{CAT}$, one first trains a classifier by feeding it labeled synthetic samples generated by…

Statistics Theory · Mathematics 2025-11-25 Patrik Róbert Gerber , Yanjun Han , Yury Polyanskiy

Security vulnerabilities play a vital role in network security system. Fuzzing technology is widely used as a vulnerability discovery technology to reduce damage in advance. However, traditional fuzzing techniques have many challenges, such…

Cryptography and Security · Computer Science 2020-08-20 Yan Wang , Peng Jia , Luping Liu , Jiayong Liu

Accurately predicting faulty software units helps practitioners target faulty units and prioritize their efforts to maintain software quality. Prior studies use machine-learning models to detect faulty software code. We revisit past studies…

Software Engineering · Computer Science 2019-01-08 Libo Li , Stefan Lessmann , Bart Baesens

Background: Test flakiness is a major problem in the software industry. Flaky tests fail seemingly at random without changes to the code and thus impede continuous integration (CI). Some researchers argue that all tests can be considered…

Software Engineering · Computer Science 2024-09-17 Alexander Berndt , Thomas Bach , Sebastian Baltes

This document presents the artifact associated with the ICSE SEIP 25 paper titled On the Diagnosis of Flaky Job Failures: Understanding and Prioritizing Failure Categories. The original paper identifies and analyzes 46 distinct categories…

Software Engineering · Computer Science 2025-03-18 Henri Aïdasso

In federated learning (FL), classifiers (e.g., deep networks) are trained on datasets from multiple data centers without exchanging data across them, which improves the sample efficiency. However, the conventional FL setting assumes the…

Machine Learning · Computer Science 2024-02-16 Qiong Zhang , Jing Peng , Xin Zhang , Aline Talhouk , Gang Niu , Xiaoxiao Li

With the emerging application of Federated Learning (FL) in decision-making scenarios, it is imperative to regulate model fairness to prevent disparities across sensitive groups (e.g., female, male). Current research predominantly focuses…

Machine Learning · Computer Science 2025-11-10 Li Zhang , Zhongxuan Han , Xiaohua Feng , Jiaming Zhang , Yuyuan Li , Chaochao Chen

Flaky tests have gained attention from the research community in recent years and with good reason. These tests lead to wasted time and resources, and they reduce the reliability of the test suites and build systems they affect. However,…

Software Engineering · Computer Science 2021-03-05 Alan Romano , Zihe Song , Sampath Grandhi , Wei Yang , Weihang Wang

Computerized Adaptive Testing (CAT) offers an efficient and personalized method for assessing examinee proficiency by dynamically adjusting test questions based on individual performance. Compared to traditional, non-personalized testing…

Classical machine learning classifiers tend to be overconfident can be unreliable outside of the laboratory benchmarks. Properly assessing the reliability of the output of the model per sample is instrumental for real-life scenarios where…

Artificial Intelligence · Computer Science 2025-11-07 Javier Fumanal-Idocin , Javier Andreu-Perez

A flaky test yields inconsistent results upon repetition, posing a significant challenge to software developers. An extensive study of their presence and characteristics has been done in classical computer software but not quantum computer…

Software Engineering · Computer Science 2025-01-14 Lei Zhang , Andriy Miranskyy

Test flakiness is a common problem in industry, which hinders the reliability of automated build and testing workflows. Most existing research on test flakiness has primarily focused on unit and small-scale integration tests. In contrast,…

Software Engineering · Computer Science 2026-03-31 Man Zhang , Chongyang Shen , Andrea Arcuri , Tao Yue

Federated Learning (FL) has emerged as a significant paradigm for training machine learning models. This is due to its data-privacy-preserving property and its efficient exploitation of distributed computational resources. This is achieved…

Machine Learning · Computer Science 2025-01-22 Mustafa Ghaleb , Mohanad Obeed , Muhamad Felemban , Anas Chaaban , Halim Yanikomeroglu