English
Related papers

Related papers: Promises and Pitfalls of Threshold-based Auto-labe…

200 papers

Software systems increasingly include AI components based on deep learning (DL). Reliable testing of such systems requires near-perfect test-input validity and label accuracy, with minimal human effort. Yet, the DL community has largely…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Mohammad Hossein Amini , Mehrdad Sabetzadeh , Shiva Nejati

State-of-the-art semi-supervised learning (SSL) approaches rely on highly confident predictions to serve as pseudo-labels that guide the training on unlabeled samples. An inherent drawback of this strategy stems from the quality of the…

Machine Learning · Computer Science 2024-03-26 Shambhavi Mishra , Balamurali Murugesan , Ismail Ben Ayed , Marco Pedersoli , Jose Dolz

As artificial intelligence (AI) becomes integral to economy and society, communication gaps between developers, users, and stakeholders hinder trust and informed decision-making. High-level AI labels, inspired by frameworks like EU energy…

Artificial Intelligence · Computer Science 2025-01-22 Raphael Fischer , Magdalena Wischnewski , Alexander van der Staay , Katharina Poitz , Christian Janiesch , Thomas Liebig

Machine learning practitioners often have access to a spectrum of data: labeled data for the target task (which is often limited), unlabeled data, and auxiliary data, the many available labeled datasets for other tasks. We describe TAGLETS,…

Machine Learning · Computer Science 2022-05-09 Wasu Piriyakulkij , Cristina Menghini , Ross Briden , Nihal V. Nayak , Jeffrey Zhu , Elaheh Raisi , Stephen H. Bach

Mislabeled data is a pervasive issue that undermines the performance of machine learning systems in real-world applications. An effective approach to mitigate this problem is to detect mislabeled instances and subject them to special…

Machine Learning · Computer Science 2025-11-05 Ilies Chibane , Thomas George , Pierre Nodet , Vincent Lemaire

In training their newly-developed malware detection methods, researchers rely on threshold-based labeling strategies that interpret the scan reports provided by online platforms, such as VirusTotal. The dynamicity of this platform renders…

Cryptography and Security · Computer Science 2020-07-02 Aleieldin Salem

Pseudo-Labeling is a simple and effective approach to semi-supervised learning. It requires criteria that guide the selection of pseudo-labeled data. The latter have been shown to crucially affect pseudo-labeling's generalization…

Machine Learning · Computer Science 2023-09-27 Julian Rodemann

Semi-supervised learning holds great promise for many real-world applications, due to its ability to leverage both unlabeled and expensive labeled data. However, most semi-supervised learning algorithms still heavily rely on the limited…

Machine Learning · Computer Science 2023-12-29 Huiling Qin , Xianyuan Zhan , Yuanxun Li , Yu Zheng

We explore the problem of learning under selective labels in the context of algorithm-assisted decision making. Selective labels is a pervasive selection bias problem that arises when historical decision making blinds us to the true outcome…

Machine Learning · Computer Science 2018-07-06 Maria De-Arteaga , Artur Dubrawski , Alexandra Chouldechova

In semi-supervised learning, methods that rely on confidence learning to generate pseudo-labels have been widely proposed. However, increasing research finds that when faced with noisy and biased data, the model's representation network is…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Yanbiao Ma , Licheng Jiao , Fang Liu , Lingling Li , Shuyuan Yang , Xu Liu

Semi-Supervised Learning (SSL) has advanced classification tasks by inputting both labeled and unlabeled data to train a model jointly. However, existing SSL methods only consider the unlabeled data whose predictions are beyond a fixed…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Zechen Liang , Yuan-Gen Wang , Wei Lu , Xiaochun Cao

Applying deep learning to solve real-life instances of hard combinatorial problems has tremendous potential. Research in this direction has focused on the Boolean satisfiability (SAT) problem, both because of its theoretical centrality and…

Artificial Intelligence · Computer Science 2023-06-06 Dimitris Achlioptas , Amrit Daswaney , Periklis A. Papakonstantinou

Automated machine learning (AutoML) aims to select and configure machine learning algorithms and combine them into machine learning pipelines tailored to a dataset at hand. For supervised learning tasks, most notably binary and multinomial…

Machine Learning · Computer Science 2024-02-29 Marcel Wever

In semi-supervised learning, the paradigm of self-training refers to the idea of learning from pseudo-labels suggested by the learner itself. Across various domains, corresponding methods have proven effective and achieve state-of-the-art…

Machine Learning · Statistics 2023-06-12 Julian Lienen , Caglar Demir , Eyke Hüllermeier

The critical challenge of Semi-Supervised Learning (SSL) is how to effectively leverage the limited labeled data and massive unlabeled data to improve the model's generalization performance. In this paper, we first revisit the popular…

Machine Learning · Computer Science 2023-03-16 Hao Chen , Ran Tao , Yue Fan , Yidong Wang , Jindong Wang , Bernt Schiele , Xing Xie , Bhiksha Raj , Marios Savvides

Semi-supervised multi-label learning (SSMLL) is a powerful framework for leveraging unlabeled data to reduce the expensive cost of collecting precise multi-label annotations. Unlike semi-supervised learning, one cannot select the most…

Machine Learning · Computer Science 2024-12-30 Jia-Hao Xiao , Ming-Kun Xie , Heng-Bo Fan , Gang Niu , Masashi Sugiyama , Sheng-Jun Huang

Semi-supervised learning (SSL) has been a fundamental challenge in machine learning for decades. The primary family of SSL algorithms, known as pseudo-labeling, involves assigning pseudo-labels to confident unlabeled instances and…

Machine Learning · Computer Science 2023-10-31 Muyang Li , Runze Wu , Haoyu Liu , Jun Yu , Xun Yang , Bo Han , Tongliang Liu

Semi-supervised learning is a powerful technique for leveraging unlabeled data to improve machine learning models, but it can be affected by the presence of ``informative'' labels, which occur when some classes are more likely to be labeled…

Machine Learning · Statistics 2023-02-16 Aude Sportisse , Hugo Schmutz , Olivier Humbert , Charles Bouveyron , Pierre-Alexandre Mattei

Active Learning (AL) aims to reduce the labeling burden by interactively selecting the most informative samples from a pool of unlabeled data. While there has been extensive research on improving AL query methods in recent years, some…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Carsten T. Lüth , Till J. Bungert , Lukas Klein , Paul F. Jaeger

Federated Learning (FL) proposed in recent years has received significant attention from researchers in that it can bring separate data sources together and build machine learning models in a collaborative but private manner. Yet, in most…

Machine Learning · Computer Science 2020-05-12 Yilun Jin , Xiguang Wei , Yang Liu , Qiang Yang