English
Related papers

Related papers: Automatic Feasibility Study via Data Quality Analy…

200 papers

Real-world datasets commonly exhibit noisy labels and class imbalance, such as long-tailed distributions. While previous research addresses this issue by differentiating noisy and clean samples, reliance on information from predictions…

Machine Learning · Computer Science 2024-03-06 Ying-Hsuan Wu , Jun-Wei Hsieh , Li Xin , Shin-You Teng , Yi-Kuan Hsieh , Ming-Ching Chang

Existing works on anomaly detection (AD) rely on clean labels from human annotators that are expensive to acquire in practice. In this work, we propose a method to leverage weak/noisy labels (e.g., risk scores generated by machine rules for…

Machine Learning · Computer Science 2022-11-24 Yue Zhao , Guoqing Zheng , Subhabrata Mukherjee , Robert McCann , Ahmed Awadallah

The recent research in semi-supervised learning (SSL) is mostly dominated by consistency regularization based methods which achieve strong performance. However, they heavily rely on domain-specific data augmentations, which are not easy to…

Machine Learning · Computer Science 2021-04-20 Mamshad Nayeem Rizve , Kevin Duarte , Yogesh S Rawat , Mubarak Shah

Developing large language models is expensive and involves making decisions with small experiments, typically by evaluating on large, multi-task evaluation suites. In this work, we analyze specific properties which make a benchmark more…

Computation and Language · Computer Science 2025-08-19 David Heineman , Valentin Hofmann , Ian Magnusson , Yuling Gu , Noah A. Smith , Hannaneh Hajishirzi , Kyle Lo , Jesse Dodge

This paper aims to devise a generalized maximum likelihood (ML) estimator to robustly detect signals with unknown noise statistics in multiple-input multiple-output (MIMO) systems. In practice, there is little or even no statistical…

Machine Learning · Computer Science 2021-01-22 Ke He , Le He , Lisheng Fan , Yansha Deng , George K. Karagiannidis , Arumugam Nallanathan

In this paper, we study the problem of learning image classification models with label noise. Existing approaches depending on human supervision are generally not scalable as manually identifying correct or incorrect labels is…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Kuang-Huei Lee , Xiaodong He , Lei Zhang , Linjun Yang

Randomized experiments are the gold standard for evaluating the effects of changes to real-world systems. Data in these tests may be difficult to collect and outcomes may have high variance, resulting in potentially large measurement error.…

Machine Learning · Statistics 2018-06-27 Benjamin Letham , Brian Karrer , Guilherme Ottoni , Eytan Bakshy

We demonstrate that learning procedures that rely on aggregated labels, e.g., label information distilled from noisy responses, enjoy robustness properties impossible without data cleaning. This robustness appears in several ways. In the…

Machine Learning · Statistics 2026-05-26 Chen Cheng , John Duchi

Data lies at the core of modern deep learning. The impressive performance of supervised learning is built upon a base of massive accurately labeled data. However, in some real-world applications, accurate labeling might not be viable;…

Noisy labels are a pervasive challenge in medical image classification, where annotation errors arise from inter-observer variability and diagnostic ambiguity. Although several noise-robust learning methods have been proposed, their…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Maycon R. S. Pereira , Filipe R. Cordeiro

The field of Weakly Supervised Learning (WSL) has recently seen a surge of popularity, with numerous papers addressing different types of "supervision deficiencies", namely: poor quality, non adaptability, and insufficient quantity of…

Machine Learning · Computer Science 2021-09-28 Pierre Nodet , Vincent Lemaire , Alexis Bondu , Antoine Cornuéjols

Arbitrary, inconsistent, or faulty decision-making raises serious concerns, and preventing unfair models is an increasingly important challenge in Machine Learning. Data often reflect past discriminatory behavior, and models trained on such…

Machine Learning · Computer Science 2023-06-29 I. Oliveira e Silva , C. Soares , I. Sousa , R. Ghani

One of the key factors of enabling machine learning models to comprehend and solve real-world tasks is to leverage multimodal data. Unfortunately, annotation of multimodal data is challenging and expensive. Recently, self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Elad Amrani , Rami Ben-Ari , Daniel Rotman , Alex Bronstein

We show that large pre-trained language models are inherently highly capable of identifying label errors in natural language datasets: simply examining out-of-sample data points in descending order of fine-tuned task loss significantly…

Computation and Language · Computer Science 2022-12-16 Derek Chong , Jenny Hong , Christopher D. Manning

To design effective digital interventions, experimenters face the challenge of learning decision policies that balance multiple objectives using offline data. Often, they aim to develop policies that maximize goal outcomes, while ensuring…

Machine Learning · Statistics 2025-03-24 Brian Cho , Ana-Roxana Pop , Ariel Evnine , Nathan Kallus

Learning with noisy labels is a practically challenging problem in weakly supervised learning. In the existing literature, open-set noises are always considered to be poisonous for generalization, similar to closed-set noises. In this…

Machine Learning · Computer Science 2021-11-22 Hongxin Wei , Lue Tao , Renchunzi Xie , Bo An

In many applications, training machine learning models involves using large amounts of human-annotated data. Obtaining precise labels for the data is expensive. Instead, training with weak supervision provides a low-cost alternative. We…

Machine Learning · Computer Science 2022-02-09 Chidubem Arachie , Bert Huang

Reliable certification of Large Language Models (LLMs)-verifying that failure rates are below a safety threshold-is critical yet challenging. While "LLM-as-a-Judge" offers scalability, judge imperfections, noise, and bias can invalidate…

Machine Learning · Computer Science 2026-01-30 Chen Feng , Minghe Shen , Ananth Balashankar , Carsten Gerner-Beuerle , Miguel R. D. Rodrigues

We propose a simulation framework for generating instance-dependent noisy labels via a pseudo-labeling paradigm. We show that the distribution of the synthetic noisy labels generated with our framework is closer to human labels compared to…

Machine Learning · Computer Science 2021-10-19 Keren Gu , Xander Masotto , Vandana Bachani , Balaji Lakshminarayanan , Jack Nikodem , Dong Yin

Label-noise or curated unlabeled data is used to compensate for the assumption of clean labeled data in training the conditional generative adversarial network; however, satisfying such an extended assumption is occasionally laborious or…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Kai Katsumata , Duc Minh Vo , Tatsuya Harada , Hideki Nakayama