English
Related papers

Related papers: Instance-dependent Label-noise Learning under a St…

200 papers

In label-noise learning, estimating the transition matrix has attracted more and more attention as the matrix plays an important role in building statistically consistent classifiers. However, it is very challenging to estimate the…

Machine Learning · Computer Science 2022-06-08 De Cheng , Tongliang Liu , Yixiong Ning , Nannan Wang , Bo Han , Gang Niu , Xinbo Gao , Masashi Sugiyama

Label noise is frequently observed in real-world large-scale datasets. The noise is introduced due to a variety of reasons; it is heterogeneous and feature-dependent. Most existing approaches to handling noisy labels fall into two…

Machine Learning · Computer Science 2021-03-30 Yikai Zhang , Songzhu Zheng , Pengxiang Wu , Mayank Goswami , Chao Chen

In noisy label learning, estimating noisy class posteriors plays a fundamental role for developing consistent classifiers, as it forms the basis for estimating clean class posteriors and the transition matrix. Existing methods typically…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Rui Zhao , Bin Shi , Jianfei Ruan , Tianze Pan , Bo Dong

Deep learning with noisy labels presents significant challenges. In this work, we theoretically characterize the role of label noise from a feature learning perspective. Specifically, we consider a signal-noise data distribution, where each…

Machine Learning · Statistics 2025-05-27 Andi Han , Wei Huang , Zhanpeng Zhou , Gang Niu , Wuyang Chen , Junchi Yan , Akiko Takeda , Taiji Suzuki

A similarity label indicates whether two instances belong to the same class while a class label shows the class of the instance. Without class labels, a multi-class classifier could be learned from similarity-labeled pairwise data by meta…

Machine Learning · Computer Science 2020-02-18 Songhua Wu , Xiaobo Xia , Tongliang Liu , Bo Han , Mingming Gong , Nannan Wang , Haifeng Liu , Gang Niu

To discover intrinsic inter-class transition probabilities underlying data, learning with noise transition has become an important approach for robust deep learning on corrupted labels. Prior methods attempt to achieve such transition…

Machine Learning · Computer Science 2020-06-15 Jun Shu , Qian Zhao , Zongben Xu , Deyu Meng

Many time series classification tasks, where labels vary over time, are affected by label noise that also varies over time. Such noise can cause label quality to improve, worsen, or periodically change over time. We first propose and…

Machine Learning · Computer Science 2025-03-18 Sujay Nagaraj , Walter Gerych , Sana Tonekaboni , Anna Goldenberg , Berk Ustun , Thomas Hartvigsen

The label noise transition matrix $T$, reflecting the probabilities that true labels flip into noisy ones, is of vital importance to model label noise and design statistically consistent classifiers. The traditional transition matrix is…

Machine Learning · Computer Science 2020-12-03 Xiaobo Xia , Tongliang Liu , Bo Han , Nannan Wang , Jiankang Deng , Jiatong Li , Yinian Mao

Noise in data appears to be inevitable in most real-world machine learning applications and would cause severe overfitting problems. Not only can data features contain noise, but labels are also prone to be noisy due to human input. In this…

Machine Learning · Computer Science 2025-05-09 Weipeng Huang , Qin Li , Yang Xiao , Cheng Qiao , Tie Cai , Junwei Liang , Neil J. Hurley , Guangyuan Piao

Existing research on learning with noisy labels predominantly focuses on synthetic label noise. Although synthetic noise possesses well-defined structural properties, it often fails to accurately replicate real-world noise patterns. In…

Computation and Language · Computer Science 2024-07-10 Hongfei Huang , Tingting Liang , Xixi Sun , Zikang Jin , Yuyu Yin

Deep neural networks have shown impressive performance in supervised learning, enabled by their ability to fit well to the provided training data. However, their performance is largely dependent on the quality of the training data and often…

Machine Learning · Computer Science 2021-11-11 Abhishek Kumar , Ehsan Amid

Images of scenes have various objects as well as abundant attributes, and diverse levels of visual categorization are possible. A natural image could be assigned with fine-grained labels that describe major components, coarse-grained labels…

Computer Vision and Pattern Recognition · Computer Science 2016-10-25 Hexiang Hu , Guang-Tong Zhou , Zhiwei Deng , Zicheng Liao , Greg Mori

We explore contemporary robust classification algorithms for overcoming class-dependant labelling noise: Forward, Importance Re-weighting and T-revision. The classifiers are trained and evaluated on class-conditional random label noise data…

Machine Learning · Computer Science 2021-06-02 Alex Díaz , Damian Steele

Suppose we have a sample of instances paired with binary labels corrupted by arbitrary instance- and label-dependent noise. With sufficiently many such samples, can we optimally classify and rank instances with respect to the noise-free…

Machine Learning · Computer Science 2016-05-05 Aditya Krishna Menon , Brendan van Rooyen , Nagarajan Natarajan

Classical machine learning implicitly assumes that labels of the training data are sampled from a clean distribution, which can be too restrictive for real-world scenarios. However, statistical-learning-based methods may not train deep…

Machine Learning · Computer Science 2021-02-23 Bo Han , Quanming Yao , Tongliang Liu , Gang Niu , Ivor W. Tsang , James T. Kwok , Masashi Sugiyama

Label noise is a critical factor that degrades the generalization performance of deep neural networks, thus leading to severe issues in real-world problems. Existing studies have employed strategies based on either loss or uncertainty to…

Machine Learning · Computer Science 2020-08-17 Wonyoung Shin , Jung-Woo Ha , Shengzhe Li , Yongwoo Cho , Hoyean Song , Sunyoung Kwon

Noise transition matrix (NTM) estimation is a promising approach for learning with label noise. It can infer clean posterior probabilities, known as Label Distribution (LD), based on noisy ones and reduce the impact of noisy labels.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Zehui Liao , Shishuai Hu , Yutong Xie , Yong Xia

Collecting large-scale datasets is crucial for training deep models, annotating the data, however, inevitably yields noisy labels, which poses challenges to deep learning algorithms. Previous efforts tend to mitigate this problem via…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Yuanpeng Tu , Boshen Zhang , Yuxi Li , Liang Liu , Jian Li , Jiangning Zhang , Yabiao Wang , Chengjie Wang , Cai Rong Zhao

Because large, human-annotated datasets suffer from labeling errors, it is crucial to be able to train deep neural networks in the presence of label noise. While training image classification models with label noise have received much…

Machine Learning · Computer Science 2019-03-19 Ishan Jindal , Daniel Pressel , Brian Lester , Matthew Nokleby

Learning from noisy labels is an important and long-standing problem in machine learning for real applications. One of the main research lines focuses on learning a label corrector to purify potential noisy labels. However, these methods…

Machine Learning · Computer Science 2023-12-05 Jian Chen , Ruiyi Zhang , Tong Yu , Rohan Sharma , Zhiqiang Xu , Tong Sun , Changyou Chen