English
Related papers

Related papers: Annot-Mix: Learning with Noisy Class Labels from M…

200 papers

Visual sentiment analysis has received increasing attention in recent years. However, the dataset's quality is a concern because the sentiment labels are crowd-sourcing, subjective, and prone to mistakes, and poses a severe threat to the…

Computer Vision and Pattern Recognition · Computer Science 2022-01-28 Wei Zhu , Zihe Zheng , Haitian Zheng , Hanjia Lyu , Jiebo Luo

The presence of noisy labels in a training dataset can significantly impact the performance of machine learning models. To tackle this issue, researchers have explored methods for Learning with Noisy Labels to identify clean samples and…

Machine Learning · Computer Science 2023-10-30 Sumyeong Ahn , Sihyeon Kim , Jongwoo Ko , Se-Young Yun

Noisy labels severely hinder the accuracy and generalization of machine learning models, especially when ambiguous instance features make reliable annotation difficult. Existing approaches, including transition-matrix-based label…

Machine Learning · Computer Science 2026-05-12 Yuxiang Zheng , Zhongyi Han , Yilong Yin

Learning with the \textit{instance-dependent} label noise is challenging, because it is hard to model such real-world noise. Note that there are psychological and physiological evidences showing that we humans perceive instances by…

Machine Learning · Computer Science 2020-12-04 Xiaobo Xia , Tongliang Liu , Bo Han , Nannan Wang , Mingming Gong , Haifeng Liu , Gang Niu , Dacheng Tao , Masashi Sugiyama

In large-scale supervised learning, penalized logistic regression (PLR) effectively mitigates overfitting through regularization, yet its performance critically depends on robust variable selection. This paper demonstrates that label noise…

Machine Learning · Computer Science 2026-02-16 Xiaofei Wu , Rongmei Liangse

Supervised learning can be viewed as distilling relevant information from input data into feature representations. This process becomes difficult when supervision is noisy as the distilled information might not be relevant. In fact, recent…

Machine Learning · Computer Science 2022-06-28 Yingyi Chen , Shell Xu Hu , Xi Shen , Chunrong Ai , Johan A. K. Suykens

Supervised fine-tuning of large language models relies on human-annotated data, yet annotation pipelines routinely involve multiple crowdworkers of heterogeneous expertise. Standard practice aggregates labels via majority vote or simple…

Machine Learning · Computer Science 2026-04-21 Sajjad Ghiasvand , Mark Beliaev , Mahnoosh Alizadeh , Ramtin Pedarsani

Noisy labels, resulting from mistakes in manual labeling or webly data collecting for supervised learning, can cause neural networks to overfit the misleading information and degrade the generalization performance. Self-supervised learning…

Machine Learning · Computer Science 2021-11-02 Cheng Tan , Jun Xia , Lirong Wu , Stan Z. Li

Label noise and class imbalance commonly coexist in real-world data. Previous works for robust learning, however, usually address either one type of the data biases and underperform when facing them both. To mitigate this gap, this work…

Machine Learning · Computer Science 2023-09-06 Shenwang Jiang , Jianan Li , Jizhou Zhang , Ying Wang , Tingfa Xu

Mixup is a data augmentation technique that creates new examples as convex combinations of training points and labels. This simple technique has empirically shown to improve the accuracy of many state-of-the-art models in different settings…

Machine Learning · Computer Science 2026-05-28 Luigi Carratino , Moustapha Cissé , Rodolphe Jenatton , Jean-Philippe Vert

Robustness to label noise within data is a significant challenge in federated learning (FL). From the data-centric perspective, the data quality of distributed datasets can not be guaranteed since annotations of different clients contain…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Xuefeng Jiang , Jia Li , Nannan Wu , Zhiyuan Wu , Xujing Li , Sheng Sun , Gang Xu , Yuwei Wang , Qi Li , Min Liu

Numerous studies have shown that label noise can lead to poor generalization performance, negatively affecting classification accuracy. Therefore, understanding the effectiveness of classifiers trained using deep neural networks in the…

Machine Learning · Computer Science 2026-03-10 Haixia Liu , Boxiao Li , Can Yang , Yang Wang

Supervised learning, especially supervised deep learning, requires large amounts of labeled data. One approach to collect large amounts of labeled data is by using a crowdsourcing platform where numerous workers perform the annotation…

Machine Learning · Computer Science 2023-08-22 Kosuke Yoshimura , Hisashi Kashima

In this paper, we address the limitations of the common data annotation and training methods for objective single-label classification tasks. Typically, when annotating such tasks annotators are only asked to provide a single label for each…

Computation and Language · Computer Science 2023-11-10 Ben Wu , Yue Li , Yida Mu , Carolina Scarton , Kalina Bontcheva , Xingyi Song

In order to reduce overfitting, neural networks are typically trained with data augmentation, the practice of artificially generating additional training data via label-preserving transformations of existing training examples. While these…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Cecilia Summers , Michael J. Dinneen

Improper or erroneous labelling can pose a hindrance to reliable generalization for supervised learning. This can have negative consequences, especially for critical fields such as healthcare. We propose an effective new approach for…

Machine Learning · Computer Science 2021-11-16 Konstantinos Nikolaidis , Thomas Plagemann , Stein Kristiansen , Vera Goebel , Mohan Kankanhalli

Most studies on learning from noisy labels rely on unrealistic models of i.i.d. label noise, such as class-conditional transition matrices. More recent work on instance-dependent noise models are more realistic, but assume a single…

Machine Learning · Computer Science 2021-06-10 Glenn Dawson , Robi Polikar

While label fusion from multiple noisy annotations is a well understood concept in data wrangling (tackled for example by the Dawid-Skene (DS) model), we consider the extended problem of carrying out learning when the labels themselves are…

Machine Learning · Statistics 2020-08-10 Michael P. J. Camilleri , Christopher K. I. Williams

Training deep neural networks with noisy labels remains a significant challenge, often leading to degraded performance. Existing methods for handling label noise typically rely on either transition matrix, noise detection, or meta-learning…

Machine Learning · Computer Science 2026-03-17 Zhanhui Lin , Yanlin Liu , Sanping Zhou

Supervised classification heavily depends on datasets annotated by humans. However, in subjective tasks such as toxicity classification, these annotations often exhibit low agreement among raters. Annotations have commonly been aggregated…

Computation and Language · Computer Science 2024-05-17 Negar Mokhberian , Myrl G. Marmarelis , Frederic R. Hopp , Valerio Basile , Fred Morstatter , Kristina Lerman