English
Related papers

Related papers: Dirichlet-Based Prediction Calibration for Learnin…

200 papers

Label smoothing is an effective regularization tool for deep neural networks (DNNs), which generates soft labels by applying a weighted average between the uniform distribution and the hard label. It is often used to reduce the overfitting…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Chang-Bin Zhang , Peng-Tao Jiang , Qibin Hou , Yunchao Wei , Qi Han , Zhen Li , Ming-Ming Cheng

Learning from label proportions (LLP) is a weakly supervised classification problem where data points are grouped into bags, and the label proportions within each bag are observed instead of the instance-level labels. The task is to learn a…

Machine Learning · Computer Science 2023-09-26 Jianxin Zhang , Yutong Wang , Clayton Scott

Learning with softmax cross-entropy on one-hot labels often leads to overconfident predictions and poor robustness under noise or perturbations. Label smoothing mitigates this by redistributing some confidence uniformly, but treats all…

Quantum Physics · Physics 2025-10-02 Fang Qi , Lu Peng , Zhengming Ding

Deep neural networks have been shown to be very powerful methods for many supervised learning tasks. However, they can also easily overfit to training set biases, i.e., label noise and class imbalance. While both learning with noisy labels…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Tong Wei , Jiang-Xin Shi , Yu-Feng Li , Min-Ling Zhang

Learning with noisy labels has gained increasing attention because the inevitable imperfect labels in real-world scenarios can substantially hurt the deep model performance. Recent studies tend to regard low-loss samples as clean ones and…

Machine Learning · Computer Science 2024-02-20 Huafeng Liu , Mengmeng Sheng , Zeren Sun , Yazhou Yao , Xian-Sheng Hua , Heng-Tao Shen

The success of modern deep learning algorithms for image segmentation heavily depends on the availability of large datasets with clean pixel-level annotations (masks), where the objects of interest are accurately delineated. Lack of time…

Computer Vision and Pattern Recognition · Computer Science 2021-02-17 Ekaterina Redekop , Alexey Chernyavskiy

Evidential Deep Learning (EDL) is a popular framework for uncertainty-aware classification that models predictive uncertainty via Dirichlet distributions parameterized by neural networks. Despite its popularity, its theoretical foundations…

Machine Learning · Statistics 2026-02-03 Pietro Carlotti , Nevena Gligić , Arya Farahi

Learning with noisy labels is one of the hottest problems in weakly-supervised learning. Based on memorization effects of deep neural networks, training on small-loss instances becomes very promising for handling noisy labels. This fosters…

Machine Learning · Computer Science 2019-05-14 Xingrui Yu , Bo Han , Jiangchao Yao , Gang Niu , Ivor W. Tsang , Masashi Sugiyama

Learning with noisy labels is a practically challenging problem in weakly supervised learning. In the existing literature, open-set noises are always considered to be poisonous for generalization, similar to closed-set noises. In this…

Machine Learning · Computer Science 2021-11-22 Hongxin Wei , Lue Tao , Renchunzi Xie , Bo An

Because deep learning is vulnerable to noisy labels, sample selection techniques, which train networks with only clean labeled data, have attracted a great attention. However, if the labels are dominantly corrupted by few classes, these…

Machine Learning · Computer Science 2021-07-16 Kyeongbo Kong , Junggi Lee , Youngchul Kwak , Young-Rae Cho , Seong-Eun Kim , Woo-Jin Song

Despite the undeniable progress in visual recognition tasks fueled by deep neural networks, there exists recent evidence showing that these models are poorly calibrated, resulting in over-confident predictions. The standard practices of…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Balamurali Murugesan , Bingyuan Liu , Adrian Galdran , Ismail Ben Ayed , Jose Dolz

Performance of neural network models relies on the availability of large datasets with minimal levels of uncertainty. Transfer Learning (TL) models have been proposed to resolve the issue of small dataset size by letting the model train on…

For classification tasks, dictionary learning based methods have attracted lots of attention in recent years. One popular way to achieve this purpose is to introduce label information to generate a discriminative dictionary to represent…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Shuai Shao , Mengke Wang , Rui Xu , Yan-Jiang Wang , Bao-Di Liu

Deep neural network can easily overfit to even noisy labels due to its high capacity, which degrades the generalization performance of a model. To overcome this issue, we propose a new approach for learning from noisy labels (LNL) via…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Seulki Park , Hwanjun Song , Daeho Um , Dae Ung Jo , Sangdoo Yun , Jin Young Choi

Deep learning has shown remarkable success in medical image analysis, but its reliance on large volumes of high-quality labeled data limits its applicability. While noisy labeled data are easier to obtain, directly incorporating them into…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Chengxuan Qian , Kai Han , Jianxia Ding , Chongwen Lyu , Zhenlong Yuan , Jun Chen , Zhe Liu

Designing robust loss functions is popular in learning with noisy labels while existing designs did not explicitly consider the overfitting property of deep neural networks (DNNs). As a result, applying these losses may still suffer from…

Machine Learning · Computer Science 2022-05-27 Hao Cheng , Zhaowei Zhu , Xing Sun , Yang Liu

In this paper, we introduce the Dependent Noise-based Inaccurate Label Distribution Learning (DN-ILDL) framework to tackle the challenges posed by noise in label distribution learning, which arise from dependencies on instances and labels.…

Machine Learning · Computer Science 2024-05-28 Zhiqiang Kou , Jing Wang , Yuheng Jia , Xin Geng

Deep neural networks have proven to be highly effective when large amounts of data with clean labels are available. However, their performance degrades when training data contains noisy labels, leading to poor generalization on the test…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Fahimeh Fooladgar , Minh Nguyen Nhat To , Parvin Mousavi , Purang Abolmaesumi

The recent integration of deep learning and pairwise similarity annotation-based constrained clustering -- i.e., $\textit{deep constrained clustering}$ (DCC) -- has proven effective for incorporating weak supervision into massive data…

Machine Learning · Computer Science 2023-06-01 Tri Nguyen , Shahana Ibrahim , Xiao Fu

The robustness of supervised deep learning-based medical image classification is significantly undermined by label noise. Although several methods have been proposed to enhance classification performance in the presence of noisy labels,…

Machine Learning · Computer Science 2024-10-28 Bidur Khanal , Tianhong Dai , Binod Bhattarai , Cristian Linte