中文
相关论文

相关论文: On Learning Contrastive Representations for Learni…

200 篇论文

This study explores the robustness of label noise classifiers, aiming to enhance model resilience against noisy data in complex real-world scenarios. Label noise in supervised learning, characterized by erroneous or imprecise labels,…

机器学习 · 计算机科学 2023-12-13 Cheng Zeng , Yixuan Xu , Jiaqi Tian

Multi-label classification, which involves assigning multiple labels to a single input, has emerged as a key area in both research and industry due to its wide-ranging applications. Designing effective loss functions is crucial for…

机器学习 · 计算机科学 2025-01-06 Alexandre Audibert , Aurélien Gauffre , Massih-Reza Amini

Numerous researches have proved that deep neural networks (DNNs) can fit everything in the end even given data with noisy labels, and result in poor generalization performance. However, recent studies suggest that DNNs tend to gradually…

机器学习 · 计算机科学 2021-04-07 Hao Yang , Youzhi Jin , Ziyin Li , Deng-Bao Wang , Lei Miao , Xin Geng , Min-Ling Zhang

Real-world datasets commonly have noisy labels, which negatively affects the performance of deep neural networks (DNNs). In order to address this problem, we propose a label noise robust learning algorithm, in which the base classifier is…

机器学习 · 计算机科学 2022-07-13 Görkem Algan , Ilkay Ulusoy

Large language models readily memorize arbitrary training instances, such as label noise, yet they perform strikingly well on reasoning tasks. In this work, we investigate how language models memorize label noise, and why such memorization…

计算与语言 · 计算机科学 2025-10-03 Yupei Du , Philipp Mondorf , Silvia Casola , Yuekun Yao , Robert Litschko , Barbara Plank

Large-scale datasets are essential for the success of deep learning in image retrieval. However, manual assessment errors and semi-supervised annotation techniques can lead to label noise even in popular datasets. As previous works…

计算机视觉与模式识别 · 计算机科学 2022-05-24 Stanislav Dereka , Ivan Karpukhin , Sergey Kolesnikov

Deep neural networks (DNNs) are powerful tools in computer vision tasks. However, in many realistic scenarios label noise is prevalent in the training images, and overfitting to these noisy labels can significantly harm the generalization…

计算机视觉与模式识别 · 计算机科学 2019-07-01 Jan M. Köhler , Maximilian Autenrieth , William H. Beluch

Algorithms which minimize the averaged loss have been widely designed for dealing with noisy labels. Intuitively, when there is a finite training sample, penalizing the variance of losses will improve the stability and generalization of the…

机器学习 · 计算机科学 2022-02-01 Yexiong Lin , Yu Yao , Yuxuan Du , Jun Yu , Bo Han , Mingming Gong , Tongliang Liu

Deep learning has achieved remarkable success in graph-related tasks, yet this accomplishment heavily relies on large-scale high-quality annotated datasets. However, acquiring such datasets can be cost-prohibitive, leading to the practical…

机器学习 · 计算机科学 2024-03-11 Ling-Hao Chen , Yuanshuo Zhang , Taohua Huang , Liangcai Su , Zeyi Lin , Xi Xiao , Xiaobo Xia , Tongliang Liu

Computer vision systems recently made a big leap thanks to deep neural networks. However, these systems require correctly labeled large datasets in order to be trained properly, which is very difficult to obtain for medical applications.…

计算机视觉与模式识别 · 计算机科学 2021-02-16 Görkem Algan , Ilkay Ulusoy , Şaban Gönül , Banu Turgut , Berker Bakbak

Deep neural networks have shown impressive performance in supervised learning, enabled by their ability to fit well to the provided training data. However, their performance is largely dependent on the quality of the training data and often…

机器学习 · 计算机科学 2021-11-11 Abhishek Kumar , Ehsan Amid

Collecting labeled data for the task of semantic segmentation is expensive and time-consuming, as it requires dense pixel-level annotations. While recent Convolutional Neural Network (CNN) based semantic segmentation approaches have…

计算机视觉与模式识别 · 计算机科学 2021-08-20 Xiangyun Zhao , Raviteja Vemulapalli , Philip Mansfield , Boqing Gong , Bradley Green , Lior Shapira , Ying Wu

Contrastive learning has significantly improved representation quality, enhancing knowledge transfer across tasks in continual learning (CL). However, catastrophic forgetting remains a key challenge, as contrastive based methods primarily…

计算机视觉与模式识别 · 计算机科学 2024-12-09 Trung-Anh Dang , Vincent Nguyen , Ngoc-Son Vu , Christel Vrain

In this paper, we study the problem of learning image classification models in the presence of label noise. We revisit a simple compression regularization named Nested Dropout. We find that Nested Dropout, though originally proposed to…

计算机视觉与模式识别 · 计算机科学 2021-04-29 Yingyi Chen , Xi Shen , Shell Xu Hu , Johan A. K. Suykens

Since deep neural networks are over-parameterized, they can memorize noisy examples. We address such a memorization issue in the presence of label noise. From the fact that deep neural networks cannot generalize to neighborhoods of…

机器学习 · 计算机科学 2020-11-12 Jisoo Lee , Sae-Young Chung

Recent information extraction approaches have relied on training deep neural models. However, such models can easily overfit noisy labels and suffer from performance degradation. While it is very costly to filter noisy labels in large…

计算与语言 · 计算机科学 2022-01-24 Wenxuan Zhou , Muhao Chen

Label smoothing (LS) is an arising learning paradigm that uses the positively weighted average of both the hard training labels and uniformly distributed soft labels. It was shown that LS serves as a regularizer for training data with hard…

机器学习 · 计算机科学 2022-06-28 Jiaheng Wei , Hangyu Liu , Tongliang Liu , Gang Niu , Masashi Sugiyama , Yang Liu

Collecting large-scale data with clean labels for supervised training of neural networks is practically challenging. Although noisy labels are usually cheap to acquire, existing methods suffer a lot from label noise. This paper targets at…

机器学习 · 计算机科学 2020-06-16 Zizhao Zhang , Han Zhang , Sercan O. Arik , Honglak Lee , Tomas Pfister

Robust learning from noisy demonstrations is a practical but highly challenging problem in imitation learning. In this paper, we first theoretically show that robust imitation learning can be achieved by optimizing a classification risk…

机器学习 · 统计学 2021-02-22 Voot Tangkaratt , Nontawat Charoenphakdee , Masashi Sugiyama

Noisy labels hurt deep learning-based supervised image classification performance as the models may overfit the noise and learn corrupted feature extractors. For natural image classification training with noisy labeled data, model…

图像与视频处理 · 电气工程与系统科学 2023-08-10 Bidur Khanal , Binod Bhattarai , Bishesh Khanal , Cristian A. Linte