English
Related papers

Related papers: Channel-Wise Contrastive Learning for Learning wit…

200 papers

A prominent technique for self-supervised representation learning has been to contrast semantically similar and dissimilar pairs of samples. Without access to labels, dissimilar (negative) points are typically taken to be randomly sampled…

Machine Learning · Computer Science 2020-10-22 Ching-Yao Chuang , Joshua Robinson , Lin Yen-Chen , Antonio Torralba , Stefanie Jegelka

Deep active learning has emerged as a powerful tool for training deep learning models within a predefined labeling budget. These models have achieved performances comparable to those trained in an offline setting. However, deep active…

Machine Learning · Computer Science 2023-09-21 Moseli Mots'oehli , Kyungim Baek

The effectiveness of contrastive learning technology in natural language processing tasks is yet to be explored and analyzed. How to construct positive and negative samples correctly and reasonably is the core challenge of contrastive…

Computation and Language · Computer Science 2023-07-17 Nankai Lin , Guanqiu Qin , Jigang Wang , Aimin Yang , Dong Zhou

Training deep neural networks on real-world datasets is often hampered by the presence of noisy labels, which can be memorized by over-parameterized models, leading to significant degradation in generalization performance. While existing…

Machine Learning · Computer Science 2025-12-18 Jianchao Wang , Qingfeng Li , Pengcheng Zheng , Xiaorong Pu , Yazhou Ren

Contrastive learning has demonstrated promising potential in recommender systems. Existing methods typically construct sparser views by randomly perturbing the original interaction graph, as they have no idea about the authentic user…

Information Retrieval · Computer Science 2025-12-19 Xufeng Liang , Zhida Qin , Chong Zhang , Tianyu Huang , Gangyi Ding

The success of learning with noisy labels (LNL) methods relies heavily on the success of a warm-up stage where standard supervised training is performed using the full (noisy) training set. In this paper, we identify a "warm-up obstacle":…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Evgenii Zheltonozhskii , Chaim Baskin , Avi Mendelson , Alex M. Bronstein , Or Litany

Detecting lane markings in road scenes poses a challenge due to their intricate nature, which is susceptible to unfavorable conditions. While lane markings have strong shape priors, their visibility is easily compromised by lighting…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Ali Zoljodi , Sadegh Abadijou , Mina Alibeigi , Masoud Daneshtalab

Label noise is ubiquitous in real-world scenarios, posing a practical challenge to supervised models due to its effect in hurting the generalization performance of deep neural networks. Existing methods primarily employ the sample selection…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Mengmeng Sheng , Zeren Sun , Tao Chen , Shuchao Pang , Yucheng Wang , Yazhou Yao

Class imbalance and noisy labels are the norm rather than the exception in many large-scale classification datasets. Nevertheless, most works in machine learning typically assume balanced and clean data. There have been some recent attempts…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Shyamgopal Karthik , Jérome Revaud , Boris Chidlovskii

Deep neural networks have incredible capacity and expressibility, and can seemingly memorize any training set. This introduces a problem when training in the presence of noisy labels, as the noisy examples cannot be distinguished from clean…

Machine Learning · Computer Science 2022-10-04 Daniel Shwartz , Uri Stern , Daphna Weinshall

The recent success of deep learning is mostly due to the availability of big datasets with clean annotations. However, gathering a cleanly annotated dataset is not always feasible due to practical challenges. As a result, label noise is a…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Görkem Algan , İlkay Ulusoy

Existing adversarial learning approaches mostly use class labels to generate adversarial samples that lead to incorrect predictions, which are then used to augment the training of the model for improved robustness. While some recent works…

Machine Learning · Computer Science 2020-10-27 Minseon Kim , Jihoon Tack , Sung Ju Hwang

Partial label learning (PLL) is an important problem that allows each training example to be labeled with a coarse candidate set, which well suits many real-world data annotation scenarios with label ambiguity. Despite the promise, the…

Machine Learning · Computer Science 2022-12-01 Haobo Wang , Ruixuan Xiao , Yixuan Li , Lei Feng , Gang Niu , Gang Chen , Junbo Zhao

Pseudo Labeling is a technique used to improve the performance of semi-supervised Graph Neural Networks (GNNs) by generating additional pseudo-labels based on confident predictions. However, the quality of generated pseudo-labels has been a…

Machine Learning · Computer Science 2023-12-20 Weigang Lu , Ziyu Guan , Wei Zhao , Yaming Yang , Yuanhai Lv , Lining Xing , Baosheng Yu , Dacheng Tao

Numerous researches have proved that deep neural networks (DNNs) can fit everything in the end even given data with noisy labels, and result in poor generalization performance. However, recent studies suggest that DNNs tend to gradually…

Machine Learning · Computer Science 2021-04-07 Hao Yang , Youzhi Jin , Ziyin Li , Deng-Bao Wang , Lei Miao , Xin Geng , Min-Ling Zhang

There has been much interest in recent years in learning good classifiers from data with noisy labels. Most work on learning from noisy labels has focused on standard loss-based performance measures. However, many machine learning problems…

Machine Learning · Computer Science 2024-04-25 Mingyuan Zhang , Shivani Agarwal

Training deep neural network (DNN) with noisy labels is practically challenging since inaccurate labels severely degrade the generalization ability of DNN. Previous efforts tend to handle part or full data in a unified denoising flow via…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Boshen Zhang , Yuxi Li , Yuanpeng Tu , Jinlong Peng , Yabiao Wang , Cunlin Wu , Yang Xiao , Cairong Zhao

Label noise in multi-label learning (MLL) poses significant challenges for model training, particularly in partial multi-label learning (PML) where candidate labels contain both relevant and irrelevant labels. While clustering offers a…

Machine Learning · Computer Science 2026-04-13 Yu Chen , Weijun Lv , Yue Huang , Xuhuan Zhu , Fang Li

Label noise widely exists in large-scale datasets and significantly degenerates the performances of deep learning algorithms. Due to the non-identifiability of the instance-dependent noise transition matrix, most existing algorithms address…

Machine Learning · Computer Science 2023-05-16 Hanwen Deng , Weijia Zhang , Min-Ling Zhang

Despite the success of deep neural networks (DNNs) in image classification tasks, the human-level performance relies on massive training data with high-quality manual annotations, which are expensive and time-consuming to collect. There…

Machine Learning · Computer Science 2019-04-15 Junnan Li , Yongkang Wong , Qi Zhao , Mohan Kankanhalli