English
Related papers

Related papers: CoDiM: Learning with Noisy Labels via Contrastive …

200 papers

This work presents a novel approach for semi-supervised semantic segmentation. The key element of this approach is our contrastive learning module that enforces the segmentation network to yield similar pixel-level feature representations…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Inigo Alonso , Alberto Sabater , David Ferstl , Luis Montesano , Ana C. Murillo

In learning tasks with label noise, improving model robustness against overfitting is a pivotal challenge because the model eventually memorizes labels, including the noisy ones. Identifying the samples with noisy labels and preventing the…

Machine Learning · Computer Science 2023-09-28 Reihaneh Torkzadehmahani , Reza Nasirigerdeh , Daniel Rueckert , Georgios Kaissis

Pseudo Labeling is a technique used to improve the performance of semi-supervised Graph Neural Networks (GNNs) by generating additional pseudo-labels based on confident predictions. However, the quality of generated pseudo-labels has been a…

Machine Learning · Computer Science 2023-12-20 Weigang Lu , Ziyu Guan , Wei Zhao , Yaming Yang , Yuanhai Lv , Lining Xing , Baosheng Yu , Dacheng Tao

This paper addresses semi-supervised semantic segmentation by exploiting a small set of images with pixel-level annotations (strong supervisions) and a large set of images with only image-level annotations (weak supervisions). Most existing…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Rumeng Yi , Yaping Huang , Qingji Guan , Mengyang Pu , Runsheng Zhang

Despite the success of deep neural networks (DNNs) in image classification tasks, the human-level performance relies on massive training data with high-quality manual annotations, which are expensive and time-consuming to collect. There…

Machine Learning · Computer Science 2019-04-15 Junnan Li , Yongkang Wong , Qi Zhao , Mohan Kankanhalli

Supervised deep learning performance is heavily tied to the availability of high-quality labels for training. Neural networks can gradually overfit corrupted labels if directly trained on noisy datasets, leading to severe performance…

Machine Learning · Computer Science 2021-02-02 Ziyi Huang , Haofeng Zhang , Andrew Laine , Elsa Angelini , Christine Hendon , Yu Gan

Consistency regularization on label predictions becomes a fundamental technique in semi-supervised learning, but it still requires a large number of training iterations for high performance. In this study, we analyze that the consistency…

Machine Learning · Computer Science 2022-06-10 Doyup Lee , Sungwoong Kim , Ildoo Kim , Yeongjae Cheon , Minsu Cho , Wook-Shin Han

In noisy label learning, estimating noisy class posteriors plays a fundamental role for developing consistent classifiers, as it forms the basis for estimating clean class posteriors and the transition matrix. Existing methods typically…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Rui Zhao , Bin Shi , Jianfei Ruan , Tianze Pan , Bo Dong

Detecting anomalies is one fundamental aspect of a safety-critical software system, however, it remains a long-standing problem. Numerous branches of works have been proposed to alleviate the complication and have demonstrated their…

Machine Learning · Computer Science 2023-01-31 Hyunsoo Cho , Jinseok Seol , Sang-goo Lee

Federated learning with noisy labels (F-LNL) aims at seeking an optimal server model via collaborative distributed learning by aggregating multiple client models trained with local noisy or clean samples. On the basis of a federated…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Jichang Li , Guanbin Li , Hui Cheng , Zicheng Liao , Yizhou Yu

Long-tailed learning has attracted much attention recently, with the goal of improving generalisation for tail classes. Most existing works use supervised learning without considering the prevailing noise in the training dataset. To move…

Machine Learning · Computer Science 2021-08-27 Tong Wei , Jiang-Xin Shi , Wei-Wei Tu , Yu-Feng Li

Self-supervised learning has gained popularity because of its ability to avoid the cost of annotating large-scale datasets. It is capable of adopting self-defined pseudo labels as supervision and use the learned representations for several…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Ashish Jaiswal , Ashwin Ramesh Babu , Mohammad Zaki Zadeh , Debapriya Banerjee , Fillia Makedon

Contrastive self-supervised learning (CSL) is an approach to learn useful representations by solving a pretext task that selects and compares anchor, negative and positive (APN) features from an unlabeled dataset. We present a conceptual…

Computer Vision and Pattern Recognition · Computer Science 2020-09-02 William Falcon , Kyunghyun Cho

Recently, as an effective way of learning latent representations, contrastive learning has been increasingly popular and successful in various domains. The success of constrastive learning in single-label classifications motivates us to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Son D. Dao , Ethan Zhao , Dinh Phung , Jianfei Cai

Self-supervised learning (SSL) has drawn an increased attention in the field of speech processing. Recent studies have demonstrated that contrastive learning is able to learn discriminative speaker embeddings in a self-supervised manner.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-23 Chunlei Zhang , Dong Yu

In standard supervised machine learning, it is necessary to provide a label for every input in the data. While raw data in many application domains is easily obtainable on the Internet, manual labelling of this data is prohibitively…

Machine Learning · Computer Science 2023-09-07 Konstantinos Christopher Tsiolis

Noisy labels are inevitable, even in well-annotated datasets. The detection of noisy labels is of significant importance to enhance the robustness of speaker recognition models. In this paper, we propose a novel noisy label detection…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-21 Yao Shen , Yingying Gao , Yaqian Hao , Chenguang Hu , Fulin Zhang , Junlan Feng , Shilei Zhang

Pseudo-labeling is the most adopted method for pre-training automatic speech recognition (ASR) models. However, its performance suffers from the supervised teacher model's degrading quality in low-resource setups and under domain transfer.…

Computation and Language · Computer Science 2021-03-10 Alex Xiao , Christian Fuegen , Abdelrahman Mohamed

Learning segmentation from noisy labels is an important task for medical image analysis due to the difficulty in acquiring highquality annotations. Most existing methods neglect the pixel correlation and structural prior in segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-22 Shuailin Li , Zhitong Gao , Xuming He

In this work, we used a semi-supervised learning method to train deep learning model that can segment the brain MRI images. The semi-supervised model uses less labeled data, and the performance is competitive with the supervised model with…

Image and Video Processing · Electrical Eng. & Systems 2022-12-07 Hedong Zhang , Anand A. Joshi