English
Related papers

Related papers: Uncertainty Guided Ensemble Self-Training for Semi…

200 papers

The divergence between labeled training data and unlabeled testing data is a significant challenge for recent deep learning models. Unsupervised domain adaptation (UDA) attempts to solve such a problem. Recent works show that self-training…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Ke Mei , Chuang Zhu , Jiaqi Zou , Shanghang Zhang

In the field of semi-supervised medical image segmentation, the shortage of labeled data is the fundamental problem. How to effectively learn image features from unlabeled images to improve segmentation accuracy is the main research…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Zhanhong Qiu , Haitao Gan , Ming Shi , Zhongwei Huang , Zhi Yang

Label noise in training data can significantly degrade a model's generalization performance for supervised learning tasks. Here we focus on the problem that noisy labels are primarily mislabeled samples, which tend to be concentrated near…

Machine Learning · Computer Science 2021-03-16 Hao-Chiang Shao , Hsin-Chieh Wang , Weng-Tai Su , Chia-Wen Lin

The amount of manually labeled data is limited in medical applications, so semi-supervised learning and automatic labeling strategies can be an asset for training deep neural networks. However, the quality of the automatically generated…

Machine Learning · Computer Science 2022-03-04 Wenhui Cui , Haleh Akrami , Anand A. Joshi , Richard M. Leahy

Self-training has been shown to be helpful in addressing data scarcity for many domains, including vision, speech, and language. Specifically, self-training, or pseudo-labeling, labels unsupervised data and adds that to the training pool.…

Computation and Language · Computer Science 2022-12-21 Mozhdeh Gheini , Tatiana Likhomanenko , Matthias Sperber , Hendra Setiawan

Models capable of leveraging unlabelled data are crucial in overcoming large distribution gaps between the acquired datasets across different imaging devices and configurations. In this regard, self-training techniques based on…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Negin Ghamsarian , Javier Gamazo Tejero , Pablo Márquez Neila , Sebastian Wolf , Martin Zinkernagel , Klaus Schoeffmann , Raphael Sznitman

Manual annotation of soiling on surround view cameras is a very challenging and expensive task. The unclear boundary for various soiling categories like water drops or mud particles usually results in a large variance in the annotation…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Michal Uricar , Ganesh Sistu , Lucie Yahiaoui , Senthil Yogamani

Unsupervised Camouflaged Object Detection (UCOD) remains a challenging task due to the high intrinsic similarity between target objects and their surroundings, as well as the reliance on noisy pseudo-labels that hinder fine-grained texture…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Shuo Jiang , Gaojia Zhang , Min Tan , Yufei Yin , Gang Pan

Recent progress in singing voice separation has primarily focused on supervised deep learning methods. However, the scarcity of ground-truth data with clean musical sources has been a problem for long. Given a limited set of labeled data,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-17 Zhepei Wang , Ritwik Giri , Umut Isik , Jean-Marc Valin , Arvindh Krishnaswamy

When a deep learning model is deployed in the wild, it can encounter test data drawn from distributions different from the training data distribution and suffer drop in performance. For safe deployment, it is essential to estimate the…

Machine Learning · Computer Science 2023-05-16 Jiefeng Chen , Frederick Liu , Besim Avci , Xi Wu , Yingyu Liang , Somesh Jha

Self-training methods have proven to be effective in exploiting abundant unlabeled data in semi-supervised learning, particularly when labeled data is scarce. While many of these approaches rely on a cross-entropy loss function (CE), recent…

Machine Learning · Computer Science 2024-09-12 Aurelien Gauffre , Julien Horvat , Massih-Reza Amini

Unsupervised Domain Adaptive Object Detection (UDA-OD) uses unlabelled data to improve the reliability of robotic vision systems in open-world environments. Previous approaches to UDA-OD based on self-training have been effective in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Nicolas Harvey Chapman , Feras Dayoub , Will Browne , Christopher Lehnert

In this paper, we propose a novel \emph{uncertainty-aware graph self-training} approach for semi-supervised node classification. Our method introduces an Expectation-Maximization (EM) regularization scheme to incorporate an uncertainty…

Machine Learning · Computer Science 2025-07-31 Emily Wang , Michael Chen , Chao Li

Semi-supervised learning lately has shown much promise in improving deep learning models when labeled data is scarce. Common among recent approaches is the use of consistency training on a large amount of unlabeled data to constrain model…

Machine Learning · Computer Science 2020-11-06 Qizhe Xie , Zihang Dai , Eduard Hovy , Minh-Thang Luong , Quoc V. Le

The performance of automatic speech recognition (ASR) systems typically degrades significantly when the training and test data domains are mismatched. In this paper, we show that self-training (ST) combined with an uncertainty-based…

Computation and Language · Computer Science 2021-02-17 Sameer Khurana , Niko Moritz , Takaaki Hori , Jonathan Le Roux

Although having achieved great success in medical image segmentation, deep learning-based approaches usually require large amounts of well-annotated data, which can be extremely expensive in the field of medical image analysis. Unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 Yingda Xia , Dong Yang , Zhiding Yu , Fengze Liu , Jinzheng Cai , Lequan Yu , Zhuotun Zhu , Daguang Xu , Alan Yuille , Holger Roth

We introduce an unsupervised formulation to estimate heteroscedastic uncertainty in retrieval systems. We propose an extension to triplet loss that models data uncertainty for each input. Besides improving performance, our formulation…

Computer Vision and Pattern Recognition · Computer Science 2019-02-08 Ahmed Taha , Yi-Ting Chen , Teruhisa Misu , Abhinav Shrivastava , Larry Davis

Applying pseudo labeling techniques has been found to be advantageous in semi-supervised 3D object detection (SSOD) in Bird's-Eye-View (BEV) for autonomous driving, particularly where labeled data is limited. In the literature, Exponential…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Saheli Hazra , Sudip Das , Rohit Choudhary , Arindam Das , Ganesh Sistu , Ciaran Eising , Ujjwal Bhattacharya

Training deep neural networks (DNNs) with limited supervision has been a popular research topic as it can significantly alleviate the annotation burden. Self-training has been successfully applied in semi-supervised learning tasks, but one…

Machine Learning · Computer Science 2023-02-17 Ran Xu , Yue Yu , Hejie Cui , Xuan Kan , Yanqiao Zhu , Joyce Ho , Chao Zhang , Carl Yang

Distantly-Supervised Named Entity Recognition (DS-NER) is widely used in real-world scenarios. It can effectively alleviate the burden of annotation by matching entities in existing knowledge bases with snippets in the text but suffer from…

Computation and Language · Computer Science 2025-07-04 Shuzheng Si , Helan Hu , Haozhe Zhao , Shuang Zeng , Kaikai An , Zefan Cai , Baobao Chang