English
Related papers

Related papers: Unsupervised Continual Learning Via Pseudo Labels

200 papers

In this paper, we work on a sound recognition system that continually incorporates new sound classes. Our main goal is to develop a framework where the model can be updated without relying on labeled data. For this purpose, we propose…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-11 Zhepei Wang , Cem Subakan , Xilin Jiang , Junkai Wu , Efthymios Tzinis , Mirco Ravanelli , Paris Smaragdis

In this paper, we propose a novel unsupervised clustering approach exploiting the hidden information that is indirectly introduced through a pseudo classification objective. Specifically, we randomly assign a pseudo parent-class label to…

Machine Learning · Computer Science 2018-02-12 Ozsel Kilinc , Ismail Uysal

We tackle the problem of discovering novel classes in an image collection given labelled examples of other classes. This setting is similar to semi-supervised learning, but significantly harder because there are no labelled examples for the…

Computer Vision and Pattern Recognition · Computer Science 2020-02-14 Kai Han , Sylvestre-Alvise Rebuffi , Sebastien Ehrhardt , Andrea Vedaldi , Andrew Zisserman

Large amounts of labeled training data are one of the main contributors to the great success that deep models have achieved in the past. Label acquisition for tasks other than benchmarks can pose a challenge due to requirements of both…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Clemens-Alexander Brust , Christoph Käding , Joachim Denzler

Supervised learning in large discriminative models is a mainstay for modern computer vision. Such an approach necessitates investing in large-scale human-annotated datasets for achieving state-of-the-art results. In turn, the efficacy of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Liang-Chieh Chen , Raphael Gontijo Lopes , Bowen Cheng , Maxwell D. Collins , Ekin D. Cubuk , Barret Zoph , Hartwig Adam , Jonathon Shlens

State-of-the-art, high capacity deep neural networks not only require large amounts of labelled training data, they are also highly susceptible to label errors in this data, typically resulting in large efforts and costs and therefore…

Machine Learning · Computer Science 2020-07-20 Christian Haase-Schütz , Rainer Stal , Heinz Hertlein , Bernhard Sick

Pseudo-labelling is a popular technique in unsuper-vised domain adaptation for semantic segmentation. However, pseudo labels are noisy and inevitably have confirmation bias due to the discrepancy between source and target domains and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Wanyu Xu , Zengmao Wang , Wei Bian

Continual learning techniques employ simple replay sample selection processes and use them during subsequent tasks. Typically, they rely on labeled data. In this paper, we depart from this by automatically selecting prototypes stored…

Machine Learning · Computer Science 2025-04-11 Agil Aghasanli , Yi Li , Plamen Angelov

Semi-supervised learning has substantially advanced medical image segmentation since it alleviates the heavy burden of acquiring the costly expert-examined annotations. Especially, the consistency-based approaches have attracted more…

Image and Video Processing · Electrical Eng. & Systems 2022-03-16 Zhe Xu , Yixin Wang , Donghuan Lu , Lequan Yu , Jiangpeng Yan , Jie Luo , Kai Ma , Yefeng Zheng , Raymond Kai-yu Tong

We present Self Meta Pseudo Labels, a novel semi-supervised learning method similar to Meta Pseudo Labels but without the teacher model. We introduce a novel way to use a single model for both generating pseudo labels and classification,…

Machine Learning · Computer Science 2022-12-29 Kei-Sing Ng , Qingchen Wang

Semi-supervised learning frameworks usually adopt mutual learning approaches with multiple submodels to learn from different perspectives. To avoid transferring erroneous pseudo labels between these submodels, a high threshold is usually…

Computer Vision and Pattern Recognition · Computer Science 2023-01-11 Hao Xu , Hui Xiao , Huazheng Hao , Li Dong , Xiaojie Qiu , Chengbin Peng

Pseudo-supervised learning methods have been shown to be effective for weakly supervised object localization tasks. However, the effectiveness depends on the powerful regularization ability of deep neural networks. Based on the assumption…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Kangbo Sun , Jie Zhu

Competitive point cloud semantic segmentation results usually rely on a large amount of labeled data. However, data annotation is a time-consuming and labor-intensive task, particularly for three-dimensional point cloud data. Thus,…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Puzuo Wang , Wei Yao

For challenging machine learning problems such as zero-shot learning and fine-grained categorization, embedding learning is the machinery of choice because of its ability to learn generic notions of similarity, as opposed to class-specific…

Computer Vision and Pattern Recognition · Computer Science 2019-12-19 Ujjal Kr Dutta , Mehrtash Harandi , Chandra Sekhar Chellu

Person re-identification aims to match a person's identity across multiple camera streams. Deep neural networks have been successfully applied to the challenging person re-identification task. One remarkable bottleneck is that the existing…

Computer Vision and Pattern Recognition · Computer Science 2018-05-17 Guodong Ding , Shanshan Zhang , Salman Khan , Zhenmin Tang , Jian Zhang , Fatih Porikli

Deep convolutional neural networks (CNNs) have demonstrated remarkable success in computer vision by supervisedly learning strong visual feature representations. However, training CNNs relies heavily on the availability of exhaustive…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Jiabo Huang , Qi Dong , Shaogang Gong , Xiatian Zhu

Fine-tuning vision-language models (VLMs) like CLIP to downstream tasks is often necessary to optimize their performance. However, a major obstacle is the limited availability of labeled data. We study the use of pseudolabels, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Cristina Menghini , Andrew Delworth , Stephen H. Bach

The advancement of visual tracking has continuously been brought by deep learning models. Typically, supervised learning is employed to train these models with expensive labeled data. In order to reduce the workload of manual annotations…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Ning Wang , Wengang Zhou , Yibing Song , Chao Ma , Wei Liu , Houqiang Li

The amount of manually labeled data is limited in medical applications, so semi-supervised learning and automatic labeling strategies can be an asset for training deep neural networks. However, the quality of the automatically generated…

Machine Learning · Computer Science 2022-03-04 Wenhui Cui , Haleh Akrami , Anand A. Joshi , Richard M. Leahy

Unsupervised learning has always been appealing to machine learning researchers and practitioners, allowing them to avoid an expensive and complicated process of labeling the data. However, unsupervised learning of complex data is…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Evgenii Zheltonozhskii , Chaim Baskin , Alex M. Bronstein , Avi Mendelson