English
Related papers

Related papers: Deep Bayesian Self-Training

200 papers

Person re-identification (re-ID) has gained more and more attention due to its widespread applications in intelligent video surveillance. Unfortunately, the mainstream deep learning methods still need a large quantity of labeled data to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Qi Wang , Sikai Bai , Junyu Gao , Yuan Yuan , Xuelong Li

Deep Learning heavily depends on large labeled datasets which limits further improvements. While unlabeled data is available in large amounts, in particular in image recognition, it does not fulfill the closed world assumption of…

Machine Learning · Computer Science 2020-12-24 Maximilian Augustin , Matthias Hein

In class-incremental semantic segmentation, we have no access to the labeled data of previous tasks. Therefore, when incrementally learning new classes, deep neural networks suffer from catastrophic forgetting of previously learned…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Lu Yu , Xialei Liu , Joost van de Weijer

Supervised training of object detectors requires well-annotated large-scale datasets, whose production is costly. Therefore, some efforts have been made to obtain annotations in economical ways, such as cloud sourcing. However, datasets…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Jiafeng Mao , Qing Yu , Yoko Yamakata , Kiyoharu Aizawa

Traditionally, most of the existing attribute learning methods are trained based on the consensus of annotations aggregated from a limited number of annotators. However, the consensus might fail in settings, especially when a wide spectrum…

Machine Learning · Computer Science 2019-06-19 Zhiyong Yang , Qianqian Xu , Xiaochun Cao , Qingming Huang

We introduce implicit Bayesian neural networks, a simple and scalable approach for uncertainty representation in deep learning. Standard Bayesian approach to deep learning requires the impractical inference of the posterior distribution…

Machine Learning · Statistics 2020-10-27 Trung Trinh , Samuel Kaski , Markus Heinonen

While the use of artificial intelligence (AI) for medical image analysis is gaining wide acceptance, the expertise, time and cost required to generate annotated data in the medical field are significantly high, due to limited availability…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Abhishek Kushwaha , Sarthak Gupta , Anish Bhanushali , Tathagato Rai Dastidar

This paper addresses text recognition for domains with limited manual annotations by a simple self-training strategy. Our approach should reduce human annotation effort when target domain data is plentiful, such as when transcribing a…

Computer Vision and Pattern Recognition · Computer Science 2022-01-26 Martin Kišš , Karel Beneš , Michal Hradiš

The divergence between labeled training data and unlabeled testing data is a significant challenge for recent deep learning models. Unsupervised domain adaptation (UDA) attempts to solve such problem. Recent works show that self-training is…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Chuang Zhu , Kebin Liu , Wenqi Tang , Ke Mei , Jiaqi Zou , Tiejun Huang

Deep neural networks are typically trained by uniformly sampling large datasets across epochs, despite evidence that not all samples contribute equally throughout learning. Recent work shows that progressively reducing the amount of…

Machine Learning · Computer Science 2026-04-15 Amar Gahir , Varshil Patel , Shreyank N Gowda

The ability to quickly annotate medical imaging data plays a critical role in training deep learning frameworks for segmentation. Doing so for image volumes or video sequences is even more pressing as annotating these is particularly…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Laurent Lejeune , Raphael Sznitman

We propose a meta-learning method for learning from multiple noisy annotators. In many applications such as crowdsourcing services, labels for supervised learning are given by multiple annotators. Since the annotators have different skills…

Machine Learning · Computer Science 2025-06-13 Atsutoshi Kumagai , Tomoharu Iwata , Taishi Nishiyama , Yasutoshi Ida , Yasuhiro Fujiwara

In deep active learning, it is especially important to choose multiple examples to markup at each step to work efficiently, especially on large datasets. At the same time, existing solutions to this problem in the Bayesian setup, such as…

Machine Learning · Computer Science 2023-02-17 Aleksandr Rubashevskii , Daria Kotova , Maxim Panov

Segmentation in medical imaging is an essential and often preliminary task in the image processing chain, driving numerous efforts towards the design of robust segmentation algorithms. Supervised learning methods achieve excellent…

Image and Video Processing · Electrical Eng. & Systems 2024-04-03 Pierre Rougé , Pierre-Henri Conze , Nicolas Passat , Odyssée Merveille

Data augmentation is a ubiquitous technique for increasing the size of labeled training sets by leveraging task-specific data transformations that preserve class labels. While it is often easy for domain experts to specify individual…

Machine Learning · Statistics 2018-12-10 Alexander J. Ratner , Henry R. Ehrenberg , Zeshan Hussain , Jared Dunnmon , Christopher Ré

Large-scale datasets are important for the development of deep learning models. Such datasets usually require a heavy workload of annotations, which are extremely time-consuming and expensive. To accelerate the annotation procedure,…

Machine Learning · Computer Science 2024-03-13 Xiaoqian Ruan , Gaoang Wang

In this work, we aim to establish a Bayesian adaptive learning framework by focusing on estimating latent variables in deep neural network (DNN) models. Latent variables indeed encode both transferable distributional information and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-26 Hu Hu , Sabato Marco Siniscalchi , Chin-Hui Lee

Sparse deep learning aims to address the challenge of huge storage consumption by deep neural networks, and to recover the sparse structure of target functions. Although tremendous empirical successes have been achieved, most sparse deep…

Machine Learning · Statistics 2020-11-17 Jincheng Bai , Qifan Song , Guang Cheng

Explosive growth in data and availability of cheap computing resources have sparked increasing interest in Big learning, an emerging subfield that studies scalable machine learning algorithms, systems, and applications with Big Data.…

Machine Learning · Computer Science 2017-03-02 Jun Zhu , Jianfei Chen , Wenbo Hu , Bo Zhang

Continual learning entails learning a sequence of tasks and balancing their knowledge appropriately. With limited access to old training samples, much of the current work in deep neural networks has focused on overcoming catastrophic…

Machine Learning · Computer Science 2023-10-16 Yilin Lyu , Liyuan Wang , Xingxing Zhang , Zicheng Sun , Hang Su , Jun Zhu , Liping Jing