English
Related papers

Related papers: Semi-Supervised Learning with Multi-Head Co-Traini…

200 papers

Ensembles of machine learning models have been well established as a powerful method of improving performance over a single model. Traditionally, ensembling algorithms train their base learners independently or sequentially with the goal of…

Machine Learning · Computer Science 2023-11-01 Alan Jeffares , Tennison Liu , Jonathan Crabbé , Mihaela van der Schaar

In this work, we used a semi-supervised learning method to train deep learning model that can segment the brain MRI images. The semi-supervised model uses less labeled data, and the performance is competitive with the supervised model with…

Image and Video Processing · Electrical Eng. & Systems 2022-12-07 Hedong Zhang , Anand A. Joshi

A central goal of unsupervised learning is to acquire representations from unlabeled data or experience that can be used for more effective learning of downstream tasks from modest amounts of labeled data. Many prior unsupervised learning…

Machine Learning · Computer Science 2019-03-25 Kyle Hsu , Sergey Levine , Chelsea Finn

Recent work has shown that self-supervised pre-training leads to improvements over supervised learning on challenging visual recognition tasks. CLIP, an exciting new approach to learning with language supervision, demonstrates promising…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Norman Mu , Alexander Kirillov , David Wagner , Saining Xie

Recent semi-supervised learning methods have shown to achieve comparable results to their supervised counterparts while using only a small portion of labels in image classification tasks thanks to their regularization strategies. In this…

Machine Learning · Computer Science 2020-09-25 Wei-Hong Li , Chuan-Sheng Foo , Hakan Bilen

There has been an increasing interest in semi-supervised learning in the recent years because of the great number of datasets with a large number of unlabeled data but only a few labeled samples. Semi-supervised learning algorithms can work…

Machine Learning · Computer Science 2020-03-26 Pedro H. M. Braga , Hansenclever F. Bassani

Current state-of-the-art methods cast monocular 3D human pose estimation as a learning problem by training neural networks on large data sets of images and corresponding skeleton poses. In contrast, we propose an approach that can exploit…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Simon Jenni , Paolo Favaro

Semi-supervised medical image segmentation (SSMIS) has witnessed substantial advancements by leveraging limited labeled data and abundant unlabeled data. Nevertheless, existing state-of-the-art (SOTA) methods encounter challenges in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Wei Li , Ruifeng Bian , Wenyi Zhao , Weijin Xu , Huihua Yang

Self-training methods have proven to be effective in exploiting abundant unlabeled data in semi-supervised learning, particularly when labeled data is scarce. While many of these approaches rely on a cross-entropy loss function (CE), recent…

Machine Learning · Computer Science 2024-09-12 Aurelien Gauffre , Julien Horvat , Massih-Reza Amini

Self-training allows a network to learn from the predictions of a more complicated model, thus often requires well-trained teacher models and mixture of teacher-student data while multi-task learning jointly optimizes different targets to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Hoàng-Ân Lê , Minh-Tan Pham

Intermediate features at different layers of a deep neural network are known to be discriminative for visual patterns of different complexities. However, most existing works ignore such cross-layer heterogeneities when classifying samples…

Computer Vision and Pattern Recognition · Computer Science 2016-07-20 Xiaojie Jin , Yunpeng Chen , Jian Dong , Jiashi Feng , Shuicheng Yan

Semi-Supervised Learning (SSL) is a framework that utilizes both labeled and unlabeled data to enhance model performance. Conventional SSL methods operate under the assumption that labeled and unlabeled data share the same label space.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Noam Fluss , Guy Hacohen , Daphna Weinshall

This work proposes an overview of the recent semi-supervised learning approaches and related works. Despite the remarkable success of neural networks in various applications, there exist a few formidable constraints, including the need for…

Machine Learning · Computer Science 2024-08-09 Gyeongho Kim

In recent years self-supervised learning has emerged as a promising candidate for unsupervised representation learning. In the visual domain its applications are mostly studied in the context of images of natural scenes. However, its…

Computer Vision and Pattern Recognition · Computer Science 2021-06-04 Vladan Stojnić , Vladimir Risojević

Reaching the performance of fully supervised learning with unlabeled data and only labeling one sample per class might be ideal for deep learning applications. We demonstrate for the first time the potential for building one-shot…

Machine Learning · Computer Science 2021-01-27 Leslie N. Smith , Adam Conovaloff

We propose a quantum classifier, which can classify data under the supervised learning scheme using a quantum feature space. The input feature vectors are encoded in a single qu$N$it (a $N$ level quantum system), as opposed to more commonly…

Quantum Physics · Physics 2020-05-12 Soumik Adhikary , Siddharth Dangwal , Debanjan Bhowmik

Self-supervised contrastive learning heavily relies on the view variance brought by data augmentation, so that it can learn a view-invariant pre-trained representation. Beyond increasing the view variance for contrast, this work focuses on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Yong Zhang , Rui Zhu , Shifeng Zhang , Xu Zhou , Shifeng Chen , Xiaofan Chen

In this paper we describe the mathematical foundations of a new approach to semi-supervised Machine Learning. Using techniques of Symbolic Computation and Computer Algebra, we apply the concept of persistent homology to obtain a new…

Machine Learning · Computer Science 2023-01-30 Adrián Inés , César Domínguez , Jónathan Heras , Gadea Mata , Julio Rubio

Meta-learning enables learning systems to adapt quickly to new tasks, similar to humans. Different meta-learning approaches all work under/with the mini-batch episodic training framework. Such framework naturally gives the information about…

Machine Learning · Computer Science 2025-11-10 Shiguang Wu , Yaqing Wang , Yatao Bian , Quanming Yao

The development of mobile and on the edge applications that embed deep convolutional neural models has the potential to revolutionise biomedicine. However, most deep learning models require computational resources that are not available in…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Adrián Inés , Andrés Díaz-Pinto , César Domínguez , Jónathan Heras , Eloy Mata , Vico Pascual