English
Related papers

Related papers: Unsupervised Few-shot Learning via Deep Laplacian …

200 papers

Learning with few samples is a major challenge for parameter-rich models like deep networks. In contrast, people learn complex new concepts even from very few examples, suggesting that the sample complexity of learning can often be reduced.…

Machine Learning · Computer Science 2019-06-11 Roman Visotsky , Yuval Atzmon , Gal Chechik

This paper tackles the problem of few-shot learning, which aims to learn new visual concepts from a few examples. A common problem setting in few-shot classification assumes random sampling strategy in acquiring data labels, which is…

Computer Vision and Pattern Recognition · Computer Science 2022-01-10 Shipeng Yan , Songyang Zhang , Xuming He

Deep learning-based analysis of high-frequency, high-resolution micro-ultrasound data shows great promise for prostate cancer detection. Previous approaches to analysis of ultrasound data largely follow a supervised learning paradigm.…

Image and Video Processing · Electrical Eng. & Systems 2022-11-02 Paul F. R. Wilson , Mahdi Gilany , Amoon Jamzad , Fahimeh Fooladgar , Minh Nguyen Nhat To , Brian Wodlinger , Purang Abolmaesumi , Parvin Mousavi

Representation learning from unlabeled data has been extensively studied in statistics, data science and signal processing with a rich literature on techniques for dimension reduction, compression, multi-dimensional scaling among others.…

Machine Learning · Computer Science 2025-10-03 Pascal Esser , Maximilian Fleissner , Debarghya Ghoshdastidar

Few-shot Learning aims to learn and distinguish new categories with a very limited number of available images, presenting a significant challenge in the realm of deep learning. Recent researchers have sought to leverage the additional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Chunpeng Zhou , Haishuai Wang , Xilu Yuan , Zhi Yu , Jiajun Bu

The amount of manually labeled data is limited in medical applications, so semi-supervised learning and automatic labeling strategies can be an asset for training deep neural networks. However, the quality of the automatically generated…

Machine Learning · Computer Science 2022-03-04 Wenhui Cui , Haleh Akrami , Anand A. Joshi , Richard M. Leahy

We investigate omni-supervised learning, a special regime of semi-supervised learning in which the learner exploits all available labeled data plus internet-scale sources of unlabeled data. Omni-supervised learning is lower-bounded by…

Computer Vision and Pattern Recognition · Computer Science 2017-12-13 Ilija Radosavovic , Piotr Dollár , Ross Girshick , Georgia Gkioxari , Kaiming He

Majority of the modern meta-learning methods for few-shot classification tasks operate in two phases: a meta-training phase where the meta-learner learns a generic representation by solving multiple few-shot tasks sampled from a large…

Machine Learning · Computer Science 2020-04-23 Qing Liu , Orchid Majumder , Alessandro Achille , Avinash Ravichandran , Rahul Bhotika , Stefano Soatto

Recent advances in self-supervised learning have attracted significant attention from both machine learning and neuroscience. This is primarily because self-supervised methods do not require annotated supervisory information, making them…

Neurons and Cognition · Quantitative Biology 2025-12-05 Asaki Kataoka , Yoshihiro Nagano , Masafumi Oizumi

The ability to learn new concepts with small amounts of data is a critical aspect of intelligence that has proven challenging for deep learning methods. Meta-learning has emerged as a promising technique for leveraging data from previous…

Machine Learning · Computer Science 2020-04-29 Mingzhang Yin , George Tucker , Mingyuan Zhou , Sergey Levine , Chelsea Finn

Despite significant advances, the performance of state-of-the-art continual learning approaches hinges on the unrealistic scenario of fully labeled data. In this paper, we tackle this challenge and propose an approach for continual…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Zhiqi Kang , Enrico Fini , Moin Nabi , Elisa Ricci , Karteek Alahari

Deep neural networks often struggle to learn robust representations in the presence of dataset biases, leading to suboptimal generalization on unbiased datasets. This limitation arises because the models heavily depend on peripheral and…

Machine Learning · Computer Science 2024-12-11 Carlo Alberto Barbano , Enzo Tartaglione , Marco Grangetto

Self-training is a classical approach in semi-supervised learning which is successfully applied to a variety of machine learning problems. Self-training algorithm generates pseudo-labels for the unlabeled examples and progressively refines…

Machine Learning · Computer Science 2020-06-22 Samet Oymak , Talha Cihad Gulcu

Transductive inference is widely used in few-shot learning, as it leverages the statistics of the unlabeled query set of a few-shot task, typically yielding substantially better performances than its inductive counterpart. The current…

Machine Learning · Computer Science 2022-04-26 Olivier Veilleux , Malik Boudiaf , Pablo Piantanida , Ismail Ben Ayed

Active learning is an iterative labeling process that is used to obtain a small labeled subset, despite the absence of labeled data, thereby enabling to train a model for supervised tasks such as text classification. While active learning…

Computation and Language · Computer Science 2024-10-07 Christopher Schröder , Gerhard Heyer

Few-shot dialogue state tracking (DST) is a realistic problem that trains the DST model with limited labeled data. Existing few-shot methods mainly transfer knowledge learned from external labeled dialogue data (e.g., from question…

Computation and Language · Computer Science 2022-10-12 Haoning Zhang , Junwei Bao , Haipeng Sun , Huaishao Luo , Wenye Li , Shuguang Cui

Most semi-supervised learning methods over-sample labeled data when constructing training mini-batches. This paper studies whether this common practice improves learning and how. We compare it to an alternative setting where each mini-batch…

Machine Learning · Computer Science 2022-04-11 Miquel Martí i Rabadán , Sebastian Bujwid , Alessandro Pieropan , Hossein Azizpour , Atsuto Maki

This paper presents SPeCiaL: a method for unsupervised pretraining of representations tailored for continual learning. Our approach devises a meta-learning objective that differentiates through a sequential learning process. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Lucas Caccia , Joelle Pineau

We propose an unsupervised visual tracking method in this paper. Different from existing approaches using extensive annotated data for supervised learning, our CNN model is trained on large-scale unlabeled videos in an unsupervised manner.…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Ning Wang , Yibing Song , Chao Ma , Wengang Zhou , Wei Liu , Houqiang Li

In order to train robust deep learning models, large amounts of labelled data is required. However, in the absence of such large repositories of labelled data, unlabeled data can be exploited for the same. Semi-Supervised learning aims to…

Machine Learning · Computer Science 2021-07-20 Soumyadeep Ghosh , Sanjay Kumar , Janu Verma , Awanish Kumar