English
Related papers

Related papers: Unsupervised Representation Learning to Aid Semi-S…

200 papers

Few-shot learning aims to learn classifiers for new classes with only a few training examples per class. Most existing few-shot learning approaches belong to either metric-based meta-learning or optimization-based meta-learning category,…

Machine Learning · Computer Science 2019-08-28 Duo Wang , Yu Cheng , Mo Yu , Xiaoxiao Guo , Tao Zhang

Unsupervised neural network learning extracts hidden features from unlabeled training data. This is used as a pretraining step for further supervised learning in deep networks. Hence, understanding unsupervised learning is of fundamental…

Disordered Systems and Neural Networks · Physics 2016-12-23 Haiping Huang , Taro Toyoizumi

We propose a few-shot learning method for unsupervised feature selection, which is a task to select a subset of relevant features in unlabeled data. Existing methods usually require many instances for feature selection. However, sufficient…

Machine Learning · Computer Science 2021-07-05 Atsutoshi Kumagai , Tomoharu Iwata , Yasuhiro Fujiwara

Conventional image classifiers are trained by randomly sampling mini-batches of images. To achieve state-of-the-art performance, practitioners use sophisticated data augmentation schemes to expand the amount of training data available for…

Machine Learning · Computer Science 2021-06-23 Renkun Ni , Micah Goldblum , Amr Sharaf , Kezhi Kong , Tom Goldstein

Meta-learning performs adaptation through a limited amount of support set, which may cause a sample bias problem. To solve this problem, transductive meta-learning is getting more and more attention, going beyond the conventional inductive…

Machine Learning · Computer Science 2023-04-25 Sanghyuk Lee , Seunghyun Lee , Byung Cheol Song

While metric learning is important for Person re-identification (RE-ID), a significant problem in visual surveillance for cross-view pedestrian matching, existing metric models for RE-ID are mostly based on supervised learning that requires…

Computer Vision and Pattern Recognition · Computer Science 2017-10-19 Hong-Xing Yu , Ancong Wu , Wei-Shi Zheng

State-of-the-art computer vision models are mostly trained with supervised learning using human-labeled images, which limits their scalability due to the expensive annotation cost. While self-supervised representation learning has achieved…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Junnan Li , Silvio Savarese , Steven C. H. Hoi

Few-shot classification aims to recognize unseen classes when presented with only a small number of samples. We consider the problem of multi-domain few-shot image classification, where unseen classes and examples come from diverse data…

Machine Learning · Computer Science 2020-09-04 Lu Liu , William Hamilton , Guodong Long , Jing Jiang , Hugo Larochelle

Product title compression for voice and mobile commerce is a well studied problem with several supervised models proposed so far. However these models have 2 major limitations; they are not designed to generate compressions dynamically…

Machine Learning · Computer Science 2021-02-23 Snehasish Mukherjee

Learning meaningful representations is at the heart of many tasks in the field of modern machine learning. Recently, a lot of methods were introduced that allow learning of image representations without supervision. These representations…

Transductive inference is an effective means of tackling the data deficiency problem in few-shot learning settings. A popular transductive inference technique for few-shot metric-based approaches, is to update the prototype of each class…

Machine Learning · Computer Science 2020-06-25 Seong Min Kye , Hae Beom Lee , Hoirin Kim , Sung Ju Hwang

We investigate the effects of the unsupervised pre-training method under the perspective of information theory. If the input distribution displays multiple views of the supervision, then unsupervised pre-training allows to learn…

Machine Learning · Computer Science 2019-05-31 Nicolas Pinchaud

Future deep learning systems call for techniques that can deal with the evolving nature of temporal data and scarcity of annotations when new problems occur. As a step towards this goal, we present FUSION (Few-shot UnSupervIsed cONtinual…

Machine Learning · Computer Science 2022-05-04 Alessia Bertugli , Stefano Vincenzi , Simone Calderara , Andrea Passerini

Meta-learning aims at learning quickly on novel tasks with limited data by transferring generic experience learned from previous tasks. Naturally, few-shot learning has been one of the most popular applications for meta-learning. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Yudong Chen , Chaoyu Guan , Zhikun Wei , Xin Wang , Wenwu Zhu

Recent advances in deep learning, in particular enabled by hardware advances and big data, have provided impressive results across a wide range of computational problems such as computer vision, natural language, or reinforcement learning.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Ileana Rugina , Rumen Dangovski , Mark Veillette , Pooya Khorrami , Brian Cheung , Olga Simek , Marin Soljačić

Semi-supervised learning is a setting in which one has labeled and unlabeled data available. In this survey we explore different types of theoretical results when one uses unlabeled data in classification and regression tasks. Most methods…

Machine Learning · Computer Science 2020-07-31 Alexander Mey , Marco Loog

One of the greatest obstacles in the adoption of deep neural networks for new applications is that training the network typically requires a large number of manually labeled training samples. We empirically investigate the scenario where…

Machine Learning · Computer Science 2020-04-09 Leslie N. Smith , Adam Conovaloff

Few-shot learning aims to transfer information from one task to enable generalization on novel tasks given a few examples. This information is present both in the domain and the class labels. In this work we investigate the complementary…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Orchid Majumder , Avinash Ravichandran , Subhransu Maji , Alessandro Achille , Marzia Polito , Stefano Soatto

We consider a practical scenario of machine unlearning to erase a target dataset, which causes unexpected behavior from the trained model. The target dataset is often assumed to be fully identifiable in a standard unlearning scenario. Such…

Machine Learning · Computer Science 2023-03-15 Youngsik Yoon , Jinhwan Nam , Hyojeong Yun , Jaeho Lee , Dongwoo Kim , Jungseul Ok

In few-shot learning, classifiers are expected to generalize to unseen classes given only a small number of instances of each new class. One of the popular solutions to few-shot learning is metric-based meta-learning. However, it highly…

Machine Learning · Computer Science 2025-11-18 Qiuhao Zeng