English
Related papers

Related papers: Few-Shot Learning via Learning the Representation,…

200 papers

Few-shot learning (FSL) techniques seek to learn the underlying patterns in data using fewer samples, analogous to how humans learn from limited experience. In this limited-data scenario, the challenges associated with deep neural networks,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Deepan Chakravarthi Padmanabhan , Shruthi Gowda , Elahe Arani , Bahram Zonooz

Deep neural networks have been able to outperform humans in some cases like image recognition and image classification. However, with the emergence of various novel categories, the ability to continuously widen the learning capability of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Nihar Bendre , Hugo Terashima Marín , Peyman Najafirad

Few-Shot Learning is the challenge of training a model with only a small amount of data. Many solutions to this problem use meta-learning algorithms, i.e. algorithms that learn to learn. By sampling few-shot tasks from a larger dataset, we…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Etienne Bennequin

Few-shot Learning aims to learn and distinguish new categories with a very limited number of available images, presenting a significant challenge in the realm of deep learning. Recent researchers have sought to leverage the additional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Chunpeng Zhou , Haishuai Wang , Xilu Yuan , Zhi Yu , Jiajun Bu

Few-shot learning or meta-learning leverages the data scarcity problem in machine learning. Traditionally, training data requires a multitude of samples and labeling for supervised learning. To address this issue, we propose a one-shot…

Machine Learning · Computer Science 2023-10-23 Atik Faysal , Mohammad Rostami , Huaxia Wang , Avimanyu Sahoo , Ryan Antle

In many real-world problems, collecting a large number of labeled samples is infeasible. Few-shot learning (FSL) is the dominant approach to address this issue, where the objective is to quickly adapt to novel categories in presence of a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Mamshad Nayeem Rizve , Salman Khan , Fahad Shahbaz Khan , Mubarak Shah

An overarching goal in machine learning is to build a generalizable model with few samples. To this end, overparameterization has been the subject of immense interest to explain the generalization ability of deep nets even when the size of…

Machine Learning · Computer Science 2022-01-19 Yue Sun , Adhyyan Narang , Halil Ibrahim Gulluk , Samet Oymak , Maryam Fazel

Few-shot learning is a challenging task since only few instances are given for recognizing an unseen class. One way to alleviate this problem is to acquire a strong inductive bias via meta-learning on similar tasks. In this paper, we show…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Wentao Chen , Chenyang Si , Wei Wang , Liang Wang , Zilei Wang , Tieniu Tan

This paper addresses the meta-learning problem in sparse linear regression with infinite tasks. We assume that the learner can access several similar tasks. The goal of the learner is to transfer knowledge from the prior tasks to a similar…

Machine Learning · Computer Science 2021-02-19 Zhanyu Wang , Jean Honorio

In this paper, we consider the problem of learning a linear regression model on a data domain of interest (target) given few samples. To aid learning, we are provided with a set of pre-trained regression models that are trained on…

Machine Learning · Computer Science 2023-06-27 Navjot Singh , Suhas Diggavi

Recent papers on the theory of representation learning has shown the importance of a quantity called diversity when generalizing from a set of source tasks to a target task. Most of these papers assume that the function mapping shared…

Machine Learning · Statistics 2021-06-01 Ziping Xu , Ambuj Tewari

Text classification tends to be difficult when data are deficient or when it is required to adapt to unseen classes. In such challenging scenarios, recent studies have often used meta-learning to simulate the few-shot task, thus negating…

Information Retrieval · Computer Science 2019-11-22 Shumin Deng , Ningyu Zhang , Zhanlin Sun , Jiaoyan Chen , Huajun Chen

Few-shot learning (FSL) is an emergent paradigm of learning that attempts to learn to reason with low sample complexity to mimic the way humans learn, generalise and extrapolate from only a few seen examples. While FSL attempts to mimic…

Machine Learning · Computer Science 2023-12-08 Jaron Mar , Jiamou Liu

In recent years, representation learning has become the research focus of the machine learning community. Large-scale neural networks are a crucial step toward achieving general intelligence, with their success largely attributed to their…

Machine Learning · Computer Science 2025-04-22 Lifeng Gu

Large pretrained language models (LMs) like BERT have improved performance in many disparate natural language processing (NLP) tasks. However, fine tuning such models requires a large number of training examples for each target task.…

Computation and Language · Computer Science 2022-01-28 Jixuan Wang , Kuan-Chieh Wang , Frank Rudzicz , Michael Brudno

Transferring representation for multitask imitation learning has the potential to provide improved sample efficiency on learning new tasks, when compared to learning from scratch. In this work, we provide a statistical guarantee indicating…

Machine Learning · Computer Science 2023-11-06 Bryan Chan , Karime Pereida , James Bergstra

The success of Reinforcement Learning (RL) heavily relies on the ability to learn robust representations from the observations of the environment. In most cases, the representations learned purely by the reinforcement learning loss can…

Machine Learning · Computer Science 2024-02-12 Somjit Nath , Rushiv Arora , Samira Ebrahimi Kahou

Few-shot Learning aims to learn classifiers for new classes with only a few training examples per class. Existing meta-learning or metric-learning based few-shot learning approaches are limited in handling diverse domains with various…

Machine Learning · Computer Science 2019-01-30 Yu Cheng , Mo Yu , Xiaoxiao Guo , Bowen Zhou

Graph representation learning, a critical step in graph-centric tasks, has seen significant advancements. Earlier techniques often operate in an end-to-end setting, which heavily rely on the availability of ample labeled data. This…

Machine Learning · Computer Science 2024-09-23 Xingtong Yu , Yuan Fang , Zemin Liu , Yuxia Wu , Zhihao Wen , Jianyuan Bo , Xinming Zhang , Steven C. H. Hoi

Few-shot learning (FSL) has attracted considerable attention recently. Among existing approaches, the metric-based method aims to train an embedding network that can make similar samples close while dissimilar samples as far as possible and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Bin Xiao , Chien-Liang Liu , Wen-Hoar Hsaio