English
Related papers

Related papers: Adaptive Posterior Learning: few-shot learning wit…

200 papers

Proprietary and closed APIs are becoming increasingly common to process natural language, and are impacting the practical applications of natural language processing, including few-shot classification. Few-shot classification involves…

Computation and Language · Computer Science 2023-10-24 Pierre Colombo , Victor Pellegrain , Malik Boudiaf , Victor Storchan , Myriam Tami , Ismail Ben Ayed , Celine Hudelot , Pablo Piantanida

Active Learning (AL) is increasingly important in a broad range of applications. Two main AL principles to obtain accurate classification with few labeled data are refinement of the current decision boundary and exploration of poorly…

Machine Learning · Computer Science 2012-10-19 Jens Roeder , Boaz Nadler , Kevin Kunzmann , Fred A. Hamprecht

The popularity of Contrastive Language-Image Pre-training (CLIP) has propelled its application to diverse downstream vision tasks. To improve its capacity on downstream tasks, few-shot learning has become a widely-adopted technique.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Xiangyang Zhu , Renrui Zhang , Bowei He , Aojun Zhou , Dong Wang , Bin Zhao , Peng Gao

In this paper, we explore contrastive learning for few-shot classification, in which we propose to use it as an additional auxiliary training objective acting as a data-dependent regularizer to promote more general and transferable…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Yassine Ouali , Céline Hudelot , Myriam Tami

Attention-based models are successful when trained on large amounts of data. In this paper, we demonstrate that even in the low-resource scenario, attention can be learned effectively. To this end, we start with discrete human-annotated…

Computation and Language · Computer Science 2018-08-29 Yujia Bao , Shiyu Chang , Mo Yu , Regina Barzilay

Few-shot learning (FSL) requires a model to classify new samples after learning from only a few samples. While remarkable results are achieved in existing methods, the performance of embedding and metrics determines the upper limit of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Hao Li , Li Li , Yunmeng Huang , Ning Li , Yongtao Zhang

In continual learning (CL), an agent learns from a stream of tasks leveraging prior experience to transfer knowledge to future tasks. It is an ideal framework to decrease the amount of supervision in the existing learning algorithms. But…

This paper considers the problem of inferring image labels from images when only a few annotated examples are available at training time. This setup is often referred to as low-shot learning, where a standard approach is to re-train the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-18 Matthijs Douze , Arthur Szlam , Bharath Hariharan , Hervé Jégou

Prompt tuning is a new few-shot transfer learning technique that only tunes the learnable prompt for pre-trained vision and language models such as CLIP. However, existing prompt tuning methods tend to learn spurious or entangled…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Xuehai He , Diji Yang , Weixi Feng , Tsu-Jui Fu , Arjun Akula , Varun Jampani , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

Prompt learning approaches have made waves in natural language processing by inducing better few-shot performance while they still follow a parametric-based learning paradigm; the oblivion and rote memorization problems in learning may…

Computation and Language · Computer Science 2023-09-20 Xiang Chen , Lei Li , Ningyu Zhang , Xiaozhuan Liang , Shumin Deng , Chuanqi Tan , Fei Huang , Luo Si , Huajun Chen

In-context learning has become an important approach for few-shot learning in Large Language Models because of its ability to rapidly adapt to new tasks without fine-tuning model parameters. However, it is restricted to applications in…

Machine Learning · Computer Science 2023-10-16 Christopher Fifty , Jure Leskovec , Sebastian Thrun

Few-shot learning (FSL) presents a challenging learning problem in which only a few samples are available for each class. Decision interpretation is more important in few-shot classification due to a greater chance of error compared to…

Machine Learning · Computer Science 2025-04-01 Mohammad Reza Zarei , Majid Komeili

Rehearsal-based continual learning (CL) mitigates catastrophic forgetting by maintaining a subset of samples from previous tasks for replay. Existing studies primarily focus on optimizing memory storage through coreset selection strategies.…

Machine Learning · Computer Science 2026-04-13 Minh-Duong Nguyen , Thien-Thanh Dao , Le-Tuan Nguyen , Dung D. Le , Kok-Seng Wong

The ability to continuously expand knowledge over time and utilize it to rapidly generalize to new tasks is a key feature of human linguistic intelligence. Existing models that pursue rapid generalization to new tasks (e.g., few-shot…

Computation and Language · Computer Science 2022-08-23 Xisen Jin , Bill Yuchen Lin , Mohammad Rostami , Xiang Ren

In this paper, we look at the problem of few-shot classification that aims to learn a classifier for previously unseen classes and domains from few labeled samples. Recent methods use adaptation networks for aligning their features to new…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Wei-Hong Li , Xialei Liu , Hakan Bilen

One of the fundamental limitations of Deep Neural Networks (DNN) is its inability to acquire and accumulate new cognitive capabilities. When some new data appears, such as new object classes that are not in the prescribed set of objects…

Machine Learning · Computer Science 2021-11-23 Xinyu Wei , Biing-Hwang Fred Juang , Ouya Wang , Shenglong Zhou , Geoffrey Ye Li

This paper tackles the problem of few-shot learning, which aims to learn new visual concepts from a few examples. A common problem setting in few-shot classification assumes random sampling strategy in acquiring data labels, which is…

Computer Vision and Pattern Recognition · Computer Science 2022-01-10 Shipeng Yan , Songyang Zhang , Xuming He

The statistical supervised learning framework assumes an input-output set with a joint probability distribution that is reliably represented by the training dataset. The learner is then required to output a prediction rule learned from the…

Machine Learning · Computer Science 2026-03-31 Deborah Pereg , Martin Villiger , Brett Bouma , Polina Golland

Partial label learning (PLL) is a typical weakly supervised learning problem, where each training example is associated with a set of candidate labels among which only one is true. Most existing PLL approaches assume that the incorrect…

Machine Learning · Computer Science 2023-02-02 Congyu Qiao , Ning Xu , Xin Geng

Online few-shot learning describes a setting where models are trained and evaluated on a stream of data while learning emerging classes. While prior work in this setting has achieved very promising performance on instance classification…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Mayank Lunayach , James Smith , Zsolt Kira