English
Related papers

Related papers: Meta-training with Demonstration Retrieval for Eff…

200 papers

Few-shot object detection has been extensively investigated by incorporating meta-learning into region-based detection frameworks. Despite its success, the said paradigm is constrained by several factors, such as (i) low-quality region…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Gongjie Zhang , Zhipeng Luo , Kaiwen Cui , Shijian Lu

Providing pretrained language models with simple task descriptions in natural language enables them to solve some tasks in a fully unsupervised fashion. Moreover, when combined with regular learning from examples, this idea yields…

Computation and Language · Computer Science 2021-10-05 Timo Schick , Hinrich Schütze

Annotated images and ground truth for the diagnosis of rare and novel diseases are scarce. This is expected to prevail, considering the small number of affected patient population and limited clinical expertise to annotate images. Further,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Karthik Desingu , Mirunalini P. , Aravindan Chandrabose

In this paper, we consider the framework of multi-task representation (MTR) learning where the goal is to use source tasks to learn a representation that reduces the sample complexity of solving a target task. We start by reviewing recent…

Machine Learning · Computer Science 2023-10-27 Quentin Bouniot , Ievgen Redko , Romaric Audigier , Angélique Loesch , Amaury Habrard

We present a meta-learning based generative model for zero-shot learning (ZSL) towards a challenging setting when the number of training examples from each \emph{seen} class is very few. This setup contrasts with the conventional ZSL…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Vinay Kumar Verma , Ashish Mishra , Anubha Pandey , Hema A. Murthy , Piyush Rai

The pre-trained foundation models (PFMs) have become essential for facilitating large-scale multimodal learning. Researchers have effectively employed the ``pre-train, prompt, and predict'' paradigm through prompt learning to induce…

Computation and Language · Computer Science 2025-12-24 Xiang Chen , Yixin Ou , Quan Feng , Lei Li , Piji Li , Haibo Ye , Sheng-Jun Huang , Shuofei Qiao , Shumin Deng , Huajun Chen , Ningyu Zhang

Best-performing speech models are trained on large amounts of data in the language they are meant to work for. However, most languages have sparse data, making training models challenging. This shortage of data is even more prevalent in…

Computation and Language · Computer Science 2024-10-08 David-Gabriel Ion , Răzvan-Alexandru Smădu , Dumitru-Clementin Cercel , Florin Pop , Mihaela-Claudia Cercel

The training of deep-learning-based text classification models relies heavily on a huge amount of annotation data, which is difficult to obtain. When the labeled data is scarce, models tend to struggle to achieve satisfactory performance.…

Computation and Language · Computer Science 2020-04-07 Dianbo Sui , Yubo Chen , Binjie Mao , Delai Qiu , Kang Liu , Jun Zhao

Few-shot classification consists of learning a predictive model that is able to effectively adapt to a new class, given only a few annotated samples. To solve this challenging problem, meta-learning has become a popular paradigm that…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Nikita Dvornik , Cordelia Schmid , Julien Mairal

Few-shot object detection, the problem of modelling novel object detection categories with few training instances, is an emerging topic in the area of few-shot learning and object detection. Contemporary techniques can be divided into two…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Berkan Demirel , Orhun Buğra Baran , Ramazan Gokberk Cinbis

Few-shot image classification requires the classifier to robustly cope with unseen classes even if there are only a few samples for each class. Recent advances benefit from the meta-learning process where episodic tasks are formed to train…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Da Chen , Yongliang Yang , Zunlei Feng , Xiang Wu , Mingli Song , Wenbin Li , Yuan He , Hui Xue , Feng Mao

Traditional recognition methods typically require large, artificially-balanced training classes, while few-shot learning methods are tested on artificially small ones. In contrast to both extremes, real world recognition problems exhibit…

Computer Vision and Pattern Recognition · Computer Science 2019-07-03 Davis Wertheimer , Bharath Hariharan

Weak supervision searches have in principle the advantages of both being able to train on experimental data and being able to learn distinctive signal properties. However, the practical applicability of such searches is limited by the fact…

High Energy Physics - Phenomenology · Physics 2024-03-05 Hugues Beauchesne , Zong-En Chen , Cheng-Wei Chiang

Meta-learning is widely used for few-shot slot tagging in task of few-shot learning. The performance of existing methods is, however, seriously affected by \textit{sample forgetting issue}, where the model forgets the historically learned…

Artificial Intelligence · Computer Science 2023-09-12 Hongru Wang , Zezhong Wang , Wai Chung Kwan , Kam-Fai Wong

Modern deep learning requires large-scale extensively labelled datasets for training. Few-shot learning aims to alleviate this issue by learning effectively from few labelled examples. In previously proposed few-shot visual classifiers, it…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Peyman Bateni , Jarred Barber , Raghav Goyal , Vaden Masrani , Jan-Willem van de Meent , Leonid Sigal , Frank Wood

Humans can learn a new language task efficiently with only few examples, by leveraging their knowledge obtained when learning prior tasks. In this paper, we explore whether and how such cross-task generalization ability can be acquired, and…

Computation and Language · Computer Science 2021-10-04 Qinyuan Ye , Bill Yuchen Lin , Xiang Ren

Reinforcement learning methods can achieve significant performance but require a large amount of training data collected on the same robotic platform. A policy trained with expensive data is rendered useless after making even a minor change…

Robotics · Computer Science 2021-03-08 Ali Ghadirzadeh , Xi Chen , Petra Poklukar , Chelsea Finn , Mårten Björkman , Danica Kragic

Large Language Models (LLMs) such as ChatGPT demonstrate strong few-shot adaptability without requiring fine-tuning, positioning them ideal for data-limited and real-time applications. However, this adaptability has not yet been replicated…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Zixuan Hu , Yongxian Wei , Li Shen , Chun Yuan , Dacheng Tao

A machine learning model that generalizes well should obtain low errors on unseen test examples. Thus, if we know how to optimally perturb training examples to account for test examples, we may achieve better generalization performance.…

Machine Learning · Computer Science 2022-02-15 Hae Beom Lee , Taewook Nam , Eunho Yang , Sung Ju Hwang

Few-shot dataset generalization is a challenging variant of the well-studied few-shot classification problem where a diverse training set of several datasets is given, for the purpose of training an adaptable model that can then learn…

Machine Learning · Computer Science 2021-06-22 Eleni Triantafillou , Hugo Larochelle , Richard Zemel , Vincent Dumoulin