English
Related papers

Related papers: Can In-context Learners Learn a Reasoning Concept …

200 papers

Large language models (LLMs) excel at few-shot in-context learning (ICL) -- learning from a few examples provided in context at inference, without any weight updates. Newly expanded context windows allow us to investigate ICL with hundreds…

Currently, the state-of-the-art methods treat few-shot semantic segmentation task as a conditional foreground-background segmentation problem, assuming each class is independent. In this paper, we introduce the concept of meta-class, which…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Zhonghua Wu , Xiangxi Shi , Guosheng lin , Jianfei Cai

Few-shot and zero-shot text classification aim to recognize samples from novel classes with limited labeled samples or no labeled samples at all. While prevailing methods have shown promising performance via transferring knowledge from seen…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Han Liu , Siyang Zhao , Xiaotong Zhang , Feng Zhang , Wei Wang , Fenglong Ma , Hongyang Chen , Hong Yu , Xianchao Zhang

Humans possess innate meta-learning capabilities, partly attributable to their exceptional color perception. In this paper, we pioneer an innovative viewpoint on few-shot learning by simulating human color perception mechanisms. We propose…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Chaofei Qi , Zhitai Liu , Jianbin Qiu

A core tension in models of concept learning is that the model must carefully balance the tractability of inference against the expressivity of the hypothesis class. Humans, however, can efficiently learn a broad range of concepts. We…

Computation and Language · Computer Science 2023-10-02 Kevin Ellis

The goal of few-shot classification is to classify new categories with few labeled examples within each class. Nowadays, the excellent performance in handling few-shot classification problems is shown by metric-based meta-learning methods.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Xu Luo , Yuxuan Chen , Liangjian Wen , Lili Pan , Zenglin Xu

We study the few-shot learning (FSL) problem, where a model learns to recognize new objects with extremely few labeled training data per category. Most of previous FSL approaches resort to the meta-learning paradigm, where the model…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Zejiang Hou , Sun-Yuan Kung

The stance detection task aims to classify the stance toward given documents and topics. Since the topics can be implicit in documents and unseen in training data for zero-shot settings, we propose to boost the transferability of the stance…

Computation and Language · Computer Science 2022-10-06 Yun Luo , Zihan Liu , Yuefeng Shi , Stan Z Li , Yue Zhang

We consider a new problem of few-shot learning of compact models. Meta-learning is a popular approach for few-shot learning. Previous work in meta-learning typically assumes that the model architecture during meta-training is the same as…

Machine Learning · Computer Science 2022-10-19 Yong Wu , Shekhor Chanda , Mehrdad Hosseinzadeh , Zhi Liu , Yang Wang

We propose a method that can perform one-class classification given only a small number of examples from the target class and none from the others. We formulate the learning of meaningful features for one-class classification as a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Gabriel Dahia , Maurício Pamplona Segundo

Most of the existing deep neural nets on automatic facial expression recognition focus on a set of predefined emotion classes, where the amount of training data has the biggest impact on performance. However, in the standard setting…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Anca-Nicoleta Ciubotaru , Arnout Devos , Behzad Bozorgtabar , Jean-Philippe Thiran , Maria Gabrani

Humans excel at building generalizations of new concepts from just one single example. Contrary to this, current computer vision models typically require large amount of training samples to achieve a comparable accuracy. In this work we…

Artificial Intelligence · Computer Science 2024-09-16 Octavio Arriaga , Jichen Guo , Rebecca Adam , Sebastian Houben , Frank Kirchner

Learning from one or few visual examples is one of the key capabilities of humans since early infancy, but is still a significant challenge for modern AI systems. While considerable progress has been achieved in few-shot learning from a few…

Computer Vision and Pattern Recognition · Computer Science 2020-01-23 Eli Schwartz , Leonid Karlinsky , Rogerio Feris , Raja Giryes , Alex M. Bronstein

Language models have been shown to perform better with an increase in scale on a wide variety of tasks via the in-context learning paradigm. In this paper, we investigate the hypothesis that the ability of a large language model to…

Computation and Language · Computer Science 2023-08-17 Hritik Bansal , Karthik Gopalakrishnan , Saket Dingliwal , Sravan Bodapati , Katrin Kirchhoff , Dan Roth

We propose to study the problem of few-shot learning with the prism of inference on a partially observed graphical model, constructed from a collection of input images whose label can be either observed or not. By assimilating generic…

Machine Learning · Statistics 2018-02-21 Victor Garcia , Joan Bruna

While many-shot ICL achieves remarkable performance, prior studies of its scaling behavior have mainly focused on non-reasoning tasks. In this work, we study many-shot ICL on reasoning tasks, with a particular focus on many-shot…

Computation and Language · Computer Science 2026-05-29 Tsz Ting Chung , Lemao Liu , Mo Yu , Dit-Yan Yeung

People interact with the real-world largely dependent on visual signal, which are ubiquitous and illustrate detailed demonstrations. In this paper, we explore utilizing visual signals as a new interface for models to interact with the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Wentao Zhang , Junliang Guo , Tianyu He , Li Zhao , Linli Xu , Jiang Bian

According to the principle of compositional generalization, the meaning of a complex expression can be understood as a function of the meaning of its parts and of how they are combined. This principle is crucial for human language…

Computation and Language · Computer Science 2024-03-19 Sungjun Han , Sebastian Padó

Imitation learning allows agents to learn complex behaviors from demonstrations. However, learning a complex vision-based task may require an impractical number of demonstrations. Meta-imitation learning is a promising approach towards…

Learning from a few examples is an important practical aspect of training classifiers. Various works have examined this aspect quite well. However, all existing approaches assume that the few examples provided are always correctly labeled.…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Pratik Mazumder , Pravendra Singh , Vinay P. Namboodiri