English
Related papers

Related papers: What Makes Good Few-shot Examples for Vision-Langu…

200 papers

The remarkable advancements in large language models (LLMs) have significantly enhanced the performance in few-shot learning settings. By using only a small number of labeled examples, referred to as demonstrations, LLMs can effectively…

Computation and Language · Computer Science 2023-11-23 Katerina Margatina , Timo Schick , Nikolaos Aletras , Jane Dwivedi-Yu

Pretrained language models (LMs) perform well on many tasks even when learning from a few examples, but prior work uses many held-out examples to tune various aspects of learning, such as hyperparameters, training objectives, and natural…

Computation and Language · Computer Science 2021-05-25 Ethan Perez , Douwe Kiela , Kyunghyun Cho

Pre-trained vision-language models (VLMs) like CLIP have demonstrated impressive zero-shot performance on a wide range of downstream computer vision tasks. However, there still exists a considerable performance gap between these models and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Bardia Safaei , Vishal M. Patel

Recent progress in the few-shot adaptation of Vision-Language Models (VLMs) has further pushed their generalization capabilities, at the expense of just a few labeled samples within the target downstream task. However, this promising,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Maxime Zanella , Ismail Ben Ayed

Few-shot learning (FSL) aims to learn new categories with a few visual samples per class. Few-shot class representations are often biased due to data scarcity. To mitigate this issue, we propose to generate visual samples based on semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-05-09 Jingyi Xu , Hieu Le

Large-scale multimodal representation learning successfully optimizes for zero-shot transfer at test time. Yet the standard pretraining paradigm (contrastive learning on large amounts of image-text data) does not explicitly encourage…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Karsten Roth , Zeynep Akata , Dima Damen , Ivana Balažević , Olivier J. Hénaff

Large-scale pretrained language models have led to dramatic improvements in text generation. Impressive performance can be achieved by finetuning only on a small number of instances (few-shot setting). Nonetheless, almost all previous work…

Computation and Language · Computer Science 2021-07-08 Ernie Chang , Xiaoyu Shen , Hui-Syuan Yeh , Vera Demberg

Few-shot learning aims to train models that can be generalized to novel classes with only a few samples. Recently, a line of works are proposed to enhance few-shot learning with accessible semantic information from class names. However,…

Machine Learning · Computer Science 2023-07-11 Zihao Jiang , Yunkai Dang , Dong Pang , Huishuai Zhang , Weiran Huang

Few-shot Learning aims to learn and distinguish new categories with a very limited number of available images, presenting a significant challenge in the realm of deep learning. Recent researchers have sought to leverage the additional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Chunpeng Zhou , Haishuai Wang , Xilu Yuan , Zhi Yu , Jiajun Bu

In few-shot learning, the selection of samples has a significant impact on the performance of the model. While effective sample selection strategies are well-established in supervised settings, research on large language models largely…

Machine Learning · Computer Science 2026-04-20 Branislav Pecher , Ivan Srba , Maria Bielikova , Joaquin Vanschoren

Few-shot action recognition aims to recognize action classes with few training samples. Most existing methods adopt a meta-learning approach with episodic training. In each episode, the few samples in a meta-training task are split into…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Xiatian Zhu , Antoine Toisoul , Juan-Manuel Perez-Rua , Li Zhang , Brais Martinez , Tao Xiang

Learning from a few examples is an important practical aspect of training classifiers. Various works have examined this aspect quite well. However, all existing approaches assume that the few examples provided are always correctly labeled.…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Pratik Mazumder , Pravendra Singh , Vinay P. Namboodiri

Few-shot classification has made great strides due to foundation models that, through priming and prompting, are highly effective few-shot learners. However, this approach has high variance both across different sets of few shots (data…

Computation and Language · Computer Science 2023-11-21 Abdullatif Köksal , Timo Schick , Hinrich Schütze

Pre-trained vision-language models learn massive data to model unified representations of images and natural languages, which can be widely applied to downstream machine learning tasks. In addition to zero-shot inference, in order to better…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Qian-Wei Wang , Yuqiu Xie , Letian Zhang , Zimo Liu , Shu-Tao Xia

Vision-language models (VLMs) have demonstrated remarkable zero-shot performance across various classification tasks. Nonetheless, their reliance on hand-crafted text prompts for each task hinders efficient adaptation to new tasks. While…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Hoyoung Kim , Seokhee Jin , Changhwan Sung , Jaechang Kim , Jungseul Ok

Recent studies have revealed the intriguing few-shot learning ability of pretrained language models (PLMs): They can quickly adapt to a new task when fine-tuned on a small amount of labeled data formulated as prompts, without requiring…

Computation and Language · Computer Science 2023-05-15 Yu Meng , Martin Michalski , Jiaxin Huang , Yu Zhang , Tarek Abdelzaher , Jiawei Han

Training a neural network model that can quickly adapt to a new task is highly desirable yet challenging for few-shot learning problems. Recent few-shot learning methods mostly concentrate on developing various meta-learning strategies from…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Zihang Jiang , Bingyi Kang , Kuangqi Zhou , Jiashi Feng

By describing the features and abstractions of our world, language is a crucial tool for human learning and a promising source of supervision for machine learning models. We use language to improve few-shot visual classification in the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Jesse Mu , Percy Liang , Noah Goodman

Large language models (LLMs) have made significant strides at code generation through improved model design, training, and chain-of-thought. However, prompt-level optimizations remain an important yet under-explored aspect of LLMs for…

Software Engineering · Computer Science 2024-12-05 Derek Xu , Tong Xie , Botao Xia , Haoyu Li , Yunsheng Bai , Yizhou Sun , Wei Wang

Few-shot Learning has been studied to mimic human visual capabilities and learn effective models without the need of exhaustive human annotation. Even though the idea of meta-learning for adaptation has dominated the few-shot learning…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Jiawei Ma , Hanchen Xie , Guangxing Han , Shih-Fu Chang , Aram Galstyan , Wael Abd-Almageed
‹ Prev 1 2 3 10 Next ›