English
Related papers

Related papers: Shaping Visual Representations with Language for F…

200 papers

The goal of few-shot classification is to classify new categories with few labeled examples within each class. Nowadays, the excellent performance in handling few-shot classification problems is shown by metric-based meta-learning methods.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Xu Luo , Yuxuan Chen , Liangjian Wen , Lili Pan , Zenglin Xu

Few-shot learning (FSL) aims to learn models that generalize to novel classes with limited training samples. Recent works advance FSL towards a scenario where unlabeled examples are also available and propose semi-supervised FSL methods.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Linglan Zhao , Dashan Guo , Yunlu Xu , Liang Qiao , Zhanzhan Cheng , Shiliang Pu , Yi Niu , Xiangzhong Fang

As unlabeled data carry rich task-relevant information, they are proven useful for few-shot learning of language model. The question is how to effectively make use of such data. In this work, we revisit the self-training technique for…

Computation and Language · Computer Science 2021-10-05 Yiming Chen , Yan Zhang , Chen Zhang , Grandee Lee , Ran Cheng , Haizhou Li

Low-shot image classification, where training images are limited or inaccessible, has benefited from recent progress on pre-trained vision-language (VL) models with strong generalizability, e.g. CLIP. Prompt learning methods built with VL…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Zhaoheng Zheng , Jingmin Wei , Xuefeng Hu , Haidong Zhu , Ram Nevatia

Although an object may appear in numerous contexts, we often describe it in a limited number of ways. Language allows us to abstract away visual variation to represent and communicate concepts. Building on this intuition, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Mohamed El Banani , Karan Desai , Justin Johnson

Few-shot natural language processing (NLP) refers to NLP tasks that are accompanied with merely a handful of labeled examples. This is a real-world challenge that an AI system must learn to handle. Usually we rely on collecting more…

Computation and Language · Computer Science 2020-07-21 Wenpeng Yin

Low-shot visual learning---the ability to recognize novel object categories from very few examples---is a hallmark of human visual intelligence. Existing machine learning approaches fail to generalize in the same way. To make progress on…

Computer Vision and Pattern Recognition · Computer Science 2017-11-07 Bharath Hariharan , Ross Girshick

Few-shot classification aims to carry out classification given only few labeled examples for the categories of interest. Though several approaches have been proposed, most existing few-shot learning (FSL) models assume that base and novel…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Yuan-Chia Cheng , Ci-Siang Lin , Fu-En Yang , Yu-Chiang Frank Wang

The existing few-shot video classification methods often employ a meta-learning paradigm by designing customized temporal alignment module for similarity calculation. While significant progress has been made, these methods fail to focus on…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zhenxi Zhu , Limin Wang , Sheng Guo , Gangshan Wu

The rise of Large Language Models (LLMs) has boosted the use of Few-Shot Learning (FSL) methods in natural language processing, achieving acceptable performance even when working with limited training data. The goal of FSL is to effectively…

Few-shot image classification aims to classify unseen classes with limited labelled samples. Recent works benefit from the meta-learning process with episodic tasks and can fast adapt to class from training to testing. Due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Da Chen , Yuefeng Chen , Yuhong Li , Feng Mao , Yuan He , Hui Xue

Cross-lingual summarization (XLS) aims to generate a summary in a target language different from the source language document. While large language models (LLMs) have shown promising zero-shot XLS performance, their few-shot capabilities on…

Computation and Language · Computer Science 2024-06-10 Gyutae Park , Seojin Hwang , Hwanhee Lee

Human intelligence is characterized by our ability to absorb and apply knowledge from the world around us, especially in rapidly acquiring new concepts from minimal examples, underpinned by prior knowledge. Few-shot learning (FSL) aims to…

Machine Learning · Computer Science 2024-08-20 Hui Xue , Yuexuan An , Yongchun Qin , Wenqian Li , Yixin Wu , Yongjuan Che , Pengfei Fang , Minling Zhang

Learning from one or few visual examples is one of the key capabilities of humans since early infancy, but is still a significant challenge for modern AI systems. While considerable progress has been achieved in few-shot learning from a few…

Computer Vision and Pattern Recognition · Computer Science 2020-01-23 Eli Schwartz , Leonid Karlinsky , Rogerio Feris , Raja Giryes , Alex M. Bronstein

When trained at sufficient scale, auto-regressive language models exhibit the notable ability to learn a new language task after being prompted with just a few examples. Here, we present a simple, yet effective, approach for transferring…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Maria Tsimpoukelli , Jacob Menick , Serkan Cabi , S. M. Ali Eslami , Oriol Vinyals , Felix Hill

Although significant progress has been made in few-shot learning, most of existing few-shot image classification methods require supervised pre-training on a large amount of samples of base classes, which limits their generalization ability…

Computer Vision and Pattern Recognition · Computer Science 2023-01-23 Fang Peng , Xiaoshan Yang , Linhui Xiao , Yaowei Wang , Changsheng Xu

Metric-based meta-learning techniques have successfully been applied to few-shot classification problems. In this paper, we propose to leverage cross-modal information to enhance metric-based few-shot learning methods. Visual and semantic…

Machine Learning · Computer Science 2020-02-19 Chen Xing , Negar Rostamzadeh , Boris N. Oreshkin , Pedro O. Pinheiro

Transformer-based language models have achieved remarkable success in few-shot in-context learning and drawn a lot of research interest. However, these models' performance greatly depends on the choice of the example prompts and also has…

Computation and Language · Computer Science 2023-06-21 Genta Indra Winata , Liang-Kang Huang , Soumya Vadlamannati , Yash Chandarana

Vision-language foundation models pretrained on large-scale data provide a powerful tool for many visual understanding tasks. Notably, many vision-language models build two encoders (visual and textual) that can map two modalities into the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Taihong Xiao , Zirui Wang , Liangliang Cao , Jiahui Yu , Shengyang Dai , Ming-Hsuan Yang

The advent of instruction-tuned language models that convincingly mimic human writing poses a significant risk of abuse. However, such abuse may be counteracted with the ability to detect whether a piece of text was composed by a language…

Computation and Language · Computer Science 2024-05-09 Rafael Rivera Soto , Kailin Koch , Aleem Khan , Barry Chen , Marcus Bishop , Nicholas Andrews