English
Related papers

Related papers: Knowledge Prompting for Few-shot Action Recognitio…

200 papers

Recent vision-language models are driven by large-scale pretrained models. However, adapting pretrained models on limited data presents challenges such as overfitting, catastrophic forgetting, and the cross-modal gap between vision and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Deniz Engin , Yannis Avrithis

Image-based visual-language (I-VL) pre-training has shown great success for learning joint visual-textual representations from large-scale web data, revealing remarkable ability for zero-shot generalisation. This paper presents a simple but…

Computer Vision and Pattern Recognition · Computer Science 2022-07-18 Chen Ju , Tengda Han , Kunhao Zheng , Ya Zhang , Weidi Xie

Many interesting events in the real world are rare making preannotated machine learning ready videos a rarity in consequence. Thus, temporal activity detection models that are able to learn from a few examples are desirable. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Huijuan Xu , Ximeng Sun , Eric Tzeng , Abir Das , Kate Saenko , Trevor Darrell

Few-shot learning aims to recognize instances from novel classes with few labeled samples, which has great value in research and application. Although there has been a lot of work in this area recently, most of the existing work is based on…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Congqi Cao , Yajuan Li , Qinyi Lv , Peng Wang , Yanning Zhang

Event detection is one of the fundamental tasks in information extraction and knowledge graph. However, a realistic event detection system often needs to deal with new event classes constantly. These new classes usually have only a few…

Computation and Language · Computer Science 2024-04-03 Kailin Zhao , Xiaolong Jin , Long Bai , Jiafeng Guo , Xueqi Cheng

A particularly successful class of approaches for few-shot learning combines language models with prompts -- hand-crafted task descriptions that complement data samples. However, designing prompts by hand for each task commonly requires…

Computation and Language · Computer Science 2023-10-24 Rami Aly , Xingjian Shi , Kaixiang Lin , Aston Zhang , Andrew Gordon Wilson

Few-shot Learning (FSL) is aimed to make predictions based on a limited number of samples. Structured data such as knowledge graphs and ontology libraries has been leveraged to benefit the few-shot setting in various tasks. However, the…

Computation and Language · Computer Science 2023-01-27 Hongbin Ye , Ningyu Zhang , Shumin Deng , Xiang Chen , Hui Chen , Feiyu Xiong , Xi Chen , Huajun Chen

The existing few-shot video classification methods often employ a meta-learning paradigm by designing customized temporal alignment module for similarity calculation. While significant progress has been made, these methods fail to focus on…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zhenxi Zhu , Limin Wang , Sheng Guo , Gangshan Wu

We propose a simple yet a novel approach to improve completion in domain modeling activities. Our approach exploits the power of large language models by using few-shot prompt learning without the need to train or fine-tune those models…

Software Engineering · Computer Science 2022-12-08 Meriem Ben Chaaben , Lola Burgueño , Houari Sahraoui

Detecting social bias in text is challenging due to nuance, subjectivity, and difficulty in obtaining good quality labeled datasets at scale, especially given the evolving nature of social biases and society. To address these challenges, we…

Computation and Language · Computer Science 2022-04-19 Shrimai Prabhumoye , Rafal Kocielnik , Mohammad Shoeybi , Anima Anandkumar , Bryan Catanzaro

The lack of large-scale real datasets with annotations makes transfer learning a necessity for video activity understanding. We aim to develop an effective method for few-shot transfer learning for first-person action classification. We…

Computer Vision and Pattern Recognition · Computer Science 2021-12-09 Huseyin Coskun , Zeeshan Zia , Bugra Tekin , Federica Bogo , Nassir Navab , Federico Tombari , Harpreet Sawhney

The Contrastive Language-Image Pretraining (CLIP) model has been widely used in various downstream vision tasks. The few-shot learning paradigm has been widely adopted to augment its capacity for these tasks. However, current paradigms may…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Jintao Rong , Hao Chen , Linlin Ou , Tianxiao Chen , Xinyi Yu , Yifan Liu

The goal of this work is to build flexible video-language models that can generalize to various video-to-text tasks from few examples, such as domain-specific captioning, question answering, and future event prediction. Existing few-shot…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Zhenhailong Wang , Manling Li , Ruochen Xu , Luowei Zhou , Jie Lei , Xudong Lin , Shuohang Wang , Ziyi Yang , Chenguang Zhu , Derek Hoiem , Shih-Fu Chang , Mohit Bansal , Heng Ji

Few-shot learning aims to recognize novel classes from a few examples. Although significant progress has been made in the image domain, few-shot video classification is relatively unexplored. We argue that previous methods underestimate the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Yongqin Xian , Bruno Korbar , Matthijs Douze , Lorenzo Torresani , Bernt Schiele , Zeynep Akata

Recent studies have demonstrated that natural-language prompts can help to leverage the knowledge learned by pre-trained language models for the binary sentence-level sentiment classification task. Specifically, these methods utilize…

Computation and Language · Computer Science 2023-07-04 Mohna Chakraborty , Adithya Kulkarni , Qi Li

We study multi-modal few-shot object detection (FSOD) in this paper, using both few-shot visual examples and class semantic information for detection, which are complementary to each other by definition. Most of the previous works on…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Guangxing Han , Long Chen , Jiawei Ma , Shiyuan Huang , Rama Chellappa , Shih-Fu Chang

Contrastive language-image pretraining has shown great success in learning visual-textual joint representation from web-scale data, demonstrating remarkable "zero-shot" generalization ability for various image tasks. However, how to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Bolin Ni , Houwen Peng , Minghao Chen , Songyang Zhang , Gaofeng Meng , Jianlong Fu , Shiming Xiang , Haibin Ling

In this paper, we explore effective prompting techniques to enhance zero- and few-shot Visual Question Answering (VQA) performance in contemporary Vision-Language Models (VLMs). Central to our investigation is the role of question templates…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Rabiul Awal , Le Zhang , Aishwarya Agrawal

When trained at sufficient scale, auto-regressive language models exhibit the notable ability to learn a new language task after being prompted with just a few examples. Here, we present a simple, yet effective, approach for transferring…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Maria Tsimpoukelli , Jacob Menick , Serkan Cabi , S. M. Ali Eslami , Oriol Vinyals , Felix Hill

Few-shot learning is often motivated by the ability of humans to learn new tasks from few examples. However, standard few-shot classification benchmarks assume that the representation is learned on a limited amount of base class data,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Yann Lifchitz , Yannis Avrithis , Sylvaine Picard