English
Related papers

Related papers: FD-Align: Feature Discrimination Alignment for Fin…

200 papers

Existing approaches towards anomaly detection~(AD) often rely on a substantial amount of anomaly-free data to train representation and density models. However, large anomaly-free datasets may not always be available before the inference…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Jingyi Liao , Xun Xu , Manh Cuong Nguyen , Adam Goodge , Chuan Sheng Foo

Many real-world classification problems often have classes with very few labeled training samples. Moreover, all possible classes may not be initially available for training, and may be given incrementally. Deep learning models need to deal…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Pratik Mazumder , Pravendra Singh , Piyush Rai

Fine-tuning a deep network trained with the standard cross-entropy loss is a strong baseline for few-shot learning. When fine-tuned transductively, this outperforms the current state-of-the-art on standard datasets such as Mini-ImageNet,…

Machine Learning · Computer Science 2020-10-23 Guneet S. Dhillon , Pratik Chaudhari , Avinash Ravichandran , Stefano Soatto

The goal of few-shot learning is to learn a classifier that can recognize unseen classes from limited support data with labels. A common practice for this task is to train a model on the base set first and then transfer to novel classes…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Zhiqiang Shen , Zechun Liu , Jie Qin , Marios Savvides , Kwang-Ting Cheng

With the popularity of foundational models, parameter efficient fine tuning has become the defacto approach to leverage pretrained models to perform downstream tasks. Taking inspiration from recent advances in large language models, Visual…

Image and Video Processing · Electrical Eng. & Systems 2025-01-08 Aadya Arora , Vinay Namboodiri

Prompt tuning, which involves training a small set of parameters, effectively enhances the pre-trained Vision-Language Models (VLMs) to downstream tasks. However, they often come at the cost of flexibility and adaptability when the tuned…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Mushui Liu , Bozheng Li , Yunlong Yu

Few-Shot learning aims to train and optimize a model that can adapt to unseen visual classes with only a few labeled examples. The existing few-shot learning (FSL) methods, heavily rely only on visual data, thus fail to capture the semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Mohamed Afham , Ranga Rodrigo

Most previous few-shot learning algorithms are based on meta-training with fake few-shot tasks as training samples, where large labeled base classes are required. The trained model is also limited by the type of tasks. In this paper we…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jianyi Li , Guizhong Liu

Learning from large-scale contrastive language-image pre-training like CLIP has shown remarkable success in a wide range of downstream tasks recently, but it is still under-explored on the challenging few-shot action recognition (FSAR)…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Xiang Wang , Shiwei Zhang , Jun Cen , Changxin Gao , Yingya Zhang , Deli Zhao , Nong Sang

Few-shot classification aims to recognize novel categories with only few labeled images in each class. Existing metric-based few-shot classification algorithms predict categories by comparing the feature embeddings of query images with…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Hung-Yu Tseng , Hsin-Ying Lee , Jia-Bin Huang , Ming-Hsuan Yang

Few-shot learning is a fundamental and challenging problem since it requires recognizing novel categories from only a few examples. The objects for recognition have multiple variants and can locate anywhere in images. Directly comparing…

Computer Vision and Pattern Recognition · Computer Science 2022-01-10 Congqi Cao , Yanning Zhang

Recent studies have revealed the intriguing few-shot learning ability of pretrained language models (PLMs): They can quickly adapt to a new task when fine-tuned on a small amount of labeled data formulated as prompts, without requiring…

Computation and Language · Computer Science 2023-05-15 Yu Meng , Martin Michalski , Jiaxin Huang , Yu Zhang , Tarek Abdelzaher , Jiawei Han

Efficient fine-tuning of vision-language models (VLMs) like CLIP for specific downstream tasks is gaining significant attention. Previous works primarily focus on prompt learning to adapt the CLIP into a variety of downstream tasks,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Jinlong Li , Dong Zhao , Zequn Jie , Elisa Ricci , Lin Ma , Nicu Sebe

Research to improve Automated Short Answer Grading has recently focused on Large Language Models (LLMs) with prompt engineering and no- or few-shot prompting to achieve best results. This is in contrast to the fine-tuning approach, which…

Machine Learning · Computer Science 2025-08-07 Joel Walsh , Siddarth Mamidanna , Benjamin Nye , Mark Core , Daniel Auerbach

Few-shot learning (FSL) is an important and topical problem in computer vision that has motivated extensive research into numerous methods spanning from sophisticated meta-learning methods to simple transfer learning baselines. We seek to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-18 Shell Xu Hu , Da Li , Jan Stühmer , Minyoung Kim , Timothy M. Hospedales

The focus of recent meta-learning research has been on the development of learning algorithms that can quickly adapt to test time tasks with limited data and low computational cost. Few-shot learning is widely used as one of the standard…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Yonglong Tian , Yue Wang , Dilip Krishnan , Joshua B. Tenenbaum , Phillip Isola

In this paper we explore few-shot imitation learning for control problems, which involves learning to imitate a target policy by accessing a limited set of offline rollouts. This setting has been relatively under-explored despite its…

Machine Learning · Computer Science 2023-06-26 Massimiliano Patacchiola , Mingfei Sun , Katja Hofmann , Richard E. Turner

Handling distribution shifts from training data, known as out-of-distribution (OOD) generalization, poses a significant challenge in the field of machine learning. While a pre-trained vision-language model like CLIP has demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Bac Nguyen , Stefan Uhlich , Fabien Cardinaux , Lukas Mauch , Marzieh Edraki , Aaron Courville

Object detection has achieved substantial progress in the last decade. However, detecting novel classes with only few samples remains challenging, since deep learning under low data regime usually leads to a degraded feature space. Existing…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Yuhang Cao , Jiaqi Wang , Ying Jin , Tong Wu , Kai Chen , Ziwei Liu , Dahua Lin

Few-shot classification requires deep neural networks to learn generalized representations only from limited training images, which is challenging but significant in low-data regimes. Recently, CLIP-based methods have shown promising…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Renrui Zhang , Bohao Li , Wei Zhang , Hao Dong , Hongsheng Li , Peng Gao , Yu Qiao