English
Related papers

Related papers: LP++: A Surprisingly Strong Linear Probe for Few-S…

200 papers

Large Language Models (LLMs) have been extensively applied in time series analysis. Yet, their utility in the few-shot classification (i.e., a crucial training scenario due to the limited training data available in industrial applications)…

Machine Learning · Computer Science 2025-02-04 Yakun Chen , Zihao Li , Chao Yang , Xianzhi Wang , Guandong Xu

Efficiently adapting large Vision-Language Models (VLMs) like CLIP for few-shot learning poses challenges in balancing pre-trained knowledge retention and task-specific adaptation. Existing methods often overlook valuable structural…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Dazhi Huang

Due to the limited availability of data, existing few-shot learning methods trained from scratch fail to achieve satisfactory performance. In contrast, large-scale pre-trained models such as CLIP demonstrate remarkable few-shot and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Kun Song , Huimin Ma , Bochao Zou , Huishuai Zhang , Weiran Huang

Prompt tuning is a new few-shot transfer learning technique that only tunes the learnable prompt for pre-trained vision and language models such as CLIP. However, existing prompt tuning methods tend to learn spurious or entangled…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Xuehai He , Diji Yang , Weixi Feng , Tsu-Jui Fu , Arjun Akula , Varun Jampani , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

In the context of few-shot classification, the goal is to train a classifier using a limited number of samples while maintaining satisfactory performance. However, traditional metric-based methods exhibit certain limitations in achieving…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Fatemeh Askari , Amirreza Fateh , Mohammad Reza Mohammadi

Humans are capable of learning new concepts from small numbers of examples. In contrast, supervised deep learning models usually lack the ability to extract reliable predictive rules from limited data scenarios when attempting to classify…

Machine Learning · Computer Science 2020-07-17 Zhongjie Yu , Sebastian Raschka

Few-shot classification aims to learn a classifier to recognize unseen classes during training with limited labeled examples. While significant progress has been made, the growing complexity of network designs, meta-learning algorithms, and…

Computer Vision and Pattern Recognition · Computer Science 2020-01-14 Wei-Yu Chen , Yen-Cheng Liu , Zsolt Kira , Yu-Chiang Frank Wang , Jia-Bin Huang

As the complexity and connectivity of networks increase, the need for novel malware detection approaches becomes imperative. Traditional security defenses are becoming less effective against the advanced tactics of today's cyberattacks.…

Cryptography and Security · Computer Science 2024-09-18 Kyle Stein , Andrew A. Mahyari , Guillermo Francia , Eman El-Sheikh

Few-shot learning aims to recognize instances from novel classes with few labeled samples, which has great value in research and application. Although there has been a lot of work in this area recently, most of the existing work is based on…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Congqi Cao , Yajuan Li , Qinyi Lv , Peng Wang , Yanning Zhang

Linear Programming (LP) is widely applied in industry and is a key component of various other mathematical problem-solving techniques. Recent work introduced an LP compiler translating polynomial-time, polynomial-space algorithms into…

Programming Languages · Computer Science 2025-09-17 Shermin Khosravi , David Bremner

Few-shot adaptation of vision-language models (VLMs) like CLIP typically relies on learning textual prompts matched to global image embeddings. Recent works extend this paradigm by incorporating local image-text alignment to capture…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Deniz Kizaroğlu , Ülku Tuncer Küçüktas , Emre Çakmakyurdu , Alptekin Temizel

Few-shot learning algorithms aim to learn model parameters capable of adapting to unseen classes with the help of only a few labeled examples. A recent regularization technique - Manifold Mixup focuses on learning a general-purpose…

Machine Learning · Computer Science 2020-01-22 Puneet Mangla , Mayank Singh , Abhishek Sinha , Nupur Kumari , Vineeth N Balasubramanian , Balaji Krishnamurthy

We study how much a linear program (LP) can be compressed when solved repeatedly, given prior knowledge about its objective function. Existing data-driven projection methods learn low-dimensional surrogate LPs with approximate…

Optimization and Control · Mathematics 2026-05-26 Yuhan Ye , Omar Bennouna

Current multi-instance learning algorithms for pathology image analysis often require a substantial number of Whole Slide Images for effective training but exhibit suboptimal performance in scenarios with limited learning data. In clinical…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Linhao Qu , Dingkang Yang , Dan Huang , Qinhao Guo , Rongkui Luo , Shaoting Zhang , Xiaosong Wang

Anomaly detection methods typically require extensive normal samples from the target class for training, limiting their applicability in scenarios that require rapid adaptation, such as cold start. Zero-shot and few-shot anomaly detection…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhaopeng Gu , Bingke Zhu , Guibo Zhu , Yingying Chen , Ming Tang , Jinqiao Wang

Verifying the authenticity of AI-generated images presents a growing challenge on social media platforms these days. While vision-language models (VLMs) like CLIP outdo in multimodal representation, their capacity for AI-generated image…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Ziyang Ou

Multi-modal (vision-language) models, such as CLIP, are replacing traditional supervised pre-training models (e.g., ImageNet-based pre-training) as the new generation of visual foundation models. These models with robust and aligned…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Fan Liu , Tianshu Zhang , Wenwen Dai , Wenwen Cai , Xiaocong Zhou , Delong Chen

Few-Shot learning aims to train and optimize a model that can adapt to unseen visual classes with only a few labeled examples. The existing few-shot learning (FSL) methods, heavily rely only on visual data, thus fail to capture the semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Mohamed Afham , Ranga Rodrigo

Recent Vision-Language Pretrained (VLP) models have become the backbone for many downstream tasks, but they are utilized as frozen model without learning. Prompt learning is a method to improve the pre-trained VLP model by adding a…

Computation and Language · Computer Science 2024-01-17 Youngjae Cho , HeeSun Bae , Seungjae Shin , Yeo Dong Youn , Weonyoung Joo , Il-Chul Moon

Pre-trained vision-language (V-L) models such as CLIP have shown excellent performance in many downstream cross-modal tasks. However, most of them are only applicable to the English context. Subsequent research has focused on this problem…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Wenbo Zhang , Yifan Zhang , Jianfeng Lin , Binqiang Huang , Jinlu Zhang , Wenhao Yu