English
Related papers

Related papers: Fine-grained Abnormality Prompt Learning for Zero-…

200 papers

Zero-shot anomaly detection (ZSAD) offers potential for identifying anomalies in medical imaging without task-specific training. In this paper, we evaluate CLIP-based models, originally developed for industrial tasks, on brain tumor…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Aldo Marzullo , Marta Bianca Maria Ranzini

Prompt learning is one of the most effective and trending ways to adapt powerful vision-language foundation models like CLIP to downstream datasets by tuning learnable prompt vectors with very few samples. However, although prompt learning…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Cairong Zhao , Yubin Wang , Xinyang Jiang , Yifei Shen , Kaitao Song , Dongsheng Li , Duoqian Miao

Despite Multimodal Large Language Models (MLLMs) showing promising results on general zero-shot image classification tasks, fine-grained image classification remains challenging. It demands precise attention to subtle visual details to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Yunqi Hong , Sohyun An , Andrew Bai , Neil Y. C. Lin , Cho-Jui Hsieh

Current non-rigid object keypoint detectors perform well on a chosen kind of species and body parts, and require a large amount of labelled keypoints for training. Moreover, their heatmaps, tailored to specific body parts, cannot recognize…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Changsheng Lu , Piotr Koniusz

This study harnesses state-of-the-art AI technology for detecting mental disorders through user-generated textual content. Existing studies typically rely on fully supervised machine learning, which presents challenges such as the…

Computation and Language · Computer Science 2025-03-17 Haoxin Liu , Wenli Zhang , Jiaheng Xie , Buomsoo Kim , Zhu Zhang , Yidong Chai , Sudha Ram

Zero-shot object detection (ZSD) aims to leverage semantic descriptions to localize and recognize objects of both seen and unseen classes. Existing ZSD works are mainly coarse-grained object detection, where the classes are visually quite…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Hongxu Ma , Chenbo Zhang , Lu Zhang , Jiaogen Zhou , Jihong Guan , Shuigeng Zhou

Visual prompt learning, as a newly emerged technique, leverages the knowledge learned by a large-scale pre-trained model and adapts it to downstream tasks through the usage of prompts. While previous research has focused on designing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Ziqing Yang , Zeyang Sha , Michael Backes , Yang Zhang

Face Morphing Attack Detection (MAD) is a critical challenge in face recognition security, where attackers can fool systems by interpolating the identity information of two or more individuals into a single face image, resulting in samples…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Eduarda Caldeira , Fadi Boutros , Naser Damer

Medical anomaly detection (AD) is crucial for early clinical intervention, yet it faces challenges due to limited access to high-quality medical imaging data, caused by privacy concerns and data silos. Few-shot learning has emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Kaiyu Guo , Tan Pan , Chen Jiang , Zijian Wang , Brian C. Lovell , Limei Han , Yuan Cheng , Mahsa Baktashmotlagh

Prompt tuning, a recently emerging paradigm, enables the powerful vision-language pre-training models to adapt to downstream tasks in a parameter -- and data -- efficient way, by learning the ``soft prompts'' to condition frozen…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Juncheng Li , Minghe Gao , Longhui Wei , Siliang Tang , Wenqiao Zhang , Mengze Li , Wei Ji , Qi Tian , Tat-Seng Chua , Yueting Zhuang

Industrial anomaly classification (AC) is an indispensable task in industrial manufacturing, which guarantees quality and safety of various product. To address the scarcity of data in industrial scenarios, lots of few-shot anomaly detection…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Zuo Zuo , Jiahao Dong , Yao Wu , Yanyun Qu , Zongze Wu

Recent advances in large-scale vision and language models have led to significant progress in zero-shot learning tasks. Methods such as CoOp and CoCoOp have shown that replacing handcrafted prompts with learnable vectors, known as prompt…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Gahyeon Kim , Sohee Kim , Seokju Lee

Recent advances in large pre-trained vision-language models have demonstrated remarkable performance on zero-shot downstream tasks. Building upon this, recent studies, such as CoOp and CoCoOp, have proposed the use of prompt learning, where…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Gahyeon Kim , Sohee Kim , Seokju Lee

Exploiting the foundation models (e.g., CLIP) to build a versatile keypoint detector has gained increasing attention. Most existing models accept either the text prompt (e.g., ``the nose of a cat''), or the visual prompt (e.g., support…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Changsheng Lu , Zheyuan Liu , Piotr Koniusz

Detecting visual anomalies in industrial inspection often requires training with only a few normal images per category. Recent few-shot methods achieve strong results employing foundation-model features, but typically rely on memory banks,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Camile Lendering , Erkut Akdag , Egor Bondarev

Despite the remarkable success of deep learning in medical imaging analysis, medical image segmentation remains challenging due to the scarcity of high-quality labeled images for supervision. Further, the significant domain gap between…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Hedda Cohen Indelman , Elay Dahan , Angeles M. Perez-Agosto , Carmit Shiran , Doron Shaked , Nati Daniel

Pre-trained vision-language models, e.g., CLIP, working with manually designed prompts have demonstrated great capacity of transfer learning. Recently, learnable prompts achieve state-of-the-art performance, which however are prone to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Baoshuo Kan , Teng Wang , Wenpeng Lu , Xiantong Zhen , Weili Guan , Feng Zheng

Zero-shot action recognition is challenging due to the semantic gap between seen and unseen classes. We present a novel framework that enhances CLIP with disentangled embeddings and semantic-guided interaction. A Motion Separation Module…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yiming Wang , Frederick W. B. Li , Jingyun Wang

Unsupervised Domain Adaptation (UDA) is a critical challenge in real-world vision systems, especially in resource-constrained environments like drones, where memory and computation are limited. Existing prompt-driven UDA methods typically…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Yasir Ali Farrukh , Syed Wali , Irfan Khan , Nathaniel D. Bastian

Most advances in medical image recognition supporting clinical auxiliary diagnosis meet challenges due to the low-resource situation in the medical field, where annotations are highly expensive and professional. This low-resource problem…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Fudan Zheng , Jindong Cao , Weijiang Yu , Zhiguang Chen , Nong Xiao , Yutong Lu