English
Related papers

Related papers: Towards Fine-Grained Vision-Language Alignment for…

200 papers

Few-shot fine-grained visual classification (FGVC) aims to leverage limited data to enable models to discriminate subtly distinct categories. Recent works mostly finetuned the pre-trained visual language models to achieve performance gain,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Hongyu Guo , Xiangzhao Hao , Jiarui Guo , Haiyun Guo , Jinqiao Wang , Tat-Seng Chua

Recently, zero-shot anomaly detection (ZSAD) has emerged as a pivotal paradigm for industrial inspection and medical diagnostics, detecting defects in novel objects without requiring any target-dataset samples during training. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Jingyi Yuan , Chenqiang Gao , Pengyu Jie , Xuan Xia , Shangri Huang , Wanquan Liu

Due to the scarcity of sampling data in reality, few-shot object detection (FSOD) has drawn more and more attention because of its ability to quickly train new detection concepts with less data. However, there are still failure…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Zeyu Shangguan , Lian Huai , Tong Liu , Xingqun Jiang

Video anomaly detection (VAD) is a challenging task that detects anomalous frames in continuous surveillance videos. Most previous work utilizes the spatio-temporal correlation of visual features to distinguish whether there are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Guangyu Dai , Dong Chen , Siliang Tang , Yueting Zhuang

Anomaly detection identifies departures from expected behavior in safety-critical settings. When target-domain normal data are unavailable, zero-shot anomaly detection (ZSAD) leverages vision-language models (VLMs). However, CLIP's coarse…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Alireza Salehi , Ehsan Karami , Sepehr Noey , Sahand Noey , Makoto Yamada , Reshad Hosseini , Mohammad Sabokrou

Modern image classification is based upon directly predicting classes via large discriminative networks, which do not directly contain information about the intuitive visual features that may constitute a classification decision. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Zhili Feng , Anna Bair , J. Zico Kolter

Foundation vision-language models (VLMs) excel on natural images, but their utility for biomedical microscopy remains underexplored. In this paper, we investigate how in-context learning enables state-of-the-art VLMs to perform few-shot…

While anomaly detection has made significant progress, generating detailed analyses that incorporate industrial knowledge remains a challenge. To address this gap, we introduce OmniAD, a novel framework that unifies anomaly detection and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Shifang Zhao , Yiheng Lin , Lu Han , Yao Zhao , Yunchao Wei

Few-shot learning (FSL) aims to address the data-scarce problem. A standard FSL framework is composed of two components: (1) Pre-train. Employ the base data to generate a CNN-based feature extraction model (FEM). (2) Meta-test. Apply the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Shuai Shao , Lei Xing , Yan Wang , Rui Xu , Chunyan Zhao , Yan-Jiang Wang , Bao-Di Liu

This paper proposes LLaFS, the first attempt to leverage large language models (LLMs) in few-shot segmentation. In contrast to the conventional few-shot segmentation methods that only rely on the limited and biased information from the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Lanyun Zhu , Tianrun Chen , Deyi Ji , Jieping Ye , Jun Liu

Zero-shot anomaly detection (ZSAD) often leverages pretrained vision or vision-language models, but many existing methods use prompt learning or complex modeling to fit the data distribution, resulting in high training or inference cost and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Chaoran Xu , Chengkan Lv , Qiyu Chen , Feng Zhang , Zhengtao Zhang

Fine-grained video action recognition can be conceptualized as a video-text matching problem. Previous approaches often rely on global video semantics to consolidate video embeddings, which can lead to misalignment in video-text pairs due…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Enqi Liu , Liyuan Pan , Yan Yang , Yiran Zhong , Zhijing Wu , Xinxiao Wu , Liu Liu

Cross-modal feature extraction and integration have led to steady performance improvements in few-shot learning tasks due to generating richer features. However, existing multi-modal object detection (MM-OD) methods degrade when facing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Zeyu Shangguan , Daniel Seita , Mohammad Rostami

Prompting has emerged as a practical way to adapt frozen vision-language models (VLMs) for video anomaly detection (VAD). Yet, existing prompts are often overly abstract, overlooking the fine-grained human-object interactions or action…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Shu Zou , Xinyu Tian , Lukas Wesemann , Fabian Waschkowski , Zhaoyuan Yang , Jing Zhang

Pretrained vision-language models (VLMs), such as CLIP, have shown remarkable potential in few-shot image classification and led to numerous effective transfer learning strategies. These methods leverage the pretrained knowledge of VLMs to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Dexia Chen , Qianjie Zhu , Weibing Li , Yue Yu , Tong Zhang , Ruixuan Wang

Recent progress in large-scale pre-training has led to the development of advanced vision-language models (VLMs) with remarkable proficiency in comprehending and generating multimodal content. Despite the impressive ability to perform…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Hang Hua , Jing Shi , Kushal Kafle , Simon Jenni , Daoan Zhang , John Collomosse , Scott Cohen , Jiebo Luo

Few-shot learning is a promising way for reducing the label cost in new categories adaptation with the guidance of a small, well labeled support set. But for few-shot semantic segmentation, the pixel-level annotations of support images are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Jing Wang , Yuang Liu , Qiang Zhou , Fan Wang

High-quality annotation of fine-grained visual categories demands great expert knowledge, which is taxing and time consuming. Alternatively, learning fine-grained visual representation from enormous unlabeled images (e.g., species, brands)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Qi Bi , Wei Ji , Jingjun Yi , Haolan Zhan , Gui-Song Xia

Weakly supervised semantic segmentation (WSSS) based on image-level labels is challenging since it is hard to obtain complete semantic regions. To address this issue, we propose a self-training method that utilizes fused multi-scale…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Guoqing Yang , Chuang Zhu , Yu Zhang

Anomaly detection is an important task for complex systems (e.g., industrial facilities, manufacturing, large-scale science experiments), where failures in a sub-system can lead to low yield, faulty products, or even damage to components.…

Machine Learning · Computer Science 2023-09-06 Ryan Humble , Zhe Zhang , Finn O'Shea , Eric Darve , Daniel Ratner