English
Related papers

Related papers: Motion-Guided Semantic Alignment with Negative Pro…

200 papers

Zero-shot anomaly detection (ZSAD) aims to detect anomalies without any target domain training samples, relying solely on external auxiliary data. Existing CLIP-based methods attempt to activate the model's ZSAD potential via handcrafted or…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Ziteng Yang , Jingzehua Xu , Yanshu Li , Zepeng Li , Yeqiang Wang , Xinghui Li

This paper presents a novel method that leverages a visual-language model, CLIP, as a data source for zero-shot anomaly detection. Tremendous efforts have been put towards developing anomaly detectors due to their potential industrial…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Masato Tamura

Multi-modal learning has become increasingly popular due to its ability to leverage information from different data sources (e.g., text and images) to improve the model performance. Recently, CLIP has emerged as an effective approach that…

Machine Learning · Computer Science 2024-07-12 Zixiang Chen , Yihe Deng , Yuanzhi Li , Quanquan Gu

Fine-grained anomaly detection is crucial in industrial and medical applications, but labeled anomalies are often scarce, making zero-shot detection challenging. While vision-language models like CLIP offer promising solutions, they…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Ming Hu , Yongsheng Huo , Mingyu Dou , Jianfu Yin , Peng Zhao , Yao Wang , Cong Hu , Bingliang Hu , Quan Wang

The goal of spatial-temporal action detection is to determine the time and place where each person's action occurs in a video and classify the corresponding action category. Most of the existing methods adopt fully-supervised learning,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Wei-Jhe Huang , Jheng-Hsien Yeh , Min-Hung Chen , Gueter Josmy Faure , Shang-Hong Lai

Recognizing the activities causing distraction in real-world driving scenarios is critical for ensuring the safety and reliability of both drivers and pedestrians on the roadways. Conventional computer vision techniques are typically…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Md Zahid Hasan , Jiajing Chen , Jiyang Wang , Mohammed Shaiqur Rahman , Ameya Joshi , Senem Velipasalar , Chinmay Hegde , Anuj Sharma , Soumik Sarkar

Contrastive language-image pre-training (CLIP) has demonstrated remarkable zero-shot classification ability, namely image classification using novel text labels. Existing works have attempted to enhance CLIP by fine-tuning on downstream…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Seongha Eom , Namgyu Ho , Jaehoon Oh , Se-Young Yun

Contrastive vision-language models, such as CLIP, have demonstrated excellent zero-shot capability across semantic recognition tasks, mainly attributed to the training on a large-scale I&1T (one Image with one Text) dataset. This kind of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Zhichao Yang , Leida Li , Pengfei Chen , Jinjian Wu , Giuseppe Valenzise

Zero-shot anomaly detection (ZSAD) requires detection models trained using auxiliary data to detect anomalies without any training sample in a target dataset. It is a crucial task when training data is not accessible due to various…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Qihang Zhou , Guansong Pang , Yu Tian , Shibo He , Jiming Chen

Zero-shot anomaly detection (ZSAD) targets the identification of anomalies within images from arbitrary novel categories. This study introduces AdaCLIP for the ZSAD task, leveraging a pre-trained vision-language model (VLM), CLIP. AdaCLIP…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Yunkang Cao , Jiangning Zhang , Luca Frittoli , Yuqi Cheng , Weiming Shen , Giacomo Boracchi

Face Morphing Attack Detection (MAD) is a critical challenge in face recognition security, where attackers can fool systems by interpolating the identity information of two or more individuals into a single face image, resulting in samples…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Eduarda Caldeira , Fadi Boutros , Naser Damer

Recent studies are leveraging advancements in large language models (LLMs) trained on extensive internet-crawled text data to generate textual descriptions of downstream classes in CLIP-based zero-shot image classification. While most of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Tong Liang , Jim Davis

Existing vision-text contrastive learning like CLIP aims to match the paired image and caption embeddings while pushing others apart, which improves representation transferability and supports zero-shot prediction. However, medical…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Zifeng Wang , Zhenbang Wu , Dinesh Agarwal , Jimeng Sun

This paper considers zero-shot Anomaly Detection (AD), performing AD without reference images of the test objects. We propose a framework called CLIP-AD to leverage the zero-shot capabilities of the large vision-language model CLIP.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Xuhai Chen , Jiangning Zhang , Guanzhong Tian , Haoyang He , Wuhao Zhang , Yabiao Wang , Chengjie Wang , Yong Liu

Zero-shot recognition aims to accurately recognize objects of unseen classes by using a shared visual-semantic mapping between the image feature space and the semantic embedding space. This mapping is learned on training data of seen…

Computer Vision and Pattern Recognition · Computer Science 2017-03-21 Yanan Li , Donghui Wang , Huanhang Hu , Yuetan Lin , Yueting Zhuang

Most existing semantic communication (SemCom) systems use deep joint source-channel coding (DeepJSCC) to encode task-specific semantics in a goal-oriented manner. However, their reliance on predefined tasks and datasets significantly limits…

Signal Processing · Electrical Eng. & Systems 2025-05-30 Jiangjing Hu , Haotian Wu , Wenjing Zhang , Fengyu Wang , Wenjun Xu , Hui Gao , Deniz Gündüz

Zero-shot learning aims at recognizing unseen classes (no training example) with knowledge transferred from seen classes. This is typically achieved by exploiting a semantic feature space shared by both seen and unseen classes, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-01 Jingcai Guo , Song Guo

With the advent of vision-language models (e.g., CLIP) in zero- and few-shot settings, CLIP has been widely applied to zero-shot anomaly detection (ZSAD) in recent research, where the rare classes are essential and expected in many…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Yuhu Bai , Jiangning Zhang , Yunkang Cao , Guangyuan Lu , Qingdong He , Xiangtai Li , Guanzhong Tian

Models that bridge vision and language, such as CLIP, are key components of multimodal AI, yet their large-scale, uncurated training data introduce severe social and spurious biases. Existing post-hoc debiasing methods often operate…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Quentin Guimard , Federico Bartsch , Simone Caldarella , Rahaf Aljundi , Elisa Ricci , Massimiliano Mancini

This paper proposes a novel Zero-Shot Action Recognition~(ZSAR) method based on contrastive learning. In ZSAR, we aim to classify examples from classes that were missing during training. Two well-known problems remain in ZSAR: the semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Valter Estevam , Rayson Laroca , Helio Pedrini , David Menotti