English
Related papers

Related papers: MADPromptS: Unlocking Zero-Shot Morphing Attack De…

200 papers

Backdoor attacks pose a critical threat by embedding hidden triggers into inputs, causing models to misclassify them into target labels. While extensive research has focused on mitigating these attacks in object recognition models through…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Kyle Stein , Andrew Arash Mahyari , Guillermo Francia , Eman El-Sheikh

Contrastive Language-Image Pre-training (CLIP) provides a foundation model by integrating natural language into visual concepts, enabling zero-shot recognition on downstream tasks. It is usually expected that satisfactory overall accuracy…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Jie-Jing Shao , Jiang-Xin Shi , Xiao-Wen Yang , Lan-Zhe Guo , Yu-Feng Li

Large foundation models, known for their strong zero-shot generalization, have excelled in visual and language applications. However, applying them to medical image segmentation, a domain with diverse imaging types and target labels,…

Image and Video Processing · Electrical Eng. & Systems 2024-04-18 Junde Wu , Jiayuan Zhu , Yueming Jin , Min Xu

Multimodal emotion and intent recognition is essential for automated human-computer interaction, It aims to analyze users' speech, text, and visual information to predict their emotions or intent. One of the significant challenges is that…

Artificial Intelligence · Computer Science 2025-07-09 Wei Zhang , Juan Chen , Yanbo J. Wang , En Zhu , Xuan Yang , Yiduo Wang

In this paper, we introduce a novel multimodal camo-perceptive framework (MMCPF) aimed at handling zero-shot Camouflaged Object Detection (COD) by leveraging the powerful capabilities of Multimodal Large Language Models (MLLMs). Recognizing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Lv Tang , Peng-Tao Jiang , Zhihao Shen , Hao Zhang , Jinwei Chen , Bo Li

The fine-grained attribute descriptions can significantly supplement the valuable semantic information for person image, which is vital to the success of person re-identification (ReID) task. However, current ReID algorithms typically…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Yajing Zhai , Yawen Zeng , Zhiyong Huang , Zheng Qin , Xin Jin , Da Cao

We propose Context-Adaptive Multi-Prompt Embedding, a novel approach to enrich semantic representations in vision-language contrastive learning. Unlike standard CLIP-style models that rely on a single text embedding, our method introduces…

Machine Learning · Computer Science 2025-08-07 Dahun Kim , Anelia Angelova

Driven by large-scale contrastive vision-language pre-trained models such as CLIP, recent advancements in the image-text matching task have achieved remarkable success in representation learning. Due to image-level visual-language…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Mengxiao Tian , Xinxiao Wu , Shuo Yang

Current zero-shot anomaly detection (ZSAD) methods show remarkable success in prompting large pre-trained vision-language models to detect anomalies in a target dataset without using any dataset-specific training or demonstration. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Jiawen Zhu , Yew-Soon Ong , Chunhua Shen , Guansong Pang

Zero-shot anomaly detection (ZSAD) often leverages pretrained vision or vision-language models, but many existing methods use prompt learning or complex modeling to fit the data distribution, resulting in high training or inference cost and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Chaoran Xu , Chengkan Lv , Qiyu Chen , Feng Zhang , Zhengtao Zhang

Face anti-spoofing is critical to the security of face recognition systems. Depth supervised learning has been proven as one of the most effective methods for face anti-spoofing. Despite the great success, most previous works still…

Computer Vision and Pattern Recognition · Computer Science 2020-03-19 Zezheng Wang , Zitong Yu , Chenxu Zhao , Xiangyu Zhu , Yunxiao Qin , Qiusheng Zhou , Feng Zhou , Zhen Lei

Thanks to the large pre-trained vision-language models (VLMs) like CLIP, we can craft a zero-shot classifier by "prompt", e.g., the confidence score of an image being "[CLASS]" can be obtained by using the VLM provided similarity measure…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Beier Zhu , Yulei Niu , Yucheng Han , Yue Wu , Hanwang Zhang

The rapid evolution of face manipulation techniques poses a critical challenge for face forgery detection: cross-domain generalization. Conventional methods, which rely on simple classification objectives, often fail to learn…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Jialei Cui , Jianwei Du , Yanzhe Li , Lei Gao , Hui Jiang , Chenfu Bao

Morphing attacks are one of the many threats that are constantly affecting deep face recognition systems. It consists of selecting two faces from different individuals and fusing them into a final image that contains the identity…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Pedro C. Neto , Tiago Gonçalves , Marco Huber , Naser Damer , Ana F. Sequeira , Jaime S. Cardoso

Generalized zero-shot learning aims to recognize both seen and unseen classes with the help of semantic information that is shared among different classes. It inevitably requires consistent visual-semantic alignment. Existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Huajie Jiang , Zhengxian Li , Xiaohan Yu , Yongli Hu , Baocai Yin , Jian Yang , Yuankai Qi

Loop Closure Detection (LCD) has been proved to be extremely useful in global consistent visual Simultaneously Localization and Mapping (SLAM) and appearance-based robot relocalization. Methods exploiting binary features in bag of words…

Computer Vision and Pattern Recognition · Computer Science 2017-03-01 Lei Han , Lu Fang

Large-scale pre-trained models have demonstrated impressive performance in vision and language tasks within open-world scenarios. Due to the lack of comparable pre-trained models for 3D shapes, recent methods utilize language-image…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Dan Song , Xinwei Fu , Ning Liu , Weizhi Nie , Wenhui Li , Lanjun Wang , You Yang , Anan Liu

Recent advances in pre-training vision-language models like CLIP have shown great potential in learning transferable visual representations. Nonetheless, for downstream inference, CLIP-like models suffer from either 1) degraded accuracy and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Feng Wang , Manling Li , Xudong Lin , Hairong Lv , Alexander G. Schwing , Heng Ji

Vision-Language Models (VLMs), such as CLIP, have demonstrated remarkable zero-shot out-of-distribution (OOD) detection capabilities, vital for reliable AI systems. Despite this promising capability, a comprehensive understanding of (1) why…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Yuxiao Lee , Xiaofeng Cao , Wei Ye , Jiangchao Yao , Jingkuan Song , Heng Tao Shen

Large-scale multimodal models have shown excellent performance over a series of tasks powered by the large corpus of paired multimodal training data. Generally, they are always assumed to receive modality-complete inputs. However, this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Lianyu Hu , Tongkai Shi , Wei Feng , Fanhua Shang , Liang Wan