English
Related papers

Related papers: Empowering Morphing Attack Detection using Interpr…

200 papers

Although current prompt learning methods have successfully been designed to effectively reuse the large pre-trained models without fine-tuning their large number of parameters, they still have limitations to be addressed, i.e., without…

Machine Learning · Computer Science 2023-12-05 Zongqian Wu , Yujing Liu , Mengmeng Zhan , Jialie Shen , Ping Hu , Xiaofeng Zhu

Multi-modal (vision-language) models, such as CLIP, are replacing traditional supervised pre-training models (e.g., ImageNet-based pre-training) as the new generation of visual foundation models. These models with robust and aligned…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Fan Liu , Tianshu Zhang , Wenwen Dai , Wenwen Cai , Xiaocong Zhou , Delong Chen

Pre-training image representations from the raw text about images enables zero-shot vision transfer to downstream tasks. Through pre-training on millions of samples collected from the internet, multimodal foundation models, such as CLIP,…

Machine Learning · Computer Science 2024-03-18 Chenguang Wang , Ruoxi Jia , Xin Liu , Dawn Song

Morphed face images have recently become a growing concern for existing face verification systems, as they are relatively easy to generate and can be used to impersonate someone's identity for various malicious purposes. Efficient Morphing…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Marija Ivanovska , Vitomir Štruc

Large pre-trained Vision-Language Models (VLMs) such as CLIP have demonstrated excellent zero-shot generalizability across various downstream tasks. However, recent studies have shown that the inference performance of CLIP can be greatly…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Xin Wang , Kai Chen , Jiaming Zhang , Jingjing Chen , Xingjun Ma

In security systems the risk assessment in the sense of common criteria testing is a very relevant topic; this requires quantifying the attack potential in terms of the expertise of the attacker, his knowledge about the target and access to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Matteo Ferrara , Annalisa Franco , Davide Maltoni , Christoph Busch

With Vision-Language Pre-training (VLP) models demonstrating powerful multimodal interaction capabilities, the application scenarios of neural networks are no longer confined to unimodal domains but have expanded to more complex multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Haonan Zheng , Xinyang Deng , Wen Jiang , Wenrui Li

With the continuous advancement of generative models, face morphing attacks have become a significant challenge for existing face verification systems due to their potential use in identity fraud and other malicious activities. Contemporary…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Marija Ivanovska , Leon Todorov , Naser Damer , Deepak Kumar Jain , Peter Peer , Vitomir Štruc

Morphing attacks have posed a severe threat to Face Recognition System (FRS). Despite the number of advancements reported in recent works, we note serious open issues such as independent benchmarking, generalizability challenges and…

There has been a recent spike in interest in multi-modal Language and Vision problems. On the language side, most of these models primarily focus on English since most multi-modal datasets are monolingual. We try to bridge this gap with a…

Machine Learning · Computer Science 2021-09-17 Pranav Aggarwal , Ritiz Tambi , Ajinkya Kale

Photo search, the task of retrieving images based on textual queries, has witnessed significant advancements with the introduction of CLIP (Contrastive Language-Image Pretraining) model. CLIP leverages a vision-language pre training…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Naresh Kumar Lahajal , Harini S

Face Morphing Attacks pose a threat to the security of identity documents, especially with respect to a subsequent access control process, because it enables both individuals involved to exploit the same document. In this study, face…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Roman Kessler , Kiran Raja , Juan Tapia , Christoph Busch

A face morphing attack image can be verified to multiple identities, making this attack a major vulnerability to processes based on identity verification, such as border checks. Various methods have been proposed to detect face morphing…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Naser Damer , Noemie Spiller , Meiling Fang , Fadi Boutros , Florian Kirchbuchner , Arjan Kuijper

Face recognition systems are widely deployed in high-security applications such as for biometric verification at border controls. Despite their high accuracy on pristine data, it is well-known that digital manipulations, such as face…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Mathias Ibsen , Lázaro J. González-Soler , Christian Rathgeb , Christoph Busch

Multimodal contrastive learning aims to train a general-purpose feature extractor, such as CLIP, on vast amounts of raw, unlabeled paired image-text data. This can greatly benefit various complex downstream tasks, including cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Ziqi Zhou , Shengshan Hu , Minghui Li , Hangtao Zhang , Yechao Zhang , Hai Jin

Recent advancements in multimodal foundation models (e.g., CLIP) have excelled in zero-shot generalization. Prompt tuning involved in the knowledge transfer from foundation models to downstream tasks has gained significant attention…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Xuejing Liu , Wei Tang , Jinghui Lu , Rui Zhao , Zhaojun Guo , Fei Tan

Pretrained vision-language models (VLMs) like CLIP exhibit exceptional generalization across diverse downstream tasks. While recent studies reveal their vulnerability to adversarial attacks, research to date has primarily focused on…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Wanqi Zhou , Shuanghao Bai , Danilo P. Mandic , Qibin Zhao , Badong Chen

Recognizing characters and predicting speakers of dialogue are critical for comic processing tasks, such as voice generation or translation. However, because characters vary by comic title, supervised learning approaches like training…

Multimedia · Computer Science 2024-09-06 Yingxuan Li , Ryota Hinami , Kiyoharu Aizawa , Yusuke Matsui

The vulnerability of Face Recognition System (FRS) to various kind of attacks (both direct and in-direct attacks) and face morphing attacks has received a great interest from the biometric community. The goal of a morphing attack is to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-05 Sushma Venkatesh , Raghavendra Ramachandra , Kiran Raja , Christoph Busch

Existing contrastive language-image pre-training aims to learn a joint representation by matching abundant image-text pairs. However, the number of image-text pairs in medical datasets is usually orders of magnitude smaller than that in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Jiarun Liu , Hong-Yu Zhou , Cheng Li , Weijian Huang , Hao Yang , Yong Liang , Shanshan Wang