English
Related papers

Related papers: Interpretable Face Anti-Spoofing: Enhancing Genera…

200 papers

To minimize the impact of age variation on face recognition, age-invariant face recognition (AIFR) extracts identity-related discriminative features by minimizing the correlation between identity- and age-related features while face age…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Zhizhong Huang , Junping Zhang , Hongming Shan

In this work we focus on learning facial representations that can be adapted to train effective face recognition models, particularly in the absence of labels. Firstly, compared with existing labelled face datasets, a vastly larger…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Zhonglin Sun , Chen Feng , Ioannis Patras , Georgios Tzimiropoulos

Face spoofing causes severe security threats in face recognition systems. Previous anti-spoofing works focused on supervised techniques, typically with either binary or auxiliary supervision. Most of them suffer from limited robustness and…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Chengwei Chen , Wang Yuan , Xuequan Lu , Lizhuang Ma

In the domain of scientific imaging, interpreting visual data often demands an intricate combination of human expertise and deep comprehension of the subject materials. This study presents a novel methodology to linguistically emulate and…

Machine Learning · Computer Science 2023-09-27 Abdulelah S. Alshehri , Franklin L. Lee , Shihu Wang

Face Recognition (FR) systems are being used in a variety of applications, including road crossings, banking, and mobile banking. The widespread use of FR systems has raised concerns about the safety of face biometrics against spoofing…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Soham S. Sarpotdar

Having revolutionized natural language processing (NLP) applications, large language models (LLMs) are expanding into the realm of multimodal inputs. Owing to their ability to interpret images, multimodal LLMs (MLLMs) have been primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Jusung Lee , Sungguk Cha , Younghyun Lee , Cheoljong Yang

Multimodal foundation models have significantly improved feature representation by integrating information from multiple modalities, making them highly suitable for a broader set of applications. However, the exploration of multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Kaiwen Zheng , Xuri Ge , Junchen Fu , Jun Peng , Joemon M. Jose

Face anti-spoofing techniques based on domain generalization have recently been studied widely. Adversarial learning and meta-learning techniques have been adopted to learn domain-invariant representations. However, prior approaches often…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Jingyi Yang , Zitong Yu , Xiuming Ni , Jia He , Hui Li

Face recognition has been widely studied due to its importance in different applications; however, most of the proposed methods fail when face images are occluded or captured under illumination and pose variations. Recently several low-rank…

Computer Vision and Pattern Recognition · Computer Science 2017-03-16 Homa Foroughi , Moein Shakeri , Nilanjan Ray , Hong Zhang

Large vision-language models (LVLMs) have demonstrated remarkable achievements, yet the generation of non-factual responses remains prevalent in fact-seeking question answering (QA). Current multimodal fact-seeking benchmarks primarily…

Computation and Language · Computer Science 2025-03-11 Yanling Wang , Yihan Zhao , Xiaodong Chen , Shasha Guo , Lixin Liu , Haoyang Li , Yong Xiao , Jing Zhang , Qi Li , Ke Xu

Recent advancements in Vision-Language Models (VLMs) have enabled complex multimodal tasks by processing text and image data simultaneously, significantly enhancing the field of artificial intelligence. However, these models often exhibit…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Hoin Jung , Taeuk Jang , Xiaoqian Wang

Multimodal Large Language Models (MLLMs) excel in vision-language tasks such as image captioning but remain prone to object hallucinations, where they describe objects that do not appear in the image. To mitigate this, we propose LISA, a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Zhihui Guo , Xin Man , Hui Xu , Jie Shao , Zhiguo Jiang , Xianchao Zhang , Heng Tao Shen

We introduce Language Feedback Models (LFMs) that identify desirable behaviour - actions that help achieve tasks specified in the instruction - for imitation learning in instruction following. To train LFMs, we obtain feedback from Large…

Machine Learning · Computer Science 2024-10-11 Victor Zhong , Dipendra Misra , Xingdi Yuan , Marc-Alexandre Côté

Large multimodal models demonstrate remarkable generalist ability to perform diverse multimodal tasks in a zero-shot manner. Large-scale web-based image-text pairs contribute fundamentally to this success, but suffer from excessive noise.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Qiying Yu , Quan Sun , Xiaosong Zhang , Yufeng Cui , Fan Zhang , Yue Cao , Xinlong Wang , Jingjing Liu

Multimodal Large Language Models (MLLMs), such as GPT4o, have shown strong capabilities in visual reasoning and explanation generation. However, despite these strengths, they face significant challenges in the increasingly critical task of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Fanrui Zhang , Jiawei Liu , Jiaying Zhu , Esther Sun , Dong Li , Qiang Zhang , Zheng-Jun Zha

Figures of speech such as metaphors, similes, and idioms are integral parts of human communication. They are ubiquitous in many forms of discourse, allowing people to convey complex, abstract ideas and evoke emotion. As figurative forms are…

Computation and Language · Computer Science 2023-11-28 Ron Yosef , Yonatan Bitton , Dafna Shahaf

In recent years, the multimedia forensics and security community has seen remarkable progress in multitask learning for DeepFake (i.e., face forgery) detection. The prevailing approach has been to frame DeepFake detection as a binary…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Mian Zou , Baosheng Yu , Yibing Zhan , Siwei Lyu , Kede Ma

Face manipulation techniques have achieved significant advances, presenting serious challenges to security and social trust. Recent works demonstrate that leveraging multimodal models can enhance the generalization and interpretability of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Ke Sun , Shen Chen , Taiping Yao , Ziyin Zhou , Jiayi Ji , Xiaoshuai Sun , Chia-Wen Lin , Rongrong Ji

Although face anti-spoofing (FAS) methods have achieved remarkable performance on specific domains or attack types, few studies have focused on the simultaneous presence of domain changes and unknown attacks, which is closer to real…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Zong-Wei Hong , Yu-Chen Lin , Hsuan-Tung Liu , Yi-Ren Yeh , Chu-Song Chen

While Vision-Language Models (VLMs) and Multimodal Large Language Models (MLLMs) have shown strong generalisation in detecting image and video deepfakes, their use for audio deepfake detection remains largely unexplored. In this work, we…

Sound · Computer Science 2026-01-05 Akanksha Chuchra , Shukesh Reddy , Sudeepta Mishra , Abhijit Das , Abhinav Dhall