English
Related papers

Related papers: FFAA: Multimodal Large Language Model based Explai…

200 papers

Face forgery by deepfake is widely spread over the internet and has raised severe societal concerns. Recently, how to detect such forgery contents has become a hot research topic and many deepfake detection methods have been proposed. Most…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Hanqing Zhao , Wenbo Zhou , Dongdong Chen , Tianyi Wei , Weiming Zhang , Nenghai Yu

Deepfake technology has raised concerns about the authenticity of digital content, necessitating the development of effective detection methods. However, the widespread availability of deepfakes has given rise to a new challenge in the form…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Sarwar Khan

This paper proposes X2-DFD, an eXplainable and eXtendable framework based on multimodal large-language models (MLLMs) for deepfake detection, consisting of three key stages. The first stage, Model Feature Assessment, systematically…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Yize Chen , Zhiyuan Yan , Guangliang Cheng , Kangran Zhao , Siwei Lyu , Baoyuan Wu

Deepfakes have recently raised significant trust issues and security concerns among the public. Compared to CNN face forgery detectors, ViT-based methods take advantage of the expressivity of transformers, achieving superior detection…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Chenqi Kong , Anwei Luo , Peijun Bao , Yi Yu , Haoliang Li , Zengwei Zheng , Shiqi Wang , Alex C. Kot

Explainability and interpretability of AI models is an essential factor affecting the safety of AI. While various explainable AI (XAI) approaches aim at mitigating the lack of transparency in deep networks, the evidence of the effectiveness…

Artificial Intelligence · Computer Science 2020-03-03 Kamran Alipour , Jurgen P. Schulze , Yi Yao , Avi Ziskind , Giedrius Burachas

Visual Question Answering (VQA), as the representative multimodal task, serves as a key benchmark for evaluating the reasoning capabilities of Multimodal Large Language Models (MLLMs). However, existing evaluations largely rely on static…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Quanxing Xu , Yuhao Tian , Ling Zhou , Xian Zhong , Xiaohua Huang , Rubing Huang , Chia-Wen Lin

With the rise in manipulated media, deepfake detection has become an imperative task for preserving the authenticity of digital content. In this paper, we present a novel multi-modal audio-video framework designed to concurrently process…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Aaditya Kharel , Manas Paranjape , Aniket Bera

Face verification remains a challenging problem in very complex conditions with large variations such as pose, illumination, expression, and occlusions. This problem is exacerbated when we rely unrealistically on a single training data…

Computer Vision and Pattern Recognition · Computer Science 2014-12-23 Chaochao Lu , Xiaoou Tang

The rapid advancement of AI technologies has significantly increased the diversity of DeepFake videos circulating online, posing a pressing challenge for \textit{generalizable forensics}, \ie, detecting a wide range of unseen DeepFake types…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Yuezun Li , Delong Zhu , Xinjie Cui , Siwei Lyu

AI based Face Recognition Systems (FRSs) are now widely distributed and deployed as MLaaS solutions all over the world, moreso since the COVID-19 pandemic for tasks ranging from validating individuals' faces while buying SIM cards to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Siddharth D Jaiswal , Ankit Kr. Verma , Animesh Mukherjee

With the increasing prevalence and deployment of Emotion AI-powered facial affect analysis (FAA) tools, concerns about the trustworthiness of these systems have become more prominent. This first workshop on "Towards Trustworthy Facial…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Jiaee Cheong , Yang Liu , Harold Soh , Hatice Gunes

DeepFakes have raised serious societal concerns, leading to a great surge in detection-based forensics methods in recent years. Face forgery recognition is a standard detection method that usually follows a two-phase pipeline. While those…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Cong Zhang , Honggang Qi , Shuhui Wang , Yuezun Li , Siwei Lyu

Face forgery detection is essential in combating malicious digital face attacks. Previous methods mainly rely on prior expert knowledge to capture specific forgery clues, such as noise patterns, blending boundaries, and frequency artifacts.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Anwei Luo , Chenqi Kong , Jiwu Huang , Yongjian Hu , Xiangui Kang , Alex C. Kot

The continuous growth of the e-commerce industry attracts fraudsters who exploit stolen credit card details. Companies often investigate suspicious transactions in order to retain customer trust and address gaps in their fraud detection…

Cryptography and Security · Computer Science 2025-06-16 Shaun Shuster , Eyal Zaloof , Asaf Shabtai , Rami Puzis

Face identity provides a powerful signal for deepfake detection. Prior studies show that even when not explicitly modeled, classifiers often learn identity features implicitly. This has led to conflicting views: some suppress identity cues…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Younghun Kim , Minsuk Jang , Myung-Joon Kwon , Wonjun Lee , Changick Kim

Modern face recognition systems (FRS) still fall short when the subjects are wearing facial masks, a common theme in the age of respiratory pandemics. An intuitive partial remedy is to add a mask detector to flag any masked faces so that…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Jiayi Zhu , Qing Guo , Felix Juefei-Xu , Yihao Huang , Yang Liu , Geguang Pu

Pioneering advancements in artificial intelligence, especially in genAI, have enabled significant possibilities for content creation, but also led to widespread misinformation and false content. The growing sophistication and realism of…

Artificial Intelligence · Computer Science 2024-11-14 Dinesh Srivasthav P , Badri Narayan Subudhi

Deep learning models often face challenges when handling real-world image corruptions. In response, researchers have developed image corruption datasets to evaluate the performance of deep neural networks in handling such corruptions.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Harshitha Machiraju , Michael H. Herzog , Pascal Frossard

Recent advances in AIGC have exacerbated the misuse of malicious deepfake content, making the development of reliable deepfake detection methods an essential means to address this challenge. Although existing deepfake detection models…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Changtao Miao , Yi Zhang , Weize Gao , Zhiya Tan , Weiwei Feng , Man Luo , Jianshu Li , Ajian Liu , Yunfeng Diao , Qi Chu , Tao Gong , Zhe Li , Weibin Yao , Joey Tianyi Zhou

The rapid progress in synthetic image generation and manipulation has now come to a point where it raises significant concerns for the implications towards society. At best, this leads to a loss of trust in digital content, but could…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Andreas Rössler , Davide Cozzolino , Luisa Verdoliva , Christian Riess , Justus Thies , Matthias Nießner