English
Related papers

Related papers: Training-Free Multimodal Deepfake Detection via Gr…

200 papers

Recent advances in image generation have led to the widespread availability of highly realistic synthetic media, increasing the difficulty of reliable deepfake detection. A key challenge is generalization, as detectors trained on a narrow…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Yichen Jiang , Mohammed Talha Alam , Sohail Ahmed Khan , Duc-Tien Dang-Nguyen , Fakhri Karray

Recent studies have utilized visual large language models (VLMs) to answer not only "Is this face a forgery?" but also "Why is the face a forgery?" These studies introduced forgery-related attributes, such as forgery location and type, to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Tao Chen , Jingyi Zhang , Decheng Liu , Chunlei Peng

This paper proposes X2-DFD, an eXplainable and eXtendable framework based on multimodal large-language models (MLLMs) for deepfake detection, consisting of three key stages. The first stage, Model Feature Assessment, systematically…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Yize Chen , Zhiyuan Yan , Guangliang Cheng , Kangran Zhao , Siwei Lyu , Baoyuan Wu

Multimodal Large Language Models (MLLMs), such as GPT4o, have shown strong capabilities in visual reasoning and explanation generation. However, despite these strengths, they face significant challenges in the increasingly critical task of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Fanrui Zhang , Jiawei Liu , Jiaying Zhu , Esther Sun , Dong Li , Qiang Zhang , Zheng-Jun Zha

Deep generative models can create remarkably photorealistic fake images while raising concerns about misinformation and copyright infringement, known as deepfake threats. Deepfake detection technique is developed to distinguish between real…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 You-Ming Chang , Chen Yeh , Wei-Chen Chiu , Ning Yu

Most prior deepfake detection methods lack explainable outputs. With the growing interest in multimodal large language models (MLLMs), researchers have started exploring their use in interpretable deepfake detection. However, a major…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Ning Jiang , Dingheng Zeng , Yanhong Liu , Haiyang Yi , Shijie Yu , Minghe Weng , Haifeng Shen , Ying Li

Deepfake detection is a widely researched topic that is crucial for combating the spread of malicious content, with existing methods mainly modeling the problem as classification or spatial localization. The rapid advancements in generative…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Wenbo Xu , Wei Lu , Xiangyang Luo , Jiantao Zhou

The recent advancements in Generative Adversarial Networks (GANs) and the emergence of Diffusion models have significantly streamlined the production of highly realistic and widely accessible synthetic content. As a result, there is a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Sohail Ahmed Khan , Duc-Tien Dang-Nguyen

Although Large Language Models (LLMs) excel in reasoning and generation for language tasks, they are not specifically designed for multimodal challenges. Training Multimodal Large Language Models (MLLMs), however, is resource-intensive and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Yuqi Pang , Bowen Yang , Haoqin Tu , Yun Cao , Zeyu Zhang

Large Language Models (LLMs) have demonstrated substantial efficacy in advancing graph-structured data analysis. Prevailing LLM-based graph methods excel in adapting LLMs to text-rich graphs, wherein node attributes are text descriptions.…

Artificial Intelligence · Computer Science 2025-06-04 Dongzhe Fan , Yi Fang , Jiajin Liu , Djellel Difallah , Qiaoyu Tan

The rapid development of generative AI is a double-edged sword, which not only facilitates content creation but also makes image manipulation easier and more difficult to detect. Although current image forgery detection and localization…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Zhipei Xu , Xuanyu Zhang , Runyi Li , Zecheng Tang , Qing Huang , Jian Zhang

Multimodal Large Language Models (MLLMs), built on powerful language backbones, have enabled Multimodal In-Context Learning (MICL)-adapting to new tasks from a few multimodal demonstrations consisting of images, questions, and answers.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Shuo Chen , Jianzhe Liu , Zhen Han , Yan Xia , Daniel Cremers , Philip Torr , Volker Tresp , Jindong Gu

Audio-visual deepfake detection (AVD) is increasingly important as modern generators can fabricate convincing speech and video. Most current multimodal detectors are small, task-specific models: they work well on curated tests but scale…

Sound · Computer Science 2026-03-02 Songjun Cao , Yuqi Li , Yunpeng Luo , Jianjun Yin , Long Ma

Image Deepfake Detection (IDD) separates manipulated images from authentic ones by spotting artifacts of synthesis or tampering. Although large vision-language models (LVLMs) offer strong image understanding, adapting them to IDD often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Yuxin Liu , Fei Wang , Kun Li , Yiqi Nie , Junjie Chen , Zhangling Duan , Zhaohong Jia

Face anti-spoofing (FAS) is crucial for protecting facial recognition systems from presentation attacks. Previous methods approached this task as a classification problem, lacking interpretability and reasoning behind the predicted results.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Hongyang Wang , Yichen Shi , Zhuofu Tao , Yuhao Gao , Liepiao Zhang , Xun Lin , Jun Feng , Xiaochen Yuan , Zitong Yu , Xiaochun Cao

Multimodal large language models have unlocked new possibilities for various multimodal tasks. However, their potential in image manipulation detection remains unexplored. When directly applied to the IMD task, M-LLMs often produce…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Zhihao Sun , Haoran Jiang , Haoran Chen , Yixin Cao , Xipeng Qiu , Zuxuan Wu , Yu-Gang Jiang

The rapid advancement of generative adversarial networks (GANs) and diffusion models has enabled the creation of highly realistic deepfake content, posing significant threats to digital trust across audio-visual domains. While unimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Chende Zheng , Ruiqi Suo , Zhoulin Ji , Jingyi Deng , Fangbin Yi , Chenhao Lin , Chao Shen

The rapid emergence of multimodal deepfakes (visual and auditory content are manipulated in concert) undermines the reliability of existing detectors that rely solely on modality-specific artifacts or cross-modal inconsistencies. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Yuxuan Du , Zhendong Wang , Yuhao Luo , Caiyong Piao , Zhiyuan Yan , Hao Li , Li Yuan

Instruction tuning of large vision-language models (LVLMs) increasingly depends on massive multimodal corpora, yet these datasets contain samples with substantial redundancy, low visual dependency, and highly imbalanced coverage of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Shristi Das Biswas , Kaushik Roy

Audio deepfakes pose a significant security threat, yet current state-of-the-art (SOTA) detection systems do not generalize well to realistic in-the-wild deepfakes. We introduce a novel \textbf{I}n-\textbf{C}ontext \textbf{L}earning…

Sound · Computer Science 2026-04-21 Benjamin Chou , Yi Zhu , Surya Koppisetti