English
Related papers

Related papers: EDVD-LLaMA: Explainable Deepfake Video Detection v…

200 papers

Audio-visual deepfake detection (AVD) is increasingly important as modern generators can fabricate convincing speech and video. Most current multimodal detectors are small, task-specific models: they work well on curated tests but scale…

Sound · Computer Science 2026-03-02 Songjun Cao , Yuqi Li , Yunpeng Luo , Jianjun Yin , Long Ma

Video Question Answering (VideoQA) demands models that jointly reason over spatial, temporal, and linguistic cues. However, the task's inherent complexity often requires multi-step reasoning that current large multimodal models (LMMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Jason Nguyen , Ameet Rao , Alexander Chang , Ishaan Kumar , Erin Tan

Multimodal Large Language Models (MLLMs), such as GPT4o, have shown strong capabilities in visual reasoning and explanation generation. However, despite these strengths, they face significant challenges in the increasingly critical task of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Fanrui Zhang , Jiawei Liu , Jiaying Zhu , Esther Sun , Dong Li , Qiang Zhang , Zheng-Jun Zha

Faces synthesized by diffusion models (DMs) with high-quality and controllable attributes pose a significant challenge for Deepfake detection. Most state-of-the-art detectors only yield a binary decision, incapable of forgery localization,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xinan He , Yue Zhou , Bing Fan , Bin Li , Guopu Zhu , Feng Ding

We present a novel approach for the detection of deepfake videos using a pair of vision transformers pre-trained by a self-supervised masked autoencoding setup. Our method consists of two distinct components, one of which focuses on…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Sayantan Das , Mojtaba Kolahdouzi , Levent Özparlak , Will Hickie , Ali Etemad

Advances in generative models have led to AI-generated images visually indistinguishable from authentic ones. Despite numerous studies on detecting AI-generated images with classifiers, a gap persists between such methods and human…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Chuangchuang Tan , Jinglu Wang , Xiang Ming , Renshuai Tao , Yunchao Wei , Yao Zhao , Yan Lu

Deepfake detection is a widely researched topic that is crucial for combating the spread of malicious content, with existing methods mainly modeling the problem as classification or spatial localization. The rapid advancements in generative…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Wenbo Xu , Wei Lu , Xiangyang Luo , Jiantao Zhou

Recent studies in Large Vision-Language Models (LVLMs) have demonstrated impressive advancements in multimodal Out-of-Context (OOC) misinformation detection, discerning whether an authentic image is wrongly used in a claim. Despite their…

Machine Learning · Computer Science 2025-02-18 Junjie Wu , Yumeng Fu , Nan Yu , Guohong Fu

The remarkable performance of Multimodal Large Language Models (MLLMs) has unequivocally demonstrated their proficient understanding capabilities in handling a wide array of visual tasks. Nevertheless, the opaque nature of their black-box…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Minghe Gao , Shuang Chen , Liang Pang , Yuan Yao , Jisheng Dang , Wenqiao Zhang , Juncheng Li , Siliang Tang , Yueting Zhuang , Tat-Seng Chua

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in multimodal task reasoning. However, they often generate responses that appear plausible yet do not accurately reflect the visual content, a phenomenon known…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Jiaqi Wang , Yifei Gao , Jitao Sang

The rapid advancement of deepfake technologies has sparked widespread public concern, particularly as face forgery poses a serious threat to public information security. However, the unknown and diverse forgery techniques, varied facial…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Zhengchao Huang , Bin Xia , Zicheng Lin , Zhun Mou , Wenming Yang , Jiaya Jia

The goal of this work is to enhance balanced multimodal understanding in audio-visual large language models (AV-LLMs) by addressing modality bias without additional training. In current AV-LLMs, audio and video features are typically…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Chaeyoung Jung , Youngjoon Jang , Jongmin Choi , Joon Son Chung

We address multimodal deepfake detection requiring both robustness and interpretability by proposing FakeHunter, a unified framework that combines memory guided retrieval, a structured Observation-Thought-Action reasoning loop, and adaptive…

Multimedia · Computer Science 2025-09-11 Chen Chen , Runze Li , Zejun Zhang , Pukun Zhao , Fanqing Zhou , Longxiang Wang , Haojian Huang

Video understanding represents the most challenging frontier in computer vision, requiring models to reason about complex spatiotemporal relationships, long-term dependencies, and multimodal evidence. The recent emergence of Video-Large…

We introduce TemporalVLM, a video large language model (video LLM) for temporal reasoning and fine-grained understanding in long videos. Our approach includes a visual encoder for mapping a long-term video into features which are time-aware…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Fawad Javed Fateh , Umer Ahmed , Hamza Khan , M. Zeeshan Zia , Quoc-Huy Tran

With the success of large language models (LLMs), integrating the vision model into LLMs to build vision-language foundation models has gained much more interest recently. However, existing LLM-based large multimodal models (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Bo He , Hengduo Li , Young Kyun Jang , Menglin Jia , Xuefei Cao , Ashish Shah , Abhinav Shrivastava , Ser-Nam Lim

Recent advances in deep generative models have made it easier to manipulate face videos, raising significant concerns about their potential misuse for fraud and misinformation. Existing detectors often perform well in in-domain scenarios…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Yinqi Cai , Jichang Li , Zhaolun Li , Weikai Chen , Rushi Lan , Xi Xie , Xiaonan Luo , Guanbin Li

Explaining Deep Learning models is becoming increasingly important in the face of daily emerging multimodal models, particularly in safety-critical domains like medical imaging. However, the lack of detailed investigations into the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Anees Ur Rehman Hashmi , Dwarikanath Mahapatra , Mohammad Yaqub

Video Question Answering (Video QA) is a challenging video understanding task that requires models to comprehend entire videos, identify the most relevant information based on contextual cues from a given question, and reason accurately to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Roberto Amoroso , Gengyuan Zhang , Rajat Koner , Lorenzo Baraldi , Rita Cucchiara , Volker Tresp

Video Large Language Models (VideoLLMs) extend the capabilities of vision-language models to spatiotemporal inputs, enabling tasks such as video question answering (VideoQA). Despite recent advances in VideoLLMs, their internal mechanisms…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Minji Kim , Taekyung Kim , Bohyung Han