English
Related papers

Related papers: Next-Frame Feature Prediction for Multimodal Deepf…

200 papers

We present a novel approach for the detection of deepfake videos using a pair of vision transformers pre-trained by a self-supervised masked autoencoding setup. Our method consists of two distinct components, one of which focuses on…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Sayantan Das , Mojtaba Kolahdouzi , Levent Özparlak , Will Hickie , Ali Etemad

The growing diversity of digital face manipulation techniques has led to an urgent need for a universal and robust detection technology to mitigate the risks posed by malicious forgeries. We present a blended-based detection approach that…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Yuyang Sun , Huy H. Nguyen , Chun-Shien Lu , ZhiYong Zhang , Lu Sun , Isao Echizen

Detecting AI-generated images, particularly deepfakes, has become increasingly crucial, with the primary challenge being the generalization to previously unseen manipulation methods. This paper tackles this issue by leveraging the forgery…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Wentang Song , Zhiyuan Yan , Yuzhen Lin , Taiping Yao , Changsheng Chen , Shen Chen , Yandan Zhao , Shouhong Ding , Bin Li

Recent advances in content generation technologies (widely known as DeepFakes) along with the online proliferation of manipulated media content render the detection of such manipulations a task of increasing importance. Even though there…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Polychronis Charitidis , Giorgos Kordopatis-Zilos , Symeon Papadopoulos , Ioannis Kompatsiaris

Audio-visual temporal deepfake localization under the content-driven partial manipulation remains a highly challenging task. In this scenario, the deepfake regions are usually only spanning a few frames, with the majority of the rest…

Multi-frame methods improve monocular depth estimation over single-frame approaches by aggregating spatial-temporal information via feature matching. However, the spatial-temporal feature leads to accuracy degradation in dynamic scenes. To…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Jiquan Zhong , Xiaolin Huang , Xiao Yu

Previous deepfake detection methods mostly depend on low-level textural features vulnerable to perturbations and fall short of detecting unseen forgery methods. In contrast, high-level semantic features are less susceptible to perturbations…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Ziyuan Fang , Hanqing Zhao , Tianyi Wei , Wenbo Zhou , Ming Wan , Zhanyi Wang , Weiming Zhang , Nenghai Yu

A major challenge in DeepFake forgery detection is that state-of-the-art algorithms are mostly trained to detect a specific fake method. As a result, these approaches show poor generalization across different types of facial manipulations,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Davide Cozzolino , Andreas Rössler , Justus Thies , Matthias Nießner , Luisa Verdoliva

Deepfakes are AI-generated media in which an image or video has been digitally modified. The advancements made in deepfake technology have led to privacy and security issues. Most deepfake detection techniques rely on the detection of a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Sneha Muppalla , Shan Jia , Siwei Lyu

Deepfakes is a branch of malicious techniques that transplant a target face to the original one in videos, resulting in serious problems such as infringement of copyright, confusion of information, or even public panic. Previous efforts for…

Computer Vision and Pattern Recognition · Computer Science 2021-04-12 Zekun Sun , Yujie Han , Zeyu Hua , Na Ruan , Weijia Jia

The rapid evolution of deep generative models poses a critical challenge to deepfake detection, as detectors trained on forgery-specific artifacts often suffer significant performance degradation when encountering unseen forgeries. While…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Mengyu Qiao , Runze Tian , Yang Wang

We introduce a deepfake video detection approach that exploits pixel-wise temporal inconsistencies, which traditional spatial frequency-based detectors often overlook. Traditional detectors represent temporal information merely by stacking…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Taehoon Kim , Jongwook Choi , Yonghyun Jeong , Haeun Noh , Jaejun Yoo , Seungryul Baek , Jongwon Choi

Due to the development of facial manipulation techniques in recent years deepfake detection in video stream became an important problem for face biometrics, brand monitoring or online video conferencing solutions. In case of a biometric…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Kirill Vyshegorodtsev , Dmitry Kudiyarov , Alexander Balashov , Alexander Kuzmin

Deep Learning has been successfully applied in diverse fields, and its impact on deepfake detection is no exception. Deepfakes are fake yet realistic synthetic content that can be used deceitfully for political impersonation, phishing,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Ammarah Hashmi , Sahibzada Adil Shahzad , Chia-Wen Lin , Yu Tsao , Hsin-Min Wang

Deepfake detection methods have shown promising results in recognizing forgeries within a given dataset, where training and testing take place on the in-distribution dataset. However, their performance deteriorates significantly when…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Aminollah Khormali , Jiann-Shiun Yuan

Recent advances in deep learning have significantly improved performance of video prediction. However, state-of-the-art methods still suffer from blurriness and distortions in their future predictions, especially when there are large…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Osamu Shouno

Deepfakes are AI-synthesized multimedia data that may be abused for spreading misinformation. Deepfake generation involves both visual and audio manipulation. To detect audio-visual deepfakes, previous studies commonly employ two relatively…

Sound · Computer Science 2025-06-10 Kuiyuan Zhang , Wenjie Pei , Rushi Lan , Yifang Guo , Zhongyun Hua

We propose PhaseForensics, a DeepFake (DF) video detection method that leverages a phase-based motion representation of facial temporal dynamics. Existing methods relying on temporal inconsistencies for DF detection present many advantages…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Ekta Prashnani , Michael Goebel , B. S. Manjunath

This paper addresses the challenge of developing a robust audio-visual deepfake detection model. In practical use cases, new generation algorithms are continually emerging, and these algorithms are not encountered during the development of…

Sound · Computer Science 2024-08-20 Kyungbok Lee , You Zhang , Zhiyao Duan

Deep learning has enabled realistic face manipulation (i.e., deepfake), which poses significant concerns over the integrity of the media in circulation. Most existing deep learning techniques for deepfake detection can achieve promising…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Bosheng Yan , Chang-Tsun Li , Xuequan Lu