English
Related papers

Related papers: Towards Generalizable Deepfake Detection with Loca…

200 papers

A big mystery in deep learning continues to be the ability of methods to generalize when the number of model parameters is larger than the number of training examples. In this work, we take a step towards a better understanding of the…

Machine Learning · Computer Science 2021-11-25 Romain Cosentino , Randall Balestriero , Richard Baraniuk , Behnaam Aazhang

Existing deepfake detection methods have reported promising in-distribution results, by accessing published large-scale dataset. However, due to the non-smooth synthesis method, the fake samples in this dataset may expose obvious artifacts…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Xinwei Sun , Botong Wu , Wei Chen

Recent advances in representation learning have successfully leveraged the underlying domain-specific structure of data across various fields. However, representing diverse and complex entities stored in tabular format within a latent space…

Machine Learning · Computer Science 2025-02-05 Jan Henrik Bertrand , David B. Hoffmann , Jacopo Pio Gargano , Laurent Mombaerts , Jonathan Taws

Deepfakes are computationally-created entities that falsely represent reality. They can take image, video, and audio modalities, and pose a threat to many areas of systems and societies, comprising a topic of interest to various aspects of…

Human-Computer Interaction · Computer Science 2023-05-26 Sergi D. Bray , Shane D. Johnson , Bennett Kleinberg

The rapid evolution of deepfake generation technologies poses critical challenges for detection systems, as non-continual learning methods demand frequent and expensive retraining. We reframe deepfake detection (DFD) as a Continual Learning…

Machine Learning · Computer Science 2025-09-11 Federico Fontana , Anxhelo Diko , Romeo Lanzino , Marco Raoul Marini , Bachir Kaddar , Gian Luca Foresti , Luigi Cinque

This paper reviews the state-of-the-art in deepfake generation and detection, focusing on modern deep learning technologies and tools based on the latest scientific advancements. The rise of deepfakes, leveraging techniques like Variational…

Cryptography and Security · Computer Science 2025-01-14 Arash Dehghani , Hossein Saberi

Recent advances in deep generative models have made it easier to manipulate face videos, raising significant concerns about their potential misuse for fraud and misinformation. Existing detectors often perform well in in-domain scenarios…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Yinqi Cai , Jichang Li , Zhaolun Li , Weikai Chen , Rushi Lan , Xi Xie , Xiaonan Luo , Guanbin Li

Deepfake is a deep learning-based technique that makes it easy to change or modify images and videos. In investigations and court, visual evidence is commonly employed, but these pieces of evidence may now be suspect due to technological…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Kundan Patil , Shrushti Kale , Jaivanti Dhokey , Abhishek Gulhane

In this paper, we propose to utilize Automated Machine Learning to adaptively search a neural architecture for deepfake detection. This is the first time to employ automated machine learning for deepfake detection. Based on our explored…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Ping Liu , Yuewei Lin , Yang He , Yunchao Wei , Liangli Zhen , Joey Tianyi Zhou , Rick Siow Mong Goh , Jingen Liu

Deepfakes are computer manipulated videos where the face of an individual has been replaced with that of another. Software for creating such forgeries is easy to use and ever more popular, causing serious threats to personal reputation and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Samuele Pino , Mark James Carman , Paolo Bestagini

The rapid advancement of deepfake and face swap technologies has raised significant concerns in digital security, particularly in identity verification and onboarding processes. Conventional detection methods often struggle to generalize…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Alejandro Hinke-Navarro , Mario Nieto-Hidalgo , Juan M. Espin , Juan E. Tapia

The ever-increasing use of synthetically generated content in different sectors of our everyday life, one for all media information, poses a strong need for deepfake detection tools in order to avoid the proliferation of altered messages.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Andrea Ciamarra , Roberto Caldelli , Federico Becattini , Lorenzo Seidenari , Alberto Del Bimbo

The generalization of Fake Audio Detection (FAD) is critical due to the emergence of new spoofing techniques. Traditional FAD methods often focus solely on distinguishing between genuine and known spoofed audio. We propose a Genuine-Focused…

Localizing partial deepfake audio, where only segments of speech are manipulated, remains challenging due to the subtle and scattered nature of these modifications. Existing approaches typically rely on frame-level predictions to identify…

Sound · Computer Science 2026-01-30 Yuchen Mao , Wen Huang , Yanmin Qian

Deepfake detectors face growing challenges in generalization as new image synthesis techniques emerge. In particular, deepfakes generated by diffusion models are highly photorealistic and often evade detectors trained on GAN-based…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Hongyuan Qi , Wenjin Hou , Hehe Fan , Jun Xiao

Increasingly many real world tasks involve data in multiple modalities or views. This has motivated the development of many effective algorithms for learning a common latent space to relate multiple domains. However, most existing…

Computer Vision and Pattern Recognition · Computer Science 2017-11-17 Tanmoy Mukherjee , Makoto Yamada , Timothy M. Hospedales

Recent advances in face forgery techniques produce nearly visually untraceable deepfake videos, which could be leveraged with malicious intentions. As a result, researchers have been devoted to deepfake detection. Previous studies have…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Jiazhi Guan , Hang Zhou , Zhibin Hong , Errui Ding , Jingdong Wang , Chengbin Quan , Youjian Zhao

Visual generative models (e.g., diffusion models) typically operate in compressed latent spaces to balance training efficiency and sample quality. In parallel, there has been growing interest in leveraging high-quality pre-trained visual…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Yuan Gao , Chen Chen , Tianrong Chen , Jiatao Gu

This paper tackles the challenge of detecting partially manipulated facial deepfakes, which involve subtle alterations to specific facial features while retaining the overall context, posing a greater detection difficulty than fully…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Andrii Yermakov , Jan Cech , Jiri Matas

A deepfake is a photo or video of a person whose image has been digitally altered or partially replaced with an image of someone else. Deepfakes have the potential to cause a variety of problems and are often used maliciously. A common…

Artificial Intelligence · Computer Science 2024-09-01 Natalie Krueger , Mounika Vanamala , Rushit Dave