English
Related papers

Related papers: Detecting Localized Deepfakes: How Well Do Synthet…

200 papers

Deepfake detection models have achieved high accuracy in identifying synthetic media, but their decision processes remain largely opaque. In this paper we present a mechanistic interpretability framework for deepfake detection applied to a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Subramanyam Sahoo , Jared Junkin

The key challenge of image manipulation detection is how to learn generalizable features that are sensitive to manipulations in novel data, whilst specific to prevent false alarms on authentic images. Current research emphasizes the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Xinru Chen , Chengbo Dong , Jiaqi Ji , Juan Cao , Xirong Li

The free access to large-scale public databases, together with the fast progress of deep learning techniques, in particular Generative Adversarial Networks, have led to the generation of very realistic fake content with its corresponding…

Computer Vision and Pattern Recognition · Computer Science 2020-06-22 Ruben Tolosana , Ruben Vera-Rodriguez , Julian Fierrez , Aythami Morales , Javier Ortega-Garcia

The evolution of artificial intelligence (AI) has catalyzed a transformation in digital content generation, with profound implications for cyber influence operations. This report delves into the potential and limitations of generative deep…

Computers and Society · Computer Science 2024-03-20 Melanie Mathys , Marco Willi , Michael Graber , Raphael Meier

Manipulated videos, especially those where the identity of an individual has been modified using deep neural networks, are becoming an increasingly relevant threat in the modern day. In this paper, we seek to develop a generalizable,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-23 Steven Schwarcz , Rama Chellappa

Generative AI models have substantially improved the realism of synthetic media, yet their misuse through sophisticated DeepFakes poses significant risks. Despite recent advances in deepfake detection, fairness remains inadequately…

Machine Learning · Computer Science 2025-07-31 Aryana Hou , Li Lin , Justin Li , Shu Hu

Training deep CNNs to capture localized image artifacts on a relatively small dataset is a challenging task. With enough images at hand, one can hope that a deep CNN characterizes localized artifacts over the entire data and their effect on…

Computer Vision and Pattern Recognition · Computer Science 2017-11-15 Parag Shridhar Chandakkar , Baoxin Li

It is well known that deep learning approaches to face recognition and facial landmark detection suffer from biases in modern training datasets. In this work, we propose to use synthetic face images to reduce the negative effects of dataset…

Computer Vision and Pattern Recognition · Computer Science 2019-06-25 Adam Kortylewski , Bernhard Egger , Andreas Morel-Forster , Andreas Schneider , Thomas Gerig , Clemens Blumer , Corius Reyneke , Thomas Vetter

Face swapping technology used to create "Deepfakes" has advanced significantly over the past few years and now enables us to create realistic facial manipulations. Current deep learning algorithms to detect deepfakes have shown promising…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Anubhav Jain , Nasir Memon , Julian Togelius

Manipulating images of complex scenes to reconstruct, insert and/or remove specific object instances is a challenging task. Complex scenes contain multiple semantics and objects, which are frequently cluttered or ambiguous, thus hampering…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Pierfrancesco Ardino , Yahui Liu , Elisa Ricci , Bruno Lepri , Marco De Nadai

Image forensics, aiming to ensure the authenticity of the image, has made great progress in dealing with common image manipulation such as copy-move, splicing, and inpainting in the past decades. However, only a few researchers pay…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Yushu Zhang , Nuo Chen , Shuren Qi , Mingfu Xue , Xiaochun Cao

The rapid advancement of generative models, such as GANs and Diffusion models, has enabled the creation of highly realistic synthetic images, raising serious concerns about misinformation, deepfakes, and copyright infringement. Although…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Ziqiang Li , Jiazhen Yan , Ziwen He , Kai Zeng , Weiwei Jiang , Lizhi Xiong , Zhangjie Fu

Digital image manipulation has become increasingly accessible and realistic with the advent of generative AI technologies. Recent developments allow for text-guided inpainting, making sophisticated image edits possible with minimal effort.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Hannes Mareen , Dimitrios Karageorgiou , Glenn Van Wallendael , Peter Lambert , Symeon Papadopoulos

The increasing popularity of facial manipulation (Deepfakes) and synthetic face creation raises the need to develop robust forgery detection solutions. Crucially, most work in this domain assume that the Deepfakes in the test set come from…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Amir Jevnisek , Shai Avidan

Photorealistic image generation has reached a new level of quality due to the breakthroughs of generative adversarial networks (GANs). Yet, the dark side of such deepfakes, the malicious use of generated media, raises concerns about visual…

Cryptography and Security · Computer Science 2022-03-21 Ning Yu , Vladislav Skripniuk , Sahar Abdelnabi , Mario Fritz

Deep learning has been successfully applied to solve various complex problems ranging from big data analytics to computer vision and human-level control. Deep learning advances however have also been employed to create software that can…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Thanh Thi Nguyen , Quoc Viet Hung Nguyen , Dung Tien Nguyen , Duc Thanh Nguyen , Thien Huynh-The , Saeid Nahavandi , Thanh Tam Nguyen , Quoc-Viet Pham , Cuong M. Nguyen

In the world of fake news and deepfakes, there have been an alarmingly large number of cases of images being tampered with and published in newspapers, used in court, and posted on social media for defamation purposes. Detecting these…

Computer Vision and Pattern Recognition · Computer Science 2022-02-10 Aditya Pandey , Anshuman Mitra

The creation of altered and manipulated faces has become more common due to the improvement of DeepFake generation methods. Simultaneously, we have seen detection models' development for differentiating between a manipulated and original…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Sowmen Das , Selim Seferbekov , Arup Datta , Md. Saiful Islam , Md. Ruhul Amin

Following the recent initiatives for the democratization of AI, deep fake generators have become increasingly popular and accessible, causing dystopian scenarios towards social erosion of trust. A particular domain, such as biological…

Computer Vision and Pattern Recognition · Computer Science 2021-05-21 Ilke Demir , Umur A. Ciftci

Conspicuous progression in the field of machine learning and deep learning have led the jump of highly realistic fake media, these media oftentimes referred as deepfakes. Deepfakes are fabricated media which are generated by sophisticated…

Machine Learning · Computer Science 2023-04-05 Aniruddha Tiwari , Rushit Dave , Mounika Vanamala