English
Related papers

Related papers: Beyond Face Swapping: A Diffusion-Based Digital Hu…

200 papers

The rapid advancement of deep generative models has significantly improved the realism of synthetic media, presenting both opportunities and security challenges. While deepfake technology has valuable applications in entertainment and…

Machine Learning · Computer Science 2025-06-09 Arnesh Batra , Anushk Kumar , Jashn Khemani , Arush Gumber , Arhan Jain , Somil Gupta

Synthetically-generated audios and videos -- so-called deep fakes -- continue to capture the imagination of the computer-graphics and computer-vision communities. At the same time, the democratization of access to technology that can create…

Computer Vision and Pattern Recognition · Computer Science 2021-01-29 Shruti Agarwal , Tarek El-Gaaly , Hany Farid , Ser-Nam Lim

It is increasingly easy to automatically swap faces in images and video or morph two faces into one using generative adversarial networks (GANs). The high quality of the resulted deep-morph raises the question of how vulnerable the current…

Computer Vision and Pattern Recognition · Computer Science 2019-10-07 Pavel Korshunov , Sébastien Marcel

With the rise in manipulated media, deepfake detection has become an imperative task for preserving the authenticity of digital content. In this paper, we present a novel multi-modal audio-video framework designed to concurrently process…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Aaditya Kharel , Manas Paranjape , Aniket Bera

Face swapping technology used to create "Deepfakes" has advanced significantly over the past few years and now enables us to create realistic facial manipulations. Current deep learning algorithms to detect deepfakes have shown promising…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Anubhav Jain , Nasir Memon , Julian Togelius

Diffusion models are known for generating high-quality images, causing serious security concerns. To combat this, most efforts rely on deep neural networks (e.g., CNNs and Transformers), while largely overlooking the potential of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Mengxin Fu , Yuezun Li

Face swapping aims to optimize realistic facial image generation by leveraging the identity of a source face onto a target face while preserving pose, expression, and context. However, existing methods, especially GAN-based methods, often…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Md Shohel Rana , Tanoy Debnath

The rapid development of Deepfake technology poses severe challenges to social trust and information security. While most existing detection methods primarily rely on passive analyses, due to unresolvable high-quality Deepfake contents,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xiao Zhang , Changfang Chen , Tianyi Wang

Diffusion probabilistic models (DPMs) have exhibited exceptional proficiency in generating visual media of outstanding quality and realism. Nonetheless, their potential in non-generative domains, such as face recognition, has yet to be…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Bowen Sun , Shibao Zheng

A robust face recognition model must be trained using datasets that include a large number of subjects and numerous samples per subject under varying conditions (such as pose, expression, age, noise, and occlusion). Due to ethical and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Bernardo Biesseck , Pedro Vidal , Luiz Coelho , Roger Granada , David Menotti|

Despite promising progress in face swapping task, realistic swapped images remain elusive, often marred by artifacts, particularly in scenarios involving high pose variation, color differences, and occlusion. To address these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Sanoojan Baliah , Qinliang Lin , Shengcai Liao , Xiaodan Liang , Muhammad Haris Khan

Media forensics has attracted a lot of attention in the last years in part due to the increasing concerns around DeepFakes. Since the initial DeepFake databases from the 1st generation such as UADFV and FaceForensics++ up to the latest…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Ruben Tolosana , Sergio Romero-Tapiador , Julian Fierrez , Ruben Vera-Rodriguez

In the digital age, the emergence of deepfakes and synthetic media presents a significant threat to societal and political integrity. Deepfakes based on multi-modal manipulation, such as audio-visual, are more realistic and pose a greater…

Sound · Computer Science 2024-08-08 Vinaya Sree Katamneni , Ajita Rattani

Deepfakes are increasingly realistic and easy to produce, raising concerns about the reliability of human judgments in misinformation settings. We study audiovisual deepfake detection by measuring how consistently crowd workers distinguish…

Information Retrieval · Computer Science 2026-05-07 Michael Soprano , Andrea Cioci , Stefano Mizzaro

Over the last few decades, many aspects of human life have been enhanced with virtual domains, from the advent of digital assistants such as Amazon's Alexa and Apple's Siri to the latest metaverse efforts of the rebranded Meta. These trends…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Siddarth Ravichandran , Ondřej Texler , Dimitar Dinev , Hyun Jae Kang

The rapid advancement in deep learning makes the differentiation of authentic and manipulated facial images and video clips unprecedentedly harder. The underlying technology of manipulating facial appearances through deep generative…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Sm Zobaed , Md Fazle Rabby , Md Istiaq Hossain , Ekram Hossain , Sazib Hasan , Asif Karim , Khan Md. Hasib

Face anti-spoofing (FAS) plays a vital role in preventing face recognition (FR) systems from presentation attacks. Nowadays, FAS systems face the challenge of domain shift, impacting the generalization performance of existing FAS methods.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Xinxu Ge , Xin Liu , Zitong Yu , Jingang Shi , Chun Qi , Jie Li , Heikki Kälviäinen

With rapid advancements in generative modeling, deepfake techniques are increasingly narrowing the gap between real and synthetic videos, raising serious privacy and security concerns. Beyond traditional face swapping and reenactment, an…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Tharun Anand , Siva Sankar Sajeev , Pravin Nair

Deepfakes are computationally-created entities that falsely represent reality. They can take image, video, and audio modalities, and pose a threat to many areas of systems and societies, comprising a topic of interest to various aspects of…

Human-Computer Interaction · Computer Science 2023-05-26 Sergi D. Bray , Shane D. Johnson , Bennett Kleinberg

Deep generative models have recently achieved impressive results for many real-world applications, successfully generating high-resolution and diverse samples from complex datasets. Due to this improvement, fake digital contents have…

Machine Learning · Computer Science 2020-03-05 Ricard Durall , Margret Keuper , Franz-Josef Pfreundt , Janis Keuper