English
Related papers

Related papers: A Multimodal Framework for Deepfake Detection

200 papers

The rapid progress in deep generative models has led to the creation of incredibly realistic synthetic images that are becoming increasingly difficult to distinguish from real-world data. The widespread use of Variational Models, Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Anant Mehta , Bryant McArthur , Nagarjuna Kolloju , Zhengzhong Tu

DeepFake, an AI technology for creating facial forgeries, has garnered global attention. Amid such circumstances, forensics researchers focus on developing defensive algorithms to counter these threats. In contrast, there are techniques…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Bing Fan , Shu Hu , Feng Ding

The recent renaissance in generative models, driven primarily by the advent of diffusion models and iterative improvement in GAN methods, has enabled many creative applications. However, each advancement is also accompanied by a rise in the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Sanjay Saha , Rashindrie Perera , Sachith Seneviratne , Tamasha Malepathirana , Sanka Rasnayaka , Deshani Geethika , Terence Sim , Saman Halgamuge

Deepfakes utilise Artificial Intelligence (AI) techniques to create synthetic media where the likeness of one person is replaced with another. There are growing concerns that deepfakes can be maliciously used to create misleading and…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Nyee Thoang Lim , Meng Yi Kuan , Muxin Pu , Mei Kuan Lim , Chun Yong Chong

The detection and localization of deepfake content, particularly when small fake segments are seamlessly mixed with real videos, remains a significant challenge in the field of digital media security. Based on the recently released…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Zhixi Cai , Abhinav Dhall , Shreya Ghosh , Munawar Hayat , Dimitrios Kollias , Kalin Stefanov , Usman Tariq

Existing methods on audio-visual deepfake detection mainly focus on high-level features for modeling inconsistencies between audio and visual data. As a result, these approaches usually overlook finer audio-visual artifacts, which are…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Marcella Astrid , Enjie Ghorbel , Djamila Aouada

Audio deepfake detection aims to detect real human voices from those generated by Artificial Intelligence (AI) and has emerged as a significant problem in the field of voice biometrics systems. With the ever-improving quality of synthetic…

Sound · Computer Science 2026-05-12 Aishwarya Fursule , Shruti Kshirsagar , Anderson R. Avila

Recent advancements in deep learning generative models have raised concerns as they can create highly convincing counterfeit images and videos. This poses a threat to people's integrity and can lead to social instability. To address this…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Leandro A. Passos , Danilo Jodas , Kelton A. P. da Costa , Luis A. Souza Júnior , Douglas Rodrigues , Javier Del Ser , David Camacho , João Paulo Papa

The rise of AI-driven generative models has enabled the creation of highly realistic speech deepfakes - synthetic audio signals that can imitate target speakers' voices - raising critical security concerns. Existing methods for detecting…

Sound · Computer Science 2025-03-25 Emma Coletta , Davide Salvi , Viola Negroni , Daniele Ugo Leonzio , Paolo Bestagini

Following the recent initiatives for the democratization of AI, deep fake generators have become increasingly popular and accessible, causing dystopian scenarios towards social erosion of trust. A particular domain, such as biological…

Computer Vision and Pattern Recognition · Computer Science 2021-05-21 Ilke Demir , Umur A. Ciftci

While the technologies empowering malicious audio deepfakes have dramatically evolved in recent years due to generative AI advances, the same cannot be said of global research into spoofing (deepfake) countermeasures. This paper highlights…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-16 Héctor Delgado , Giorgio Ramondetti , Emanuele Dalmasso , Gennady Karvitsky , Daniele Colibro , Haydar Talib

The rapid proliferation of AI-generated content, driven by advances in generative adversarial networks, diffusion models, and multimodal large language models, has made the creation and dissemination of synthetic media effortless,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Guangyu Lin , Li Lin , Christina P. Walker , Daniel S. Schiff , Shu Hu

Deepfakes are increasingly realistic and easy to produce, raising concerns about the reliability of human judgments in misinformation settings. We study audiovisual deepfake detection by measuring how consistently crowd workers distinguish…

Information Retrieval · Computer Science 2026-05-07 Michael Soprano , Andrea Cioci , Stefano Mizzaro

As speech generation technology advances, the risk of misuse through deepfake audio has become a pressing concern, which underscores the critical need for robust detection systems. However, many existing speech deepfake datasets are limited…

Sound · Computer Science 2025-07-30 Wen Huang , Yanmei Gu , Zhiming Wang , Huijia Zhu , Yanmin Qian

Deepfakes are AI-generated media in which the original content is digitally altered to create convincing but manipulated images, videos, or audio. Among the various types of deepfakes, lip-syncing deepfakes are one of the most challenging…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Soumyya Kanti Datta , Shan Jia , Siwei Lyu

The rise of deepfake images, especially of well-known personalities, poses a serious threat to the dissemination of authentic information. To tackle this, we present a thorough investigation into how deepfakes are produced and how they can…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Haixu Song , Shiyu Huang , Yinpeng Dong , Wei-Wei Tu

Generative deep learning models are able to create realistic audio and video. This technology has been used to impersonate the faces and voices of individuals. These ``deepfakes'' are being used to spread misinformation, enable scams,…

Artificial Intelligence · Computer Science 2023-06-06 Guy Frankovits , Yisroel Mirsky

Recent rapid advancements in deepfake technology have allowed the creation of highly realistic fake media, such as video, image, and audio. These materials pose significant challenges to human authentication, such as impersonation,…

Cryptography and Security · Computer Science 2023-09-12 Binh Le , Shahroz Tariq , Alsharif Abuadbba , Kristen Moore , Simon Woo

AI-generated media are advancing rapidly, raising pressing concerns for content authenticity and digital trust. We introduce DYMAPIA, a multi-domain Deepfake detection framework that fuses spatial, spectral, and temporal cues to capture…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Md Shohel Rana , Andrew H. Sung

Social media is currently being used by many individuals online as a major source of information. However, not all information shared online is true, even photos and videos can be doctored. Deepfakes have recently risen with the rise of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Jacob mallet , Laura Pryor , Rushit Dave , Mounika Vanamala