English
Related papers

Related papers: A Multimodal Framework for Deepfake Detection

200 papers

Deeplearning has been used to solve complex problems in various domains. As it advances, it also creates applications which become a major threat to our privacy, security and even to our Democracy. Such an application which is being…

Computer Vision and Pattern Recognition · Computer Science 2020-09-17 Rahul U , Ragul M , Raja Vignesh K , Tejeswinee K

Online media data, in the forms of images and videos, are becoming mainstream communication channels. However, recent advances in deep learning, particularly deep generative models, open the doors for producing perceptually convincing…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Junke Wang , Zhenxin Li , Chao Zhang , Jingjing Chen , Zuxuan Wu , Larry S. Davis , Yu-Gang Jiang

In this paper, we propose an enhanced audio-visual deep detection method. Recent methods in audio-visual deepfake detection mostly assess the synchronization between audio and visual features. Although they have shown promising results,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Marcella Astrid , Enjie Ghorbel , Djamila Aouada

Deepfakes are realistic face manipulations that can pose serious threats to security, privacy, and trust. Existing methods mostly treat this task as binary classification, which uses digital labels or mask signals to train the detection…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Ke Sun , Shen Chen , Taiping Yao , Haozhe Yang , Xiaoshuai Sun , Shouhong Ding , Rongrong Ji

The field of visual and audio generation is burgeoning with new state-of-the-art methods. This rapid proliferation of new techniques underscores the need for robust solutions for detecting synthetic content in videos. In particular, when…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Nicholas Klein , Hemlata Tak , James Fullwood , Krishna Regmi , Leonidas Spinoulas , Ganesh Sivaraman , Tianxiang Chen , Elie Khoury

The rise of deepfake technology brings forth new questions about the authenticity of various forms of media found online today. Videos and images generated by artificial intelligence (AI) have become increasingly more difficult to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Benjamin Carter , Nathan Dilla , Micheal Callahan , Atuhaire Ambala

Deepfake technologies empowered by deep learning are rapidly evolving, creating new security concerns for society. Existing multimodal detection methods usually capture audio-visual inconsistencies to expose Deepfake videos. More seriously,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Yu Chen , Yang Yu , Rongrong Ni , Yao Zhao , Haoliang Li

Recent multimodal deepfake detection methods designed for generalization conjecture that single-stage supervised training struggles to generalize across unseen manipulations and datasets. However, such approaches that target generalization…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Ashutosh Anshul , Shreyas Gopal , Deepu Rajan , Eng Siong Chng

Recently, image manipulation has achieved rapid growth due to the advancement of sophisticated image editing tools. A recent surge of generated fake imagery and videos using neural networks is DeepFake. DeepFake algorithms can create fake…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Naciye Celebi , Qingzhong Liu , Muhammed Karatoprak

Voice authentication systems deployed at the network edge face dual threats: a) sophisticated deepfake synthesis attacks and b) control-plane poisoning in distributed federated learning protocols. We present a framework coupling…

Sound · Computer Science 2025-12-09 Alireza Mohammadi , Keshav Sood , Dhananjay Thiruvady , Asef Nazari

This research explores the positive application of deepfake technology for upper body generation, specifically sign language for the Deaf and Hard of Hearing (DHoH) community. Given the complexity of sign language and the scarcity of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Shahzeb Naeem , Muhammad Riyyan Khan , Usman Tariq , Abhinav Dhall , Carlos Ivan Colon , Hasan Al-Nashash

Deepfake technologies are often associated with deception, misinformation, and identity fraud, raising legitimate societal concerns. Yet such narratives may obscure a key insight: deepfakes embody sophisticated capabilities for sensory…

Computers and Society · Computer Science 2025-10-28 Yizhi Liu , Balaji Padmanabhan , Siva Viswanathan

Multimodal manipulations (also known as audio-visual deepfakes) make it difficult for unimodal deepfake detectors to detect forgeries in multimedia content. To avoid the spread of false propaganda and fake news, timely detection is crucial.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Sahibzada Adil Shahzad , Ammarah Hashmi , Yan-Tsung Peng , Yu Tsao , Hsin-Min Wang

Deepfake videos, where a person's face is automatically swapped with a face of someone else, are becoming easier to generate with more realistic results. In response to the threat such manipulations can pose to our trust in video evidence,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Pavel Korshunov , Sébastien Marcel

As audio deepfakes transition from research artifacts to widely available commercial tools, robust biometric authentication faces pressing security threats in high-stakes industries. This paper presents a systematic empirical evaluation of…

Sound · Computer Science 2026-01-07 Mengze Hong , Di Jiang , Zeying Xie , Weiwei Zhao , Guan Wang , Chen Jason Zhang

Deepfakes and manipulated media are becoming a prominent threat due to the recent advances in realistic image and video synthesis techniques. There have been several attempts at combating Deepfakes using machine learning classifiers.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Paarth Neekhara , Shehzeen Hussain , Xinqiao Zhang , Ke Huang , Julian McAuley , Farinaz Koushanfar

Deepfake speech detection presents a growing challenge as generative audio technologies continue to advance. We propose a hybrid training framework that advances detection performance through novel augmentation strategies. First, we…

Sound · Computer Science 2025-11-14 Inbal Rimon , Oren Gal , Haim Permuter

The rapid advancement of speech synthesis and voice conversion technologies has raised significant security concerns in multimedia forensics. Although current detection models demonstrate impressive performance, they struggle to maintain…

Sound · Computer Science 2025-11-26 Wangjie Li , Lin Li , Qingyang Hong

While Vision-Language Models (VLMs) and Multimodal Large Language Models (MLLMs) have shown strong generalisation in detecting image and video deepfakes, their use for audio deepfake detection remains largely unexplored. In this work, we…

Sound · Computer Science 2026-01-05 Akanksha Chuchra , Shukesh Reddy , Sudeepta Mishra , Abhijit Das , Abhinav Dhall

One of the most terrifying phenomenon nowadays is the DeepFake: the possibility to automatically replace a person's face in images and videos by exploiting algorithms based on deep learning. This paper will present a brief overview of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Luca Guarnera , Oliver Giudice , Cristina Nastasi , Sebastiano Battiato