English
Related papers

Related papers: Audio-Visual Deepfake Detection With Local Tempora…

200 papers

As AI-generated content (AIGC) thrives, deepfakes have expanded from single-modality falsification to cross-modal fake content creation, where either audio or visual components can be manipulated. While using two unimodal detectors can…

Multimedia · Computer Science 2024-10-28 Cai Yu , Peng Chen , Jiahe Tian , Jin Liu , Jiao Dai , Xi Wang , Yesheng Chai , Shan Jia , Siwei Lyu , Jizhong Han

The rise of manipulated media has made deepfakes a particularly insidious threat, involving various generative manipulations such as lip-sync modifications, face-swaps, and avatar-driven facial synthesis. Conventional detection methods,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Soumyya Kanti Datta , Tanvi Ranga , Chengzhe Sun , Siwei Lyu

Current text-to-speech algorithms produce realistic fakes of human voices, making deepfake detection a much-needed area of research. While researchers have presented various techniques for detecting audio spoofs, it is often unclear exactly…

The recent renaissance in generative models, driven primarily by the advent of diffusion models and iterative improvement in GAN methods, has enabled many creative applications. However, each advancement is also accompanied by a rise in the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Sanjay Saha , Rashindrie Perera , Sachith Seneviratne , Tamasha Malepathirana , Sanka Rasnayaka , Deshani Geethika , Terence Sim , Saman Halgamuge

Advances in computer vision and deep learning have blurred the line between deepfakes and authentic media, undermining multimedia credibility through audio-visual forgery. Current multimodal detection methods remain limited by unbalanced…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zihan Xiong , Xiaohua Wu , Lei Chen , Fangqi Lou

This paper reviews the state-of-the-art in deepfake generation and detection, focusing on modern deep learning technologies and tools based on the latest scientific advancements. The rise of deepfakes, leveraging techniques like Variational…

Cryptography and Security · Computer Science 2025-01-14 Arash Dehghani , Hossein Saberi

A lip-syncing deepfake is a digitally manipulated video in which a person's lip movements are created convincingly using AI models to match altered or entirely new audio. Lip-syncing deepfakes are a dangerous type of deepfakes as the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Soumyya Kanti Datta , Shan Jia , Siwei Lyu

Deep generative modeling has the potential to cause significant harm to society. Recognizing this threat, a magnitude of research into detecting so-called "Deepfakes" has emerged. This research most often focuses on the image domain, while…

Machine Learning · Computer Science 2021-11-05 Joel Frank , Lea Schönherr

This paper addresses the challenge of developing a robust audio-visual deepfake detection model. In practical use cases, new generation algorithms are continually emerging, and these algorithms are not encountered during the development of…

Sound · Computer Science 2024-08-20 Kyungbok Lee , You Zhang , Zhiyao Duan

Recent advancements in text-to-speech and speech conversion technologies have enabled the creation of highly convincing synthetic speech. While these innovations offer numerous practical benefits, they also cause significant security…

Sound · Computer Science 2024-12-18 Kuiyuan Zhang , Zhongyun Hua , Rushi Lan , Yushu Zhang , Yifang Guo

With the rapid development of artificial intelligence technology, the application of deepfake technology in the audio field has gradually increased, resulting in a wide range of security risks. Especially in the financial and social…

Sound · Computer Science 2024-12-13 Yangguang Feng

Recent advances in face forgery techniques produce nearly visually untraceable deepfake videos, which could be leveraged with malicious intentions. As a result, researchers have been devoted to deepfake detection. Previous studies have…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Jiazhi Guan , Hang Zhou , Zhibin Hong , Errui Ding , Jingdong Wang , Chengbin Quan , Youjian Zhao

The Audio Deep Synthesis Detection (ADD) Challenge has been held to detect generated human-like speech. With our submitted system, this paper provides an overall assessment of track 1 (Low-quality Fake Audio Detection) and track 2…

Sound · Computer Science 2022-10-12 Xiaohui Liu , Meng Liu , Lin Zhang , Linjuan Zhang , Chang Zeng , Kai Li , Nan Li , Kong Aik Lee , Longbiao Wang , Jianwu Dang

We present a learning-based method for detecting real and fake deepfake multimedia content. To maximize information for learning, we extract and analyze the similarity between the two audio and visual modalities from within the same video.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Trisha Mittal , Uttaran Bhattacharya , Rohan Chandra , Aniket Bera , Dinesh Manocha

Detecting deepfake videos is highly challenging given the complexity of characterizing spatio-temporal artifacts. Most existing methods rely on binary classifiers trained using real and fake image sequences, therefore hindering their…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Dat Nguyen , Marcella Astrid , Anis Kacem , Enjie Ghorbel , Djamila Aouada

The misuse of deepfake technology by malicious actors poses a potential threat to nations, societies, and individuals. However, existing methods for detecting deepfakes primarily focus on uncompressed videos, such as noise characteristics,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Zongmei Chen , Xin Liao , Xiaoshuai Wu , Yanxiang Chen

Generative AI advances rapidly, allowing the creation of very realistic manipulated video and audio. This progress presents a significant security and ethical threat, as malicious users can exploit DeepFake techniques to spread…

Multimedia · Computer Science 2025-06-09 Marcel Klemt , Carlotta Segna , Anna Rohrbach

Better generative models and larger datasets have led to more realistic fake videos that can fool the human eye but produce temporal and spatial artifacts that deep learning approaches can detect. Most current Deepfake detection methods…

Computer Vision and Pattern Recognition · Computer Science 2020-06-29 Oscar de Lima , Sean Franklin , Shreshtha Basu , Blake Karwoski , Annet George

The detection and localization of highly realistic deepfake audio-visual content are challenging even for the most advanced state-of-the-art methods. While most of the research efforts in this domain are focused on detecting high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Zhixi Cai , Shreya Ghosh , Aman Pankaj Adatia , Munawar Hayat , Abhinav Dhall , Tom Gedeon , Kalin Stefanov

Recent progress in generative AI technology has made audio deepfakes remarkably more realistic. While current research on anti-spoofing systems primarily focuses on assessing whether a given audio sample is fake or genuine, there has been…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-26 Nicholas Klein , Tianxiang Chen , Hemlata Tak , Ricardo Casal , Elie Khoury