English
Related papers

Related papers: An Efficient Temporary Deepfake Location Approach …

200 papers

The rapid advancement of deepfake technology poses a significant threat to digital media integrity. Deepfakes, synthetic media created using AI, can convincingly alter videos and audio to misrepresent reality. This creates risks of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Kashish Gandhi , Prutha Kulkarni , Taran Shah , Piyush Chaudhari , Meera Narvekar , Kranti Ghag

Deepfake detection is crucial for curbing the harm it causes to society. However, current Deepfake detection methods fail to thoroughly explore artifact information across different domains due to insufficient intrinsic interactions. These…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Xueqi Qiu , Xingyu Miao , Fan Wan , Haoran Duan , Tejal Shah , Varun Ojhab , Yang Longa , Rajiv Ranjan

Multimodal deepfakes can exhibit subtle visual artifacts and cross-modal inconsistencies, which remain challenging to detect, especially when detectors are trained primarily on curated synthetic forgeries. Such synthetic dependence can…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Sahibzada Adil Shahzad , Ammarah Hashmi , Junichi Yamagishi , Yusuke Yasuda , Yu Tsao , Chia-Wen Lin , Yan-Tsung Peng , Hsin-Min Wang

Weakly Supervised Sound Event Detection (WSSED), which relies on audio tags without precise onset and offset times, has become prevalent due to the scarcity of strongly labeled data that includes exact temporal boundaries for events. This…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-08 Yuliang Zhang , Defeng , Huang , Roberto Togneri

While the pursuit of higher accuracy in deepfake detection remains a central goal, there is an increasing demand for precise localization of manipulated regions. Despite the remarkable progress made in classification-based detection,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Chao Shuai , Gaojian Wang , Kun Pan , Tong Wu , Fanli Jin , Haohan Tan , Mengxiang Li , Zhenguang Liu , Feng Lin , Kui Ren

Verifying the identity of a speaker is crucial in modern human-machine interfaces, e.g., to ensure privacy protection or to enable biometric authentication. Classical speaker verification (SV) approaches estimate a fixed-dimensional…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-29 Ahmad Aloradi , Wolfgang Mack , Mohamed Elminshawi , Emanuël A. P. Habets

Rapid advances in singing voice synthesis have increased unauthorized imitation risks, creating an urgent need for better Singing Voice Deepfake (SingFake) Detection, also known as SVDD. Unlike speech, singing contains complex pitch, wide…

Sound · Computer Science 2026-04-07 Xuanjun Chen , Chia-Yu Hu , Sung-Feng Huang , Haibin Wu , Hung-yi Lee , Jyh-Shing Roger Jang

Audio deepfake detection has become a pivotal task over the last couple of years, as many recent speech synthesis and voice cloning systems generate highly realistic speech samples, thus enabling their use in malicious activities. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-15 David Combei , Adriana Stan , Dan Oneata , Horia Cucu

Automatic speaker verification systems are vulnerable to a variety of access threats, prompting research into the formulation of effective spoofing detection systems to act as a gate to filter out such spoofing attacks. This study…

Sound · Computer Science 2022-11-21 Zhenyu Wang , John H. L. Hansen

Transferring existing image-based detectors to the video is non-trivial since the quality of frames is always deteriorated by part occlusion, rare pose, and motion blur. Previous approaches exploit to propagate and aggregate features across…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Zhengkai Jiang , Yu Liu , Ceyuan Yang , Jihao Liu , Peng Gao , Qian Zhang , Shiming Xiang , Chunhong Pan

With the rapid development of deepfake technology, simply making a binary judgment of true or false on audio is no longer sufficient to meet practical needs. Accurately determining the specific deepfake method has become crucial. This paper…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-11 Li Wang , Junyi Ao , Linyong Gan , Yuancheng Wang , Xueyao Zhang , Zhizheng Wu

Temporal Forgery Localization (TFL) aims to precisely identify manipulated segments within videos or audio streams, providing interpretable evidence for multimedia forensics and security. While most existing TFL methods rely on dense…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Xiaodong Zhu , Yuanming Zheng , Suting Wang , Junqi Yang , Yuhong Yang , Weiping Tu , Zhongyuan Wang

Localizing sounds and detecting events in different room environments is a difficult task, mainly due to the wide range of reflections and reverberations. When training neural network models with sounds recorded in only a few room…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-06 Yusun Shul , Byeong-Yun Ko , Jung-Woo Choi

Video DeepFakes are fake media created with Deep Learning (DL) that manipulate a person's expression or identity. Most current DeepFake detection methods analyze each frame independently, ignoring inconsistencies and unnatural movements…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Peter Grönquist , Yufan Ren , Qingyi He , Alessio Verardo , Sabine Süsstrunk

Speaker verification (SV) aims to determine whether the speaker's identity of a test utterance is the same as the reference speech. In the past few years, extracting speaker embeddings using deep neural networks for SV systems has gone…

Sound · Computer Science 2022-05-27 Nan Zhang , Jianzong Wang , Zhenhou Hong , Chendong Zhao , Xiaoyang Qu , Jing Xiao

The emergence of new spoofing attacks poses an increasing challenge to audio security. Current detection methods often falter when faced with unseen spoofing attacks. Traditional strategies, such as retraining with new data, are not always…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-16 Feiyi Dong , Qingchen Tang , Yichen Bai , Zihan Wang

Traditional defenses against Deep Leakage (DL) attacks in Federated Learning (FL) primarily focus on obfuscation, introducing noise, transformations or encryption to degrade an attacker's ability to reconstruct private data. While effective…

Cryptography and Security · Computer Science 2026-01-22 Isaac Baglin , Xiatian Zhu , Simon Hadfield

Audio deepfake detection (ADD) is essential for preventing the misuse of synthetic voices that may infringe on personal rights and privacy. Recent zero-shot text-to-speech (TTS) models pose higher risks as they can clone voices with a…

Sound · Computer Science 2024-09-23 Yuang Li , Min Zhang , Mengxin Ren , Miaomiao Ma , Daimeng Wei , Hao Yang

Current audio deepfake detection has achieved remarkable performance using diverse deep learning architectures such as ResNet, and has seen further improvements with the introduction of large models (LMs) like Wav2Vec. The success of large…

Sound · Computer Science 2026-03-27 Yupei Li , Shuaijie Shao , Manuel Milling , Björn Schuller

Recent advances in speech deepfake detection (SDD) have significantly improved artifacts-based detection in spoofed speech. However, most models overlook speech naturalness, a crucial cue for distinguishing bona fide speech from spoofed…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-21 Taewoo Kim , Guisik Kim , Choongsang Cho , Young Han Lee