English
Related papers

Related papers: Naturalness-Aware Curriculum Learning with Dynamic…

200 papers

The state-of-the-art audio deepfake detectors leveraging deep neural networks exhibit impressive recognition performance. Nonetheless, this advantage is accompanied by a significant carbon footprint. This is mainly due to the use of…

Sound · Computer Science 2024-03-22 Subhajit Saha , Md Sahidullah , Swagatam Das

Eliminating the negative effect of non-stationary environmental noise is a long-standing research topic for automatic speech recognition that stills remains an important challenge. Data-driven supervised approaches, including ones based on…

Automatic Speaker Verification systems are gaining popularity these days; spoofing attacks are of prime concern as they make these systems vulnerable. Some spoofing attacks like Replay attacks are easier to implement but are very hard to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-11 Rahul T P , P R Aravind , Ranjith C , Usamath Nechiyil , Nandakumar Paramparambath

Sound event detection (SED) is essential for recognizing specific sounds and their temporal locations within acoustic signals. This becomes challenging particularly for on-device applications, where computational resources are limited. To…

Sound · Computer Science 2024-02-07 Yang Xiao , Rohan Kumar Das

Pseudo-label based self training approaches are a popular method for source-free unsupervised domain adaptation. However, their efficacy depends on the quality of the labels generated by the source trained model. These labels may be…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Deepti Hegde , Vishwanath Sindagi , Velat Kilic , A. Brinton Cooper , Mark Foster , Vishal Patel

Due to the successful application of deep learning, audio spoofing detection has made significant progress. Spoofed audio with speech synthesis or voice conversion can be well detected by many countermeasures. However, an automatic speaker…

Sound · Computer Science 2024-01-12 Lian Huang , Chi-Man Pun

Generalization remains a critical challenge in speech deepfake detection (SDD). While various approaches aim to improve robustness, generalization is typically assessed through performance metrics like equal error rate without a theoretical…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-16 Wen Huang , Xuechen Liu , Xin Wang , Junichi Yamagishi , Yanmin Qian

Distantly-Supervised Named Entity Recognition (DS-NER) is widely used in real-world scenarios. It can effectively alleviate the burden of annotation by matching entities in existing knowledge bases with snippets in the text but suffer from…

Computation and Language · Computer Science 2025-07-04 Shuzheng Si , Helan Hu , Haozhe Zhao , Shuang Zeng , Kaikai An , Zefan Cai , Baobao Chang

In this paper, we propose an enhanced audio-visual deep detection method. Recent methods in audio-visual deepfake detection mostly assess the synchronization between audio and visual features. Although they have shown promising results,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Marcella Astrid , Enjie Ghorbel , Djamila Aouada

Albeit recent progress in speaker verification generates powerful models, malicious attacks in the form of spoofed speech, are generally not coped with. Recent results in ASVSpoof2015 and BTAS2016 challenges indicate that spoof-aware…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-28 Heinrich Dinkel , Nanxin Chen , Yanmin Qian , Kai Yu

With a recent influx of voice generation methods, the threat introduced by audio DeepFake (DF) is ever-increasing. Several different detection methods have been presented as a countermeasure. Many methods are based on so-called front-ends,…

Sound · Computer Science 2023-06-05 Piotr Kawa , Marcin Plata , Michał Czuba , Piotr Szymański , Piotr Syga

Deep learning has enabled highly realistic synthetic speech, raising concerns about fraud, impersonation, and disinformation. Despite rapid progress in neural detectors, transparent baselines are needed to reveal which acoustic cues…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-16 Faheem Ahmad , Ajan Ahmed , Masudul Imtiaz

Over the recent years, various deep learning-based methods were proposed for extracting a fixed-dimensional embedding vector from speech signals. Although the deep learning-based embedding extraction methods have shown good performance in…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-08 Woo Hyun Kang , Jahangir Alam , Abderrahim Fathan

Due to the lack of target speech annotations in real-recorded far-field conversational datasets, speech enhancement (SE) models are typically trained on simulated data. However, the trained models often perform poorly in real-world…

Sound · Computer Science 2025-06-24 Longjie Luo , Lin Li , Qingyang Hong

Current speech deepfake detection approaches perform satisfactorily against known adversaries; however, generalization to unseen attacks remains an open challenge. The proliferation of speech deepfakes on social media underscores the need…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-01 Ivan Kukanov , Janne Laakkonen , Tomi Kinnunen , Ville Hautamäki

This paper describes a submission to the Environment-Aware Speech and Sound Deepfake Detection Challenge (ESDD2) 2026, which addresses component-level deepfake detection using the CompSpoofV2 dataset, where speech and environmental sounds…

Sound · Computer Science 2026-05-06 Khalid Zaman , Qixuan Huang , Muhammad Uzair , Masashi Unoki

Audio recorded in real-world environments often contains a mixture of foreground speech and background environmental sounds. With rapid advances in text-to-speech, voice conversion, and other generation models, either component can now be…

Sound · Computer Science 2026-02-06 Xueping Zhang , Han Yin , Yang Xiao , Lin Zhang , Ting Dang , Rohan Kumar Das , Ming Li

Although current fake audio detection approaches have achieved remarkable success on specific datasets, they often fail when evaluated with datasets from different distributions. Previous studies typically address distribution shift by…

In this paper, we propose a deep neural network approach for deepfake speech detection (DSD) based on a lowcomplexity Depthwise-Inception Network (DIN) trained with a contrastive training strategy (CTS). In this framework, input audio…

Standard supervised training for deepfake detection treats all samples with uniform importance, which can be suboptimal for learning robust and generalizable features. In this work, we propose a novel Tutor-Student Reinforcement Learning…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Zhanhe Lei , Zhongyuan Wang , Jikang Cheng , Baojin Huang , Yuhong Yang , Zhen Han , Chao Liang , Dengpan Ye