English
Related papers

Related papers: Advancing Continual Learning for Robust Deepfake A…

200 papers

This paper describes our submitted systems to the 2022 ADD challenge withing the tracks 1 and 2. Our approach is based on the combination of a pre-trained wav2vec2 feature extractor and a downstream classifier to detect spoofed audio. This…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-04 Juan M. Martín-Doñas , Aitor Álvarez

Audio autoencoders learn useful, compressed audio representations, but their non-linear latent spaces prevent intuitive algebraic manipulation such as mixing or scaling. We introduce a simple training methodology to induce linearity in a…

Sound · Computer Science 2026-01-29 Bernardo Torres , Manuel Moussallam , Gabriel Meseguer-Brocal

Audio analysis is useful in many application scenarios. The state-of-the-art audio analysis approaches assume the data distribution at training and deployment time will be the same. However, due to various real-life challenges, the data may…

Advances in speech synthesis technologies, like text-to-speech (TTS) and voice conversion (VC), have made detecting deepfake speech increasingly challenging. Spoofing countermeasures often struggle to generalize effectively, particularly…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-27 Wen Huang , Yanmei Gu , Zhiming Wang , Huijia Zhu , Yanmin Qian

We introduce DECAR, a self-supervised pre-training approach for learning general-purpose audio representations. Our system is based on clustering: it utilizes an offline clustering step to provide target labels that act as pseudo-labels for…

Sound · Computer Science 2023-03-15 Sreyan Ghosh , Sandesh V Katta , Ashish Seth , S. Umesh

The generalization of Fake Audio Detection (FAD) is critical due to the emergence of new spoofing techniques. Traditional FAD methods often focus solely on distinguishing between genuine and known spoofed audio. We propose a Genuine-Focused…

Deepfakes have become a universal and rapidly intensifying concern of generative AI across various media types such as images, audio, and videos. Among these, audio deepfakes have been of particular concern due to the ease of high-quality…

Cryptography and Security · Computer Science 2025-03-25 Xiang Li , Pin-Yu Chen , Wenqi Wei

Since Text-to-Speech systems typically don't produce waveforms directly, recent spoof detection studies use resynthesized waveforms from vocoders and neural audio codecs to simulate an attacker. Unlike vocoders, which are specifically…

Sound · Computer Science 2026-02-19 Yixuan Xiao , Florian Lux , Alejandro Pérez-González-de-Martos , Ngoc Thang Vu

Generative techniques continue to evolve at an impressively high rate, driven by the hype about these technologies. This rapid advancement severely limits the application of deepfake detectors, which, despite numerous efforts by the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Francesco Tassone , Luca Maiano , Irene Amerini

Although continual learning and anomaly detection have separately been well-studied in previous works, their intersection remains rather unexplored. The present work addresses a learning scenario where a model has to incrementally learn a…

Machine Learning · Computer Science 2022-07-15 Ahmed Frikha , Denis Krompaß , Volker Tresp

Rapid growth in speech data demands adaptive models, as traditional static methods fail to keep pace with dynamic and diverse speech information. We introduce continuous speech learning, a new set-up targeting at bridging the adaptation gap…

Computation and Language · Computer Science 2025-06-04 Guitao Wang , Jinming Zhao , Hao Yang , Guilin Qi , Tongtong Wu , Gholamreza Haffari

Continual Learning, also known as Lifelong Learning, aims to continually learn from new data as it becomes available. While prior research on continual learning in automatic speech recognition has focused on the adaptation of models across…

Machine Learning · Computer Science 2022-07-13 Muqiao Yang , Ian Lane , Shinji Watanabe

With the ever-rising quality of deep generative models, it is increasingly important to be able to discern whether the audio data at hand have been recorded or synthesized. Although the detection of fake speech signals has been studied…

Sound · Computer Science 2024-06-14 Hafsa Ouajdi , Oussama Hadder , Modan Tailleur , Mathieu Lagrange , Laurie M. Heller

Automatic speech recognition systems have created exciting possibilities for applications, however they also enable opportunities for systematic eavesdropping. We propose a method to camouflage a person's voice over-the-air from these…

Sound · Computer Science 2022-02-18 Mia Chiquier , Chengzhi Mao , Carl Vondrick

In this paper, we tackle the new Language-Based Audio Retrieval task proposed in DCASE 2022. Firstly, we introduce a simple, scalable architecture which ties both the audio and text encoder together. Secondly, we show that using this…

Sound · Computer Science 2022-06-30 Andrew Koh , Eng Siong Chng

The state-of-the-art audio deepfake detectors leveraging deep neural networks exhibit impressive recognition performance. Nonetheless, this advantage is accompanied by a significant carbon footprint. This is mainly due to the use of…

Sound · Computer Science 2024-03-22 Subhajit Saha , Md Sahidullah , Swagatam Das

Advances in deep learning, combined with availability of large datasets, have led to impressive improvements in face presentation attack detection research. However, state-of-the-art face antispoofing systems are still vulnerable to novel…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Mohammad Rostami , Leonidas Spinoulas , Mohamed Hussein , Joe Mathai , Wael Abd-Almageed

Recent advances in speech deepfake detection (SDD) have significantly improved artifacts-based detection in spoofed speech. However, most models overlook speech naturalness, a crucial cue for distinguishing bona fide speech from spoofed…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-21 Taewoo Kim , Guisik Kim , Choongsang Cho , Young Han Lee

Continual learning requires learning incremental tasks with dynamic data distributions. So far, it has been observed that employing a combination of contrastive loss and distillation loss for training in continual learning yields strong…

Machine Learning · Computer Science 2024-05-30 Yichen Wen , Zhiquan Tan , Kaipeng Zheng , Chuanlong Xie , Weiran Huang

Sound event detection (SED) is essential for recognizing specific sounds and their temporal locations within acoustic signals. This becomes challenging particularly for on-device applications, where computational resources are limited. To…

Sound · Computer Science 2024-02-07 Yang Xiao , Rohan Kumar Das