中文
相关论文

相关论文: Comprehensive Layer-wise Analysis of SSL Models fo…

200 篇论文

Deep learning models trained in a supervised setting have revolutionized audio and speech processing. However, their performance inherently depends on the quantity of human-annotated data, making them costly to scale and prone to poor…

音频与语音处理 · 电气工程与系统科学 2026-02-12 Theo Lepage , Reda Dehak

In recent years, self-supervised learning (SSL) models have made significant progress in audio deepfake detection (ADD) tasks. However, existing SSL models mainly rely on large-scale real speech for pre-training and lack the learning of…

声音 · 计算机科学 2025-09-05 Yunqi Hao , Yihao Chen , Minqiang Xu , Jianbo Zhan , Liang He , Lei Fang , Sian Fang , Lin Liu

Self-supervised learning (SSL) models like Wav2Vec2, HuBERT, and WavLM have been widely used in speech processing. These transformer-based models consist of multiple layers, each capturing different levels of representation. While prior…

音频与语音处理 · 电气工程与系统科学 2025-08-13 Xinyu Liang , Fredrik Cumlin , Victor Ungureanu , Chandan K. A. Reddy , Christian Schuldt , Saikat Chatterjee

Recent research has highlighted a key issue in speech deepfake detection: models trained on one set of deepfakes perform poorly on others. The question arises: is this due to the continuously improving quality of Text-to-Speech (TTS)…

声音 · 计算机科学 2024-06-13 Nicolas M. Müller , Nicholas Evans , Hemlata Tak , Philip Sperl , Konstantin Böttinger

While supervised quality predictors for synthesized speech have demonstrated strong correlations with human ratings, their requirement for in-domain labeled training data hinders their generalization ability to new domains. Unsupervised…

音频与语音处理 · 电气工程与系统科学 2025-09-08 Erica Cooper , Takuma Okamoto , Yamato Ohtani , Tomoki Toda , Hisashi Kawai

Since the majority of audio DeepFake (DF) detection methods are trained on English-centric datasets, their applicability to non-English languages remains largely unexplored. In this work, we present a benchmark for the multilingual audio DF…

声音 · 计算机科学 2025-08-07 Bartłomiej Marek , Piotr Kawa , Piotr Syga

Audio deepfake detection is an emerging active topic. A growing number of literatures have aimed to study deepfake detection algorithms and achieved effective performance, the problem of which is far from being solved. Although there are…

声音 · 计算机科学 2023-08-30 Jiangyan Yi , Chenglong Wang , Jianhua Tao , Xiaohui Zhang , Chu Yuan Zhang , Yan Zhao

Self-supervised learning (SSL) has allowed substantial progress in Automatic Speech Recognition (ASR) performance in low-resource settings. In this context, it has been demonstrated that larger self-supervised feature extractors are crucial…

音频与语音处理 · 电气工程与系统科学 2023-03-14 Salah Zaiem , Robin Algayres , Titouan Parcollet , Slim Essid , Mirco Ravanelli

Audio deepfake detection (ADD) is crucial to combat the misuse of speech synthesized from generative AI models. Existing ADD models suffer from generalization issues, with a large performance discrepancy between in-domain and out-of-domain…

声音 · 计算机科学 2024-07-29 Yi Zhu , Surya Koppisetti , Trang Tran , Gaurav Bharaj

Audio deepfake detection has become increasingly challenging due to rapid advances in speech synthesis and voice conversion technologies, particularly under channel distortions, replay attacks, and real-world recording conditions. This…

音频与语音处理 · 电气工程与系统科学 2026-01-13 K. A. Shahriar

Self-supervised learning (SSL) has grown in interest within the speech processing community, since it produces representations that are useful for many downstream tasks. SSL uses global and contextual methods to produce robust…

音频与语音处理 · 电气工程与系统科学 2024-11-08 Subrina Sultana , Donald S. Williamson

This paper describes the BUT submission to the ESDD 2026 Challenge, specifically focusing on Track 1: Environmental Sound Deepfake Detection with Unseen Generators. To address the critical challenge of generalizing to audio generated by…

音频与语音处理 · 电气工程与系统科学 2025-12-10 Junyi Peng , Lin Zhang , Jin Li , Oldrich Plchot , Jan Cernocky

The rapid advancement of audio generation technologies has escalated the risks of malicious deepfake audio across speech, sound, singing voice, and music, threatening multimedia security and trust. While existing countermeasures (CMs)…

声音 · 计算机科学 2026-01-12 Yuankun Xie , Ruibo Fu , Zhiyong Wang , Xiaopeng Wang , Songjun Cao , Long Ma , Haonan Cheng , Long Ye

Audio and speech self-supervised encoder models are now widely used for a lot of different tasks. Many of these models are often trained on clean segmented speech content such as LibriSpeech. In this paper, we look into how the pretraining…

音频与语音处理 · 电气工程与系统科学 2026-04-13 Valentin Pelloin , Lina Bekkali , Reda Dehak , David Doukhan

In speech deepfake detection, one of the critical aspects is developing detectors able to generalize on unseen data and distinguish fake signals across different datasets. Common approaches to this challenge involve incorporating diverse…

声音 · 计算机科学 2024-09-27 Davide Salvi , Viola Negroni , Luca Bondi , Paolo Bestagini , Stefano Tubaro

Self-supervised learning (SSL) speech representation models, trained on large speech corpora, have demonstrated effectiveness in extracting hierarchical speech embeddings through multiple transformer layers. However, the behavior of these…

计算与语言 · 计算机科学 2024-06-18 Zihan Pan , Tianchi Liu , Hardik B. Sailor , Qiongqiong Wang

Detecting medical conditions from speech acoustics is fundamentally a weakly-supervised learning problem: a single, often noisy, session-level label must be linked to nuanced patterns within a long, complex audio recording. This task is…

声音 · 计算机科学 2026-04-21 Xingyuan Li , Mengyue Wu

Speech deepfake detection is a well-established research field with different models, datasets, and training strategies. However, the lack of standardized implementations and evaluation protocols limits reproducibility, benchmarking, and…

In large part due to their implicit semantic modeling, self-supervised learning (SSL) methods have significantly increased the performance of valence recognition in speech emotion recognition (SER) systems. Yet, their large size may often…

音频与语音处理 · 电气工程与系统科学 2023-09-20 Danilo de Oliveira , Navin Raj Prabhu , Timo Gerkmann

Self-supervised learning (SSL) approaches such as wav2vec 2.0 and HuBERT models have shown promising results in various downstream tasks in the speech community. In particular, speech representations learned by SSL models have been shown to…

音频与语音处理 · 电气工程与系统科学 2022-04-11 Eesung Kim , Jae-Jin Jeon , Hyeji Seo , Hoon Kim