English
Related papers

Related papers: Improving Distortion Robustness of Self-supervised…

200 papers

Extensive Unsupervised Domain Adaptation (UDA) studies have shown great success in practice by learning transferable representations across a labeled source domain and an unlabeled target domain with deep models. However, previous works…

Machine Learning · Computer Science 2021-09-03 Muhammad Awais , Fengwei Zhou , Hang Xu , Lanqing Hong , Ping Luo , Sung-Ho Bae , Zhenguo Li

When there is a mismatch between the training and test domains, current speech recognition systems show significant performance degradation. Self-training methods, such as noisy student teacher training, can help address this and enable the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-21 Robert Flynn , Anton Ragni

In speech deepfake detection (SDD), data augmentation (DA) is commonly used to improve model generalization across varied speech conditions and spoofing attacks. However, during training, the backpropagated gradients from original and…

Sound · Computer Science 2026-01-29 Duc-Tuan Truong , Tianchi Liu , Junjie Li , Ruijie Tao , Kong Aik Lee , Eng Siong Chng

Self-supervised speech representation learning aims to extract meaningful factors from the speech signal that can later be used across different downstream tasks, such as speech and/or emotion recognition. Existing models, such as HuBERT,…

Adversarial training is widely acknowledged as the most effective defense against adversarial attacks. However, it is also well established that achieving both robustness and generalization in adversarially trained models involves a…

Computation and Language · Computer Science 2023-12-12 Enes Altinisik , Hassan Sajjad , Husrev Taha Sencar , Safa Messaoud , Sanjay Chawla

Many speech enhancement methods try to learn the relationship between noisy and clean speech, obtained using an acoustic room simulator. We point out several limitations of enhancement methods relying on clean speech targets; the goal of…

Computation and Language · Computer Science 2018-12-26 Geonmin Kim , Hwaran Lee , Bo-Kyeong Kim , Sang-Hoon Oh , Soo-Young Lee

Adversarial training is a defense technique that improves adversarial robustness of a deep neural network (DNN) by including adversarial examples in the training data. In this paper, we identify an overlooked problem of adversarial training…

Machine Learning · Computer Science 2020-09-24 Wonseok Lee , Hanbit Lee , Sang-goo Lee

Self-supervised representation learning approaches have grown in popularity due to the ability to train models on large amounts of unlabeled data and have demonstrated success in diverse fields such as natural language processing, computer…

Machine Learning · Computer Science 2023-02-06 John Harvill , Jarred Barber , Arun Nair , Ramin Pishehvar

The objective of this work is to train noise-robust speaker embeddings adapted for speaker diarisation. Speaker embeddings play a crucial role in the performance of diarisation systems, but they often capture spurious information such as…

Sound · Computer Science 2022-11-04 You Jin Kim , Hee-Soo Heo , Jee-weon Jung , Youngki Kwon , Bong-Jin Lee , Joon Son Chung

We consider the problem of unsupervised domain adaptation for image classification. To learn target-domain-aware features from the unlabeled data, we create a self-supervised pretext task by augmenting the unlabeled data with a certain type…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 L. Xiao , J. Xu , D. Zhao , Z. Wang , L. Wang , Y. Nie , B. Dai

Recent work in the field of speech enhancement (SE) has involved the use of self-supervised speech representations (SSSRs) as feature transformations in loss functions. However, in prior work, very little attention has been paid to the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-23 George Close , Thomas Hain , Stefan Goetze

Automatic speech recognition models are often adapted to improve their accuracy in a new domain. A potential drawback of model adaptation to new domains is catastrophic forgetting, where the Word Error Rate on the original domain is…

Sound · Computer Science 2022-10-10 Somshubra Majumdar , Shantanu Acharya , Vitaly Lavrukhin , Boris Ginsburg

In spite of the recent success of Dialogue Act (DA) classification, the majority of prior works focus on text-based classification with oracle transcriptions, i.e. human transcriptions, instead of Automatic Speech Recognition (ASR)'s…

Computation and Language · Computer Science 2018-10-18 Xuanli He , Quan Hung Tran , William Havard , Laurent Besacier , Ingrid Zukerman , Gholamreza Haffari

Deep transformer neural network models have improved the predictive accuracy of intelligent text processing systems in the biomedical domain. They have obtained state-of-the-art performance scores on a wide variety of biomedical and…

Computation and Language · Computer Science 2021-11-17 Milad Moradi , Matthias Samwald

Acoustic modeling for child speech is challenging due to the high acoustic variability caused by physiological differences in the vocal tract. The dearth of publicly available datasets makes the task more challenging. In this work, we…

Sound · Computer Science 2021-02-25 Richeng Duan , Nancy F. Chen

Arabic dialect identification (ADI) systems are essential for large-scale data collection pipelines that enable the development of inclusive speech technologies for Arabic language varieties. However, the reliability of current ADI systems…

Computation and Language · Computer Science 2025-06-02 Badr M. Abdullah , Matthew Baas , Bernd Möbius , Dietrich Klakow

Speech recognition systems are often highly domain dependent, a fact widely reported in the literature. However the concept of domain is complex and not bound to clear criteria. Hence it is often not evident if data should be considered to…

Computation and Language · Computer Science 2015-09-23 Mortaza Doulaty , Oscar Saz , Thomas Hain

Semi-supervised domain adaptation (SSDA) adapts a learner to a new domain by effectively utilizing source domain data and a few labeled target samples. It is a practical yet under-investigated research topic. In this paper, we analyze the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Wenqiao Zhang , Changshuo Liu , Can Cui , Beng Chin Ooi

Spoken question answering (SQA) is challenging due to complex reasoning on top of the spoken documents. The recent studies have also shown the catastrophic impact of automatic speech recognition (ASR) errors on SQA. Therefore, this work…

Computation and Language · Computer Science 2019-04-18 Chia-Hsuan Lee , Yun-Nung Chen , Hung-Yi Lee

Speaker recognition, recognizing speaker identities based on voice alone, enables important downstream applications, such as personalization and authentication. Learning speaker representations, in the context of supervised learning,…

Machine Learning · Computer Science 2022-07-13 Metehan Cekic , Ruirui Li , Zeya Chen , Yuguang Yang , Andreas Stolcke , Upamanyu Madhow
‹ Prev 1 4 5 6 7 8 10 Next ›