English
Related papers

Related papers: Self-FiLM: Conditioning GANs with self-supervised …

200 papers

In this paper, we present end-to-end and speech embedding based systems trained in a self-supervised fashion to participate in the ACM Multimedia 2022 ComParE Challenge, specifically the stuttering sub-challenge. In particular, we exploit…

Sound · Computer Science 2022-07-25 Shakeel Ahmad Sheikh , Md Sahidullah , Fabrice Hirsch , Slim Ouni

Acoustic scene classification (ASC) predominantly relies on supervised approaches. However, acquiring labeled data for training ASC models is often costly and time-consuming. Recently, self-supervised learning (SSL) has emerged as a…

Sound · Computer Science 2024-08-28 Yiqiang Cai , Shengchen Li , Xi Shao

We propose a self-supervised representation learning model for the task of unsupervised phoneme boundary detection. The model is a convolutional neural network that operates directly on the raw waveform. It is optimized to identify spectral…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Felix Kreuk , Joseph Keshet , Yossi Adi

In automatic speech recognition, any factor that alters the acoustic properties of speech can pose a challenge to the system's performance. This paper presents a novel approach for automatic whispered speech recognition in the Irish dialect…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-05 Aref Farhadipour , Homa Asadi , Volker Dellwo

This study tackles unsupervised subword modeling in the zero-resource scenario, learning frame-level speech representation that is phonetically discriminative and speaker-invariant, using only untranscribed speech for target languages.…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-29 Siyuan Feng , Tan Lee

Producing a large annotated speech corpus for training ASR systems remains difficult for more than 95% of languages all over the world which are low-resourced, but collecting a relatively big unlabeled data set for such languages is more…

Computation and Language · Computer Science 2019-08-26 Kuan-Yu Chen , Che-Ping Tsai , Da-Rong Liu , Hung-Yi Lee , Lin-shan Lee

Generalized end-to-end (GE2E) model is widely used in speaker verification (SV) fields due to its expandability and generality regardless of specific languages. However, the long-short term memory (LSTM) based on GE2E has two limitations:…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-17 Hyeonmook Park , Jungbae Park , Sang Wan Lee

The performance of spoofing countermeasure systems depends fundamentally upon the use of sufficiently representative training data. With this usually being limited, current solutions typically lack generalisation to attacks encountered in…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-01 Hemlata Tak , Massimiliano Todisco , Xin Wang , Jee-weon Jung , Junichi Yamagishi , Nicholas Evans

Speech systems developed for a particular choice of acoustic domain and sampling frequency do not translate easily to others. The usual practice is to learn domain adaptation and bandwidth extension models independently. Contrary to this,…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-01 Saurabh Kataria , Jesús Villalba , Laureano Moro-Velázquez , Najim Dehak

Recent studies have shown that the benefits provided by self-supervised pre-training and self-training (pseudo-labeling) are complementary. Semi-supervised fine-tuning strategies under the pre-training framework, however, remain…

Sound · Computer Science 2022-06-28 Bowen Zhang , Songjun Cao , Xiaoming Zhang , Yike Zhang , Long Ma , Takahiro Shinozaki

Self-supervised learning (SSL)-based speech models are extensively used for full-stack speech processing. However, it has been observed that improving SSL-based speech representations using unlabeled speech for content-related tasks is…

Computation and Language · Computer Science 2024-06-14 Amit Meghanani , Thomas Hain

Supervised training of an automated medical image analysis system often requires a large amount of expert annotations that are hard to collect. Moreover, the proportions of data available across different classes may be highly imbalanced…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Yuan Xue , Jiarong Ye , Rodney Long , Sameer Antani , Zhiyun Xue , Xiaolei Huang

The performances of the automatic speaker verification (ASV) systems degrade due to the reduction in the amount of speech used for enrollment and verification. Combining multiple systems based on different features and classifiers…

Computer Vision and Pattern Recognition · Computer Science 2019-02-01 Arnab Poddar , Md Sahidullah , Goutam Saha

Despite the rapid progress in speech enhancement (SE) research, enhancing the quality of desired speech in environments with strong noise and interfering speakers remains challenging. In this paper, we extend the application of the recently…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-07 Jianwei Yu , Yi Luo , Hangting Chen , Rongzhi Gu , Chao Weng

Recent work has shown that it is possible to train an $\textit{unsupervised}$ automatic speech recognition (ASR) system using only unpaired audio and text. Existing unsupervised ASR methods assume that no labeled data can be used for…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-19 Tatiana Likhomanenko , Loren Lugosch , Ronan Collobert

Self-supervised learning (SSL) has been able to leverage unlabeled data to boost the performance of automatic speech recognition (ASR) models when we have access to only a small amount of transcribed speech data. However, this raises the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-06 Reem Gody , David Harwath

We propose a new speaker diarization system based on a recently introduced unsupervised clustering technique namely, generative adversarial network mixture model (GANMM). The proposed system uses x-vectors as front-end representation.…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-28 Monisankha Pal , Manoj Kumar , Raghuveer Peri , Shrikanth Narayanan

Time-Scale Modification (TSM) of speech aims to alter the playback rate of audio without changing its pitch. While classical methods like Waveform Similarity-based Overlap-Add (WSOLA) provide strong baselines, they often introduce artifacts…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-06 Dyah A. M. G. Wisnu , Ryandhimas E. Zezario , Stefano Rini , Fo-Rui Li , Yan-Tsung Peng , Hsin-Min Wang , Yu Tsao

In self-supervised learning for speaker recognition, pseudo labels are useful as the supervision signals. It is a known fact that a speaker recognition model doesn't always benefit from pseudo labels due to their unreliability. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-15 Ruijie Tao , Kong Aik Lee , Rohan Kumar Das , Ville Hautamäki , Haizhou Li

We propose the application of a semi-supervised learning method to improve the performance of acoustic modelling for automatic speech recognition based on deep neural net- works. As opposed to unsupervised initialisation followed by…

Machine Learning · Statistics 2016-10-04 Akash Kumar Dhaka , Giampiero Salvi