English
Related papers

Related papers: Towards Better Domain Adaptation for Self-supervis…

200 papers

Self-supervised learning (SSL) models have achieved considerable improvements in automatic speech recognition (ASR). In addition, ASR performance could be further improved if the model is dedicated to audio content information learning…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-08 Genshun Wan , Tan Liu , Hang Chen , Jia Pan , Cong Liu , Zhongfu Ye

Recent advancements in Deep and Self-Supervised Learning (SSL) have led to substantial improvements in Speech Emotion Recognition (SER) performance, reaching unprecedented levels. However, obtaining sufficient amounts of accurately labeled…

Computation and Language · Computer Science 2025-02-25 Bulat Khaertdinov , Pedro Jeuris , Annanda Sousa , Enrique Hortal

Automatic Speech Recognition (ASR) systems often struggle to accurately process children's speech due to its distinct and highly variable acoustic and linguistic characteristics. While recent advancements in self-supervised learning (SSL)…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-01 Abhijit Sinha , Hemant Kumar Kathania , Sudarsana Reddy Kadiri , Shrikanth Narayanan

Self-Supervised Learning (SSL) is a paradigm that leverages unlabeled data for model training. Empirical studies show that SSL can achieve promising performance in distribution shift scenarios, where the downstream and training…

Machine Learning · Computer Science 2023-12-13 Xuyang Zhao , Tianqi Du , Yisen Wang , Jun Yao , Weiran Huang

Aspect-Target Sentiment Classification (ATSC) is a subtask of Aspect-Based Sentiment Analysis (ABSA), which has many applications e.g. in e-commerce, where data and insights from reviews can be leveraged to create value for businesses and…

Computation and Language · Computer Science 2019-11-20 Alexander Rietzler , Sebastian Stabinger , Paul Opitz , Stefan Engl

The amount of labeled data to train models for speech tasks is limited for most languages, however, the data scarcity is exacerbated for speech translation which requires labeled data covering two different languages. To address this issue,…

Computation and Language · Computer Science 2022-10-20 Changhan Wang , Hirofumi Inaguma , Peng-Jen Chen , Ilia Kulikov , Yun Tang , Wei-Ning Hsu , Michael Auli , Juan Pino

Most semi-supervised learning (SSL) models entail complex structures and iterative training processes as well as face difficulties in interpreting their predictions to users. To address these issues, this paper proposes a new interpretable…

Neural and Evolutionary Computing · Computer Science 2023-06-26 Farhad Pourpanah , Chee Peng Lim , Ali Etemad , Q. M. Jonathan Wu

In spite of the recent success of Dialogue Act (DA) classification, the majority of prior works focus on text-based classification with oracle transcriptions, i.e. human transcriptions, instead of Automatic Speech Recognition (ASR)'s…

Computation and Language · Computer Science 2018-10-18 Xuanli He , Quan Hung Tran , William Havard , Laurent Besacier , Ingrid Zukerman , Gholamreza Haffari

The excellent generalization ability of self-supervised learning (SSL) for speech foundation models has garnered significant attention. HuBERT is a successful example that utilizes offline clustering to convert speech features into discrete…

Computation and Language · Computer Science 2023-06-16 Ziyang Ma , Zhisheng Zheng , Guanrou Yang , Yu Wang , Chao Zhang , Xie Chen

Self-supervised learning (SSL) based discrete speech representations are highly compact and domain adaptable. In this paper, SSL discrete speech features extracted from WavLM models are used as additional cross-utterance acoustic context…

Computation and Language · Computer Science 2025-06-11 Mingyu Cui , Yifan Yang , Jiajun Deng , Jiawen Kang , Shujie Hu , Tianzi Wang , Zhaoqing Li , Shiliang Zhang , Xie Chen , Xunying Liu

On-device Automatic Speech Recognition (ASR) models trained on speech data of a large population might underperform for individuals unseen during training. This is due to a domain shift between user data and the original training data,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-23 Jisi Zhang , Vandana Rajan , Haaris Mehmood , David Tuckey , Pablo Peso Parada , Md Asif Jalal , Karthikeyan Saravanan , Gil Ho Lee , Jungin Lee , Seokyeong Jung

While Automatic Speech Recognition (ASR) models have shown significant advances with the introduction of unsupervised or self-supervised training techniques, these improvements are still only limited to a subsection of languages and…

Computation and Language · Computer Science 2023-10-19 Theresa Pekarek Rosin , Stefan Wermter

Recently self-supervised learning has emerged as an effective approach to improve the performance of automatic speech recognition (ASR). Under such a framework, the neural network is usually pre-trained with massive unlabeled data and then…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-16 Songjun Cao , Yueteng Kang , Yanzhe Fu , Xiaoshuo Xu , Sining Sun , Yike Zhang , Long Ma

Personalizing automatic speech recognition (ASR) systems for non-normative speech, such as dysarthric and aphasic speech, is challenging. While speaker-specific fine-tuning (SS-FT) is widely used, it is typically initialized directly from a…

Sound · Computer Science 2026-03-17 Shan Jiang , Jiawen Qi , Chuanbing Huo , Yingqiang Gao , Qinyu Chen

Most existing automatic speech recognition (ASR) research evaluate models using in-domain datasets. However, they seldom evaluate how they generalize across diverse speech contexts. This study addresses this gap by benchmarking seven Akan…

Automatic Speech Recognition (ASR) systems have found their use in numerous industrial applications in very diverse domains. Since domain-specific systems perform better than their generic counterparts on in-domain evaluation, the need for…

Computation and Language · Computer Science 2021-10-26 Saket Dingliwal , Ashish Shenoy , Sravan Bodapati , Ankur Gandhe , Ravi Teja Gadde , Katrin Kirchhoff

Self-supervised pre-trained speech models have strongly improved speech recognition, yet they are still sensitive to domain shifts and accented or atypical speech. Many of these models rely on quantisation or clustering to learn discrete…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-06 Jakob Poncelet , Hugo Van hamme

Recently, there has been a vast interest in self-supervised learning (SSL) where the model is pre-trained on large scale unlabeled data and then fine-tuned on a small labeled dataset. The common wisdom is that SSL helps resource-limited…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-13 Chengyi Wang , Yu Wu , Shujie Liu , Jinyu Li , Yao Qian , Kenichi Kumatani , Furu Wei

Large performance degradation is often observed for speaker ver-ification systems when applied to a new domain dataset. Givenan unlabeled target-domain dataset, unsupervised domain adaptation(UDA) methods, which usually leverage adversarial…

Sound · Computer Science 2021-09-01 Zhengyang Chen , Shuai Wang , Yanmin Qian

Automatic recognition of dysarthric speech remains a highly challenging task to date. Neuro-motor conditions and co-occurring physical disabilities create difficulty in large-scale data collection for ASR system development. Adapting SSL…

Sound · Computer Science 2024-01-02 Huimeng Wang , Zengrui Jin , Mengzhe Geng , Shujie Hu , Guinan Li , Tianzi Wang , Haoning Xu , Xunying Liu