English
Related papers

Related papers: Towards Better Domain Adaptation for Self-supervis…

200 papers

Source separation can improve automatic speech recognition (ASR) under multi-party meeting scenarios by extracting single-speaker signals from overlapped speech. Despite the success of self-supervised learning models in single-channel…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-04 Yuang Li , Xianrui Zheng , Philip C. Woodland

Speech emotion recognition (SER) has made significant strides with the advent of powerful self-supervised learning (SSL) models. However, the generalization of these models to diverse languages and emotional expressions remains a challenge.…

Computation and Language · Computer Science 2024-08-16 Mohamed Osman , Daniel Z. Kaplan , Tamer Nadeem

This paper focuses on the unsupervised domain adaptation of transferring the knowledge from the source domain to the target domain in the context of semantic segmentation. Existing approaches usually regard the pseudo label as the ground…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Zhedong Zheng , Yi Yang

Thanks to the rise of self-supervised learning, automatic speech recognition (ASR) systems now achieve near-human performance on a wide variety of datasets. However, they still lack generalization capability and are not robust to domain…

Machine Learning · Computer Science 2023-03-15 Lucas Maison , Yannick Estève

Contextualized word embeddings such as ELMo and BERT provide a foundation for strong performance across a wide range of natural language processing tasks by pretraining on large corpora of unlabeled text. However, the applicability of this…

Computation and Language · Computer Science 2019-09-06 Xiaochuang Han , Jacob Eisenstein

Unsupervised domain adaptation of speech signal aims at adapting a well-trained source-domain acoustic model to the unlabeled data from target domain. This can be achieved by adversarial training of deep neural network (DNN) acoustic models…

Computation and Language · Computer Science 2019-05-01 Zhong Meng , Zhuo Chen , Vadim Mazalov , Jinyu Li , Yifan Gong

The massive growth of self-supervised learning (SSL) has been witnessed in language, vision, speech, and audio domains over the past few years. While discrete label prediction is widely adopted for other modalities, the state-of-the-art…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-20 Sanyuan Chen , Yu Wu , Chengyi Wang , Shujie Liu , Daniel Tompkins , Zhuo Chen , Furu Wei

Speech recognition systems often struggle with data domains that have not been included in the training. To address this, unsupervised domain adaptation has been explored with ensemble and multi-stage teacher-student training methods…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-14 Rehan Ahmad , Muhammad Umar Farooq , Qihang Feng , Thomas Hain

The performance of automatic speech recognition models often degenerates on domains not covered by the training data. Domain adaptation can address this issue, assuming the availability of the target domain data in the target language.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-17 Han Zhu , Gaofeng Cheng , Qingwei Zhao , Pengyuan Zhang

Unsupervised single-channel overlapped speech recognition is one of the hardest problems in automatic speech recognition (ASR). Permutation invariant training (PIT) is a state of the art model-based approach, which applies a single neural…

Computation and Language · Computer Science 2017-12-27 Zhehuai Chen , Jasha Droppo , Jinyu Li , Wayne Xiong

In this paper, we initiate the concern of enhancing the spoofing robustness of the automatic speaker verification (ASV) system, without the primary presence of a separate countermeasure module. We start from the standard ASV framework of…

Sound · Computer Science 2022-04-27 Xuechen Liu , Md Sahidullah , Tomi Kinnunen

State-of-the-art speaker recognition systems comprise an x-vector (or i-vector) speaker embedding front-end followed by a probabilistic linear discriminant analysis (PLDA) backend. The effectiveness of these components relies on the…

Machine Learning · Computer Science 2020-04-22 Kong Aik Lee , Qiongqiong Wang , Takafumi Koshinaka

The goal of self-supervised learning (SSL) for automatic speech recognition (ASR) is to learn good speech representations from a large amount of unlabeled speech for the downstream ASR task. However, most SSL frameworks do not consider…

Computation and Language · Computer Science 2022-01-27 Yiming Wang , Jinyu Li , Heming Wang , Yao Qian , Chengyi Wang , Yu Wu

Speech-based depression detection (SDD) has emerged as a non-invasive and scalable alternative to conventional clinical assessments. However, existing methods still struggle to capture robust depression-related speech characteristics, which…

Computation and Language · Computer Science 2026-01-22 Yuxin Li , Eng Siong Chng , Cuntai Guan

Domain adaptation (DA) aims to transfer knowledge from a label-rich and related domain (source domain) to a label-scare domain (target domain). Pseudo-labeling has recently been widely explored and used in DA. However, this line of research…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Yunlong Zhang , Changxing Jing , Huangxing Lin , Chaoqi Chen , Yue Huang , Xinghao Ding , Yang Zou

Automated speaking assessment (ASA) typically involves automatic speech recognition (ASR) and hand-crafted feature extraction from the ASR transcript of a learner's speech. Recently, self-supervised learning (SSL) has shown stellar…

Sound · Computer Science 2025-03-04 Tien-Hong Lo , Fu-An Chao , Tzu-I Wu , Yao-Ting Sung , Berlin Chen

Speaker verification system trained on one domain usually suffers performance degradation when applied to another domain. To address this challenge, researchers commonly use feature distribution matching-based methods in unsupervised domain…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-23 Wen Huang , Bing Han , Zhengyang Chen , Shuai Wang , Yanmin Qian

Speech impairments resulting from congenital disorders, such as cerebral palsy, down syndrome, or apert syndrome, as well as acquired brain injuries due to stroke, traumatic accidents, or tumors, present major challenges to automatic speech…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-17 Niclas Pokel , Pehuén Moure , Roman Boehringer , Shih-Chii Liu , Yingqiang Gao

Transformer-based audio self-supervised learning (SSL) models commonly use spectrograms, vision-style Transformers, and masked modeling objectives. However, convolutional patchification with temporal downsampling lowers the effective…

Sound · Computer Science 2026-05-15 Kohei Yamamoto , Kosuke Okusa

WiFi sensing is an emerging technology that utilizes wireless signals for various sensing applications. However, the reliance on supervised learning, the scarcity of labelled data, and the incomprehensible channel state information (CSI)…

Signal Processing · Electrical Eng. & Systems 2024-10-04 B. Barahimi , H. Tabassum , M. Omer , O. Waqar