English
Related papers

Related papers: Sample-Efficient Unsupervised Domain Adaptation of…

200 papers

Self-supervised learning (SSL)-based speech models are extensively used for full-stack speech processing. However, it has been observed that improving SSL-based speech representations using unlabeled speech for content-related tasks is…

Computation and Language · Computer Science 2024-06-14 Amit Meghanani , Thomas Hain

Modern software systems often have to cope with uncertain operation conditions, such as changing workloads or fluctuating interference in a wireless network. To ensure that these systems meet their goals these uncertainties have to be…

Software Engineering · Computer Science 2023-06-05 Federico Quin , Danny Weyns , Omid Gheibi

When the task of locating manipulation regions in partially-fake audio (PFA) involves cross-domain datasets, the performance of deep learning models drops significantly due to the shift between the source and target domains. To address this…

Sound · Computer Science 2024-07-12 Siding Zeng , Jiangyan Yi , Jianhua Tao , Yujie Chen , Shan Liang , Yong Ren , Xiaohui Zhang

Data-driven based approaches, in spite of great success in many tasks, have poor generalization when applied to unseen image domains, and require expensive cost of annotation especially for dense pixel prediction tasks such as semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Shuaijun Chen , Xu Jia , Jianzhong He , Yongjie Shi , Jianzhuang Liu

In this study, we aim to explore efficient tuning methods for speech self-supervised learning. Recent studies show that self-supervised learning (SSL) can learn powerful representations for different speech tasks. However, fine-tuning…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-31 Zih-Ching Chen , Chin-Lun Fu , Chih-Ying Liu , Shang-Wen Li , Hung-yi Lee

Modeling the speaker variability is a key challenge for automatic speech recognition (ASR) systems. In this paper, the learning hidden unit contributions (LHUC) based adaptation techniques with compact speaker dependent (SD) parameters are…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-09 Xurong Xie , Xunying Liu , Hui Chen , Hongan Wang

Automatic speech recognition (ASR) has been widely researched with supervised approaches, while many low-resourced languages lack audio-text aligned data, and supervised methods cannot be applied on them. In this work, we propose a…

Computation and Language · Computer Science 2018-08-14 Yi-Chen Chen , Chia-Hao Shen , Sung-Feng Huang , Hung-yi Lee

Current state-of-the-art dialogue systems heavily rely on extensive training datasets. However, challenges arise in domains where domain-specific training datasets are insufficient or entirely absent. To tackle this challenge, we propose a…

Computation and Language · Computer Science 2024-07-01 Yongkang Liu , Ercong Nie , Shi Feng , Zheng Hua , Zifeng Ding , Daling Wang , Yifei Zhang , Hinrich Schütze

Advancements in deep neural networks have allowed automatic speech recognition (ASR) systems to attain human parity on several publicly available clean speech datasets. However, even state-of-the-art ASR systems experience performance…

Computation and Language · Computer Science 2023-10-17 Chen Chen , Yuchen Hu , Chao-Han Huck Yang , Sabato Macro Siniscalchi , Pin-Yu Chen , Eng Siong Chng

Self-supervised learning (SSL) to learn high-level speech representations has been a popular approach to building Automatic Speech Recognition (ASR) systems in low-resource settings. However, the common assumption made in literature is that…

Computation and Language · Computer Science 2023-05-19 Ashish Seth , Lodagala V S V Durga Prasad , Sreyan Ghosh , S. Umesh

We investigated an enhancement and a domain adaptation approach to make speaker verification systems robust to perturbations of far-field speech. In the enhancement approach, using paired (parallel) reverberant-clean speech, we trained a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Phani Sankar Nidadavolu , Saurabh Kataria , Paola García-Perera , Jesús Villalba , Najim Dehak

Training speech recognizers with unpaired speech and text -- known as unsupervised speech recognition (UASR) -- is a crucial step toward extending ASR to low-resource languages in the long-tail distribution and enabling multimodal learning…

Computation and Language · Computer Science 2025-10-07 Liming Wang , Junrui Ni , Kai-Wei Chang , Saurabhchand Bhati , David Harwath , Mark Hasegawa-Johnson , James R. Glass

Due to privacy, storage, and other constraints, there is a growing need for unsupervised domain adaptation techniques in machine learning that do not require access to the data used to train a collection of source models. Existing methods…

Machine Learning · Computer Science 2023-06-01 Maohao Shen , Yuheng Bu , Gregory Wornell

Self-supervised learning of speech representations has achieved impressive results in improving automatic speech recognition (ASR). In this paper, we show that data selection is important for self-supervised learning. We propose a simple…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-06 Zhiyun Lu , Yongqiang Wang , Yu Zhang , Wei Han , Zhehuai Chen , Parisa Haghani

Contemporary domain adaptive semantic segmentation aims to address data annotation challenges by assuming that target domains are completely unannotated. However, annotating a few target samples is usually very manageable and worthwhile…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Jiaxing Huang , Dayan Guan , Aoran Xiao , Shijian Lu

State-of-the-art speaker recognition systems comprise a speaker embedding front-end followed by a probabilistic linear discriminant analysis (PLDA) back-end. The effectiveness of these components relies on the availability of a large amount…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-26 Qiongqiong Wang , Koji Okabe , Kong Aik Lee , Takafumi Koshinaka

The task of making speaker verification systems robust to adverse scenarios remain a challenging and an active area of research. We developed an unsupervised feature enhancement approach in log-filter bank domain with the end goal of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-18 Phani Sankar Nidadavolu , Saurabh Kataria , Jesús Villalba , Paola García-Perera , Najim Dehak

Best-performing speech models are trained on large amounts of data in the language they are meant to work for. However, most languages have sparse data, making training models challenging. This shortage of data is even more prevalent in…

Computation and Language · Computer Science 2024-10-08 David-Gabriel Ion , Răzvan-Alexandru Smădu , Dumitru-Clementin Cercel , Florin Pop , Mihaela-Claudia Cercel

Automatic recognition of disordered and elderly speech remains highly challenging tasks to date due to data scarcity. Parameter fine-tuning is often used to exploit the large quantities of non-aged and healthy speech pre-trained models,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-28 Tianzi Wang , Shoukang Hu , Jiajun Deng , Zengrui Jin , Mengzhe Geng , Yi Wang , Helen Meng , Xunying Liu

Speech production is a complex phenomenon, wherein the brain orchestrates a sequence of processes involving thought processing, motor planning, and the execution of articulatory movements. However, this intricate execution of various…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-06 Shakeel Ahmad Sheikh