中文
相关论文

相关论文: Leveraging ASR Pretrained Conformers for Speaker V…

200 篇论文

The adoption of advanced deep learning architectures in stuttering detection (SD) tasks is challenging due to the limited size of the available datasets. To this end, this work introduces the application of speech embeddings extracted from…

声音 · 计算机科学 2023-06-02 Shakeel A. Sheikh , Md Sahidullah , Fabrice Hirsch , Slim Ouni

We present a frontend for improving robustness of automatic speech recognition (ASR), that jointly implements three modules within a single model: acoustic echo cancellation, speech enhancement, and speech separation. This is achieved by…

音频与语音处理 · 电气工程与系统科学 2021-11-22 Tom O'Malley , Arun Narayanan , Quan Wang , Alex Park , James Walker , Nathan Howard

Self-supervised learning (SSL) foundation models have emerged as powerful, domain-agnostic, general-purpose feature extractors applicable to a wide range of tasks. Such models pre-trained on human speech have demonstrated high…

机器学习 · 计算机科学 2025-01-22 Eklavya Sarkar , Mathew Magimai. -Doss

Fine-tuning pretrained language models (LMs) is a popular approach to automatic speech recognition (ASR) error detection during post-processing. While error detection systems often take advantage of statistical language archetypes captured…

计算与语言 · 计算机科学 2021-08-05 Seongmin Park , Dongchan Shin , Sangyoun Paik , Subong Choi , Alena Kazakova , Jihwa Lee

While significant improvements have been made in recent years in terms of end-to-end automatic speech recognition (ASR) performance, such improvements were obtained through the use of very large neural networks, unfit for embedded use on…

计算与语言 · 计算机科学 2020-03-25 Alex Bie , Bharat Venkitesh , Joao Monteiro , Md. Akmal Haidar , Mehdi Rezagholizadeh

Speaker extraction aims to extract target speech signal from a multi-talker environment with interference speakers and surrounding noise, given the target speaker's reference information. Most speaker extraction systems achieve satisfactory…

音频与语音处理 · 电气工程与系统科学 2022-08-12 Chengyun Deng , Shiqian Ma , Yi Zhang , Yongtao Sha , Hui Zhang , Hui Song , Xiangang Li

In far-field speaker verification, the performance of speaker embeddings is susceptible to degradation when there is a mismatch between the conditions of enrollment and test speech. To solve this problem, we propose the feature-level and…

声音 · 计算机科学 2021-06-18 Li Zhang , Qing Wang , Kong Aik Lee , Lei Xie , Haizhou Li

While Automatic Speech Recognition (ASR) models have shown significant advances with the introduction of unsupervised or self-supervised training techniques, these improvements are still only limited to a subsection of languages and…

计算与语言 · 计算机科学 2023-10-19 Theresa Pekarek Rosin , Stefan Wermter

Recently, there has been an increasing interest in two-pass streaming end-to-end speech recognition (ASR) that incorporates a 2nd-pass rescoring model on top of the conventional 1st-pass streaming ASR model to improve recognition accuracy…

计算与语言 · 计算机科学 2022-11-17 Suyoun Kim , Ke Li , Lucas Kabela , Rongqing Huang , Jiedan Zhu , Ozlem Kalinli , Duc Le

Smart devices serviced by large-scale AI models necessitates user data transfer to the cloud for inference. For speech applications, this means transferring private user information, e.g., speaker identity. Our paper proposes a…

音频与语音处理 · 电气工程与系统科学 2023-07-26 Md Asif Jalal , Pablo Peso Parada , Jisi Zhang , Karthikeyan Saravanan , Mete Ozay , Myoungji Han , Jung In Lee , Seokyeong Jung

Current ASR systems are mainly trained and evaluated at the utterance level. Long range cross utterance context can be incorporated. A key task is to derive a suitable compact representation of the most relevant history contexts. In…

音频与语音处理 · 电气工程与系统科学 2023-06-27 Mingyu Cui , Jiawen Kang , Jiajun Deng , Xi Yin , Yutao Xie , Xie Chen , Xunying Liu

Speech separation has been successfully applied as a frontend processing module of conversation transcription systems thanks to its ability to handle overlapped speech and its flexibility to combine with downstream tasks such as automatic…

音频与语音处理 · 电气工程与系统科学 2021-07-06 Jian Wu , Zhuo Chen , Sanyuan Chen , Yu Wu , Takuya Yoshioka , Naoyuki Kanda , Shujie Liu , Jinyu Li

Bootstrapping speech recognition on limited data resources has been an area of active research for long. The recent transition to all-neural models and end-to-end (E2E) training brought along particular challenges as these models are known…

音频与语音处理 · 电气工程与系统科学 2021-06-21 Manuel Giollo , Deniz Gunceler , Yulan Liu , Daniel Willett

Self-supervised learning (SSL) based models have been shown to generate powerful representations that can be used to improve the performance of downstream speech tasks. Several state-of-the-art SSL models are available, and each of these…

计算与语言 · 计算机科学 2023-02-21 A Arunkumar , Vrunda N Sukhadia , S. Umesh

Self-supervised learning (SSL) based speech foundation models have been applied to a wide range of ASR tasks. However, their application to dysarthric and elderly speech via data-intensive parameter fine-tuning is confronted by in-domain…

音频与语音处理 · 电气工程与系统科学 2024-07-22 Shujie Hu , Xurong Xie , Mengzhe Geng , Zengrui Jin , Jiajun Deng , Guinan Li , Yi Wang , Mingyu Cui , Tianzi Wang , Helen Meng , Xunying Liu

Speech emotion recognition (SER) is the task of recognising human's emotional states from speech. SER is extremely prevalent in helping dialogue systems to truly understand our emotions and become a trustworthy human conversational partner.…

声音 · 计算机科学 2022-10-27 Zhao Ren , Thanh Tam Nguyen , Yi Chang , Björn W. Schuller

Adapting an automatic speech recognition (ASR) system to unseen noise environments is crucial. Integrating adapters into neural networks has emerged as a potent technique for transfer learning. This study thoroughly investigates…

声音 · 计算机科学 2024-06-05 Hao Shi , Tatsuya Kawahara

Speech-enabled systems typically first convert audio to text through an automatic speech recognition (ASR) model and then feed the text to downstream natural language processing (NLP) modules. The errors of the ASR system can seriously…

计算与语言 · 计算机科学 2021-03-26 Tong Cui , Jinghui Xiao , Liangyou Li , Xin Jiang , Qun Liu

Modern ASR systems are typically trained on large-scale pseudo-labeled, in-the-wild data spanning multiple domains. While such heterogeneous data benefit generalist models designed for broad deployment, they pose challenges for specialist…

The application of speech self-supervised learning (SSL) models has achieved remarkable performance in speaker verification (SV). However, there is a computational cost hurdle in employing them, which makes development and deployment…

音频与语音处理 · 电气工程与系统科学 2023-06-09 Jungwoo Heo , Chan-yeong Lim , Ju-ho Kim , Hyun-seo Shin , Ha-Jin Yu