中文
相关论文

相关论文: Confidence Score Based Conformer Speaker Adaptatio…

200 篇论文

Spoken question answering (SQA) is challenging due to complex reasoning on top of the spoken documents. The recent studies have also shown the catastrophic impact of automatic speech recognition (ASR) errors on SQA. Therefore, this work…

计算与语言 · 计算机科学 2019-04-18 Chia-Hsuan Lee , Yun-Nung Chen , Hung-Yi Lee

Accent variability has posed a huge challenge to automatic speech recognition~(ASR) modeling. Although one-hot accent vector based adaptation systems are commonly used, they require prior knowledge about the target accent and cannot handle…

声音 · 计算机科学 2022-04-22 Xun Gong , Yizhou Lu , Zhikai Zhou , Yanmin Qian

The utilization of speech Self-Supervised Learning (SSL) models achieves impressive performance on Automatic Speech Recognition (ASR). However, in low-resource language ASR, they encounter the domain mismatch problem between pre-trained and…

Automatic speech recognition (ASR) for conversational speech remains challenging due to the limited availability of large-scale, well-annotated multi-speaker dialogue data and the complex temporal dynamics of natural interactions.…

声音 · 计算机科学 2026-02-05 Máté Gedeon , Péter Mihajlik

Speaker Diarization (SD) systems are typically audio-based and operate independently of the ASR system in traditional speech transcription pipelines and can have speaker errors due to SD and/or ASR reconciliation, especially around speaker…

音频与语音处理 · 电气工程与系统科学 2024-06-26 Rohit Paturi , Xiang Li , Sundararajan Srinivasan

In recent years, self-supervised learning (SSL) has achieved tremendous success in various speech tasks due to its power to extract representations from massive unlabeled data. However, compared with tasks such as speech recognition (ASR),…

音频与语音处理 · 电气工程与系统科学 2022-11-14 Tianrui Wang , Xie Chen , Zhuo Chen , Shu Yu , Weibin Zhu

Attention layers are an integral part of modern end-to-end automatic speech recognition systems, for instance as part of the Transformer or Conformer architecture. Attention is typically multi-headed, where each head has an independent set…

计算与语言 · 计算机科学 2022-09-14 Kartik Audhkhasi , Yinghui Huang , Bhuvana Ramabhadran , Pedro J. Moreno

Automatic detection of speaker confidence is critical for adaptive computing but remains constrained by limited labelled data and the subjectivity of paralinguistic annotations. This paper proposes a semi-supervised hybrid framework that…

声音 · 计算机科学 2026-05-13 Adam Wynn , Jingyun Wang

End-to-end approaches for automatic speech recognition (ASR) benefit from directly modeling the probability of the word sequence given the input audio stream in a single neural network. However, compared to conventional ASR systems, these…

音频与语音处理 · 电气工程与系统科学 2020-02-19 Ankur Gandhe , Ariya Rastrow

This paper presents the architecture and performance of a novel Multilingual Automatic Speech Recognition (ASR) system developed by the Transsion Speech Team for Track 1 of the MLC-SLM 2025 Challenge. The proposed system comprises three key…

音频与语音处理 · 电气工程与系统科学 2025-08-22 Xiaoxiao Li , An Zhu , Youhai Jiang , Fengjie Zhu

An embedding-based speaker adaptive training (SAT) approach is proposed and investigated in this paper for deep neural network acoustic modeling. In this approach, speaker embedding vectors, which are a constant given a particular speaker,…

计算与语言 · 计算机科学 2017-10-20 Xiaodong Cui , Vaibhava Goel , George Saon

Modeling the errors of a speech recognizer can help simulate errorful recognized speech data from plain text, which has proven useful for tasks like discriminative language modeling, improving robustness of NLP systems, where limited or…

人工智能 · 计算机科学 2024-08-22 Prashant Serai , Peidong Wang , Eric Fosler-Lussier

In the realm of spoken language understanding (SLU), numerous natural language understanding (NLU) methodologies have been adapted by supplying large language models (LLMs) with transcribed speech instead of conventional written text. In…

Speech recognisers usually perform optimally only in a specific environment and need to be adapted to work well in another. For adaptation to a new speaker, there is often too little data for fine-tuning to be robust, and that data is…

音频与语音处理 · 电气工程与系统科学 2025-06-13 Rogier C. van Dalen , Shucong Zhang , Titouan Parcollet , Sourav Bhattacharya

Automatic speech recognition (ASR) systems often degrade on accented speech because acoustic-phonetic and prosodic shifts induce a mismatch to training data, making labeled accent adaptation costly. However, common pseudo-label selection…

计算与语言 · 计算机科学 2026-02-17 Ligong Lei , Wenwen Lu , Xudong Pang , Zaokere Kadeer , Aishan Wumaier

Fundamental modelling differences between hybrid and end-to-end (E2E) automatic speech recognition (ASR) systems create large diversity and complementarity among them. This paper investigates multi-pass rescoring and cross adaptation based…

音频与语音处理 · 电气工程与系统科学 2023-06-26 Mingyu Cui , Jiajun Deng , Shoukang Hu , Xurong Xie , Tianzi Wang , Shujie Hu , Mengzhe Geng , Boyang Xue , Xunying Liu , Helen Meng

Language modeling (LM) for automatic speech recognition (ASR) does not usually incorporate utterance level contextual information. For some domains like voice assistants, however, additional context, such as the time at which an utterance…

计算与语言 · 计算机科学 2021-06-04 Richard Diehl Martinez , Scott Novotney , Ivan Bulyko , Ariya Rastrow , Andreas Stolcke , Ankur Gandhe

Automatic speech recognition (ASR) has reached a level of accuracy in recent years, that even outperforms humans in transcribing speech to text. Nevertheless, all current ASR approaches show a certain weakness against ambient noise. To…

声音 · 计算机科学 2023-12-22 Christopher Simic , Tobias Bocklet

Language models (LMs) have been commonly adopted to boost the performance of automatic speech recognition (ASR) particularly in domain adaptation tasks. Conventional way of LM training treats all the words in corpora equally, resulting in…

计算与语言 · 计算机科学 2023-10-18 Yingyi Ma , Zhe Liu , Ozlem Kalinli

Current ASR systems are mainly trained and evaluated at the utterance level. Long range cross utterance context can be incorporated. A key task is to derive a suitable compact representation of the most relevant history contexts. In…

音频与语音处理 · 电气工程与系统科学 2023-06-27 Mingyu Cui , Jiawen Kang , Jiajun Deng , Xi Yin , Yutao Xie , Xie Chen , Xunying Liu