中文
相关论文

相关论文: Task Arithmetic can Mitigate Synthetic-to-Real Gap…

200 篇论文

General-purpose automatic speech recognition (ASR) systems do not always perform well in goal-oriented dialogue. Existing ASR correction methods rely on prior user data or named entities. We extend correction to tasks that have no prior…

计算与语言 · 计算机科学 2025-01-13 Yuya Asano , Sabit Hassan , Paras Sharma , Anthony Sicilia , Katherine Atwell , Diane Litman , Malihe Alikhani

Automatic recognition of dysarthric speech remains a highly challenging task to date. Neuro-motor conditions and co-occurring physical disabilities create difficulty in large-scale data collection for ASR system development. Adapting SSL…

声音 · 计算机科学 2024-01-02 Huimeng Wang , Zengrui Jin , Mengzhe Geng , Shujie Hu , Guinan Li , Tianzi Wang , Haoning Xu , Xunying Liu

Multilingual end-to-end(E2E) models have shown a great potential in the expansion of the language coverage in the realm of automatic speech recognition(ASR). In this paper, we aim to enhance the multilingual ASR performance in two ways,…

计算与语言 · 计算机科学 2021-10-18 Rimita Lahiri , Kenichi Kumatani , Eric Sun , Yao Qian

Automatic speech recognition (ASR) systems often falter while processing stuttering-related disfluencies -- such as involuntary blocks and word repetitions -- yielding inaccurate transcripts. A critical barrier to progress is the scarcity…

音频与语音处理 · 电气工程与系统科学 2024-10-03 Dena Mujtaba , Nihar R. Mahapatra , Megan Arney , J. Scott Yaruss , Caryn Herring , Jia Bin

Spoken question answering (SQA) is challenging due to complex reasoning on top of the spoken documents. The recent studies have also shown the catastrophic impact of automatic speech recognition (ASR) errors on SQA. Therefore, this work…

计算与语言 · 计算机科学 2019-04-18 Chia-Hsuan Lee , Yun-Nung Chen , Hung-Yi Lee

Building a high quality automatic speech recognition (ASR) system with limited training data has been a challenging task particularly for a narrow target population. Open-sourced ASR systems, trained on sufficient data from adults, are…

音频与语音处理 · 电气工程与系统科学 2020-11-18 Liu Chen , Meysam Asgari

Modern neural networks have greatly improved performance across speech recognition benchmarks. However, gains are often driven by frequent words with limited semantic weight, which can obscure meaningful differences in word error rate, the…

计算与语言 · 计算机科学 2026-04-21 Lasse Borgholt , Jakob Havtorn , Christian Igel , Lars Maaløe , Zheng-Hua Tan

Text injection for automatic speech recognition (ASR), wherein unpaired text-only data is used to supplement paired audio-text data, has shown promising improvements for word error rate. This study examines the use of text injection for…

计算与语言 · 计算机科学 2023-08-16 Shaan Bijwadia , Shuo-yiin Chang , Weiran Wang , Zhong Meng , Hao Zhang , Tara N. Sainath

Recent advances in synthetic speech quality have enabled us to train text-to-speech (TTS) systems by using synthetic corpora. However, merely increasing the amount of synthetic data is not always advantageous for improving training…

音频与语音处理 · 电气工程与系统科学 2022-07-01 Eunwoo Song , Ryuichi Yamamoto , Ohsung Kwon , Chan-Ho Song , Min-Jae Hwang , Suhyeon Oh , Hyun-Wook Yoon , Jin-Seob Kim , Jae-Min Kim

Generative models have gained significant attention for their ability to produce realistic synthetic data that supplements the quantity of real-world datasets. While recent studies show performance improvements in wireless sensing tasks by…

机器学习 · 计算机科学 2025-07-01 Chen Gong , Bo Liang , Wei Gao , Chenren Xu

Multimodal speech recognition aims to improve the performance of automatic speech recognition (ASR) systems by leveraging additional visual information that is usually associated to the audio input. While previous approaches make crucial…

声音 · 计算机科学 2022-04-29 Dan Oneata , Horia Cucu

Recently, end-to-end (E2E) automatic speech recognition (ASR) models have made great strides and exhibit excellent performance in general speech recognition. However, there remain several challenging scenarios that E2E models are not…

计算与语言 · 计算机科学 2023-06-16 Zheng Liang , Zheshu Song , Ziyang Ma , Chenpeng Du , Kai Yu , Xie Chen

Automatic Speech Recognition (ASR) is widely used within consumer devices such as mobile phones. Recently, personalization or on-device model fine-tuning has shown that adaptation of ASR models towards target user speech improves their…

音频与语音处理 · 电气工程与系统科学 2025-04-08 Haaris Mehmood , Karthikeyan Saravanan , Pablo Peso Parada , David Tuckey , Mete Ozay , Gil Ho Lee , Jungin Lee , Seokyeong Jung

It is estimated that around 70 million people worldwide are affected by a speech disorder called stuttering. With recent advances in Automatic Speech Recognition (ASR), voice assistants are increasingly useful in our everyday lives. Many…

音频与语音处理 · 电气工程与系统科学 2022-02-14 Olabanji Shonibare , Xiaosu Tong , Venkatesh Ravichandran

This paper investigates the use of unsupervised text-to-speech synthesis (TTS) as a data augmentation method to improve accented speech recognition. TTS systems are trained with a small amount of accented speech training data and their…

计算与语言 · 计算机科学 2024-07-08 Cong-Thanh Do , Shuhei Imai , Rama Doddipatla , Thomas Hain

The advancement of Artificial Intelligence (AI) has created opportunities for e-learning, particularly in automated assessment systems that reduce educators' workload and provide timely feedback to students. However, developing effective…

计算机与社会 · 计算机科学 2025-02-11 Long Zhang , Meng Zhang , Wei Lin Wang , Yu Luo

In this paper, we explore the benefits of incorporating context into a Recurrent Neural Network (RNN-T) based Automatic Speech Recognition (ASR) model to improve the speech recognition for virtual assistants. Specifically, we use meta…

音频与语音处理 · 电气工程与系统科学 2021-06-17 Swayambhu Nath Ray , Soumyajit Mitra , Raghavendra Bilgi , Sri Garimella

For real-world speech recognition applications, noise robustness is still a challenge. In this work, we adopt the teacher-student (T/S) learning technique using a parallel clean and noisy corpus for improving automatic speech recognition…

音频与语音处理 · 电气工程与系统科学 2019-03-19 Ladislav Mošner , Minhua Wu , Anirudh Raju , Sree Hari Krishnan Parthasarathi , Kenichi Kumatani , Shiva Sundaram , Roland Maas , Björn Hoffmeister

While modern Text-to-Speech (TTS) systems can produce natural-sounding speech, they remain unable to reproduce the full diversity found in natural speech data. We consider the distribution of all possible real speech samples that could be…

音频与语音处理 · 电气工程与系统科学 2023-05-26 Christoph Minixhofer , Ondřej Klejch , Peter Bell

Although end-to-end automatic speech recognition (E2E ASR) has achieved great performance in tasks that have numerous paired data, it is still challenging to make E2E ASR robust against noisy and low-resource conditions. In this study, we…

音频与语音处理 · 电气工程与系统科学 2021-06-08 Emiru Tsunoo , Kentaro Shibata , Chaitanya Narisetty , Yosuke Kashiwagi , Shinji Watanabe