English
Related papers

Related papers: An Efficient Self-Learning Framework For Interacti…

200 papers

Automatic Speech Recognition (ASR) systems have found their use in numerous industrial applications in very diverse domains. Since domain-specific systems perform better than their generic counterparts on in-domain evaluation, the need for…

Computation and Language · Computer Science 2021-10-26 Saket Dingliwal , Ashish Shenoy , Sravan Bodapati , Ankur Gandhe , Ravi Teja Gadde , Katrin Kirchhoff

Automatic speech recognition (ASR) technologies today are primarily optimized for given datasets; thus, any changes in the application environment (e.g., acoustic conditions or topic domains) may inevitably degrade the performance. We can…

Computation and Language · Computer Science 2021-07-05 Heng-Jui Chang , Hung-yi Lee , Lin-shan Lee

Self-supervised pretraining for Automated Speech Recognition (ASR) has shown varied degrees of success. In this paper, we propose to jointly learn representations during pretraining from two different modalities: speech and text. The…

Computation and Language · Computer Science 2021-08-30 Zhehuai Chen , Yu Zhang , Andrew Rosenberg , Bhuvana Ramabhadran , Gary Wang , Pedro Moreno

Supervised ASR models have reached unprecedented levels of accuracy, thanks in part to ever-increasing amounts of labelled training data. However, in many applications and locales, only moderate amounts of data are available, which has led…

Automatic Speech Recognition (ASR) systems are known to exhibit difficulties when transcribing children's speech. This can mainly be attributed to the absence of large children's speech corpora to train robust ASR models and the resulting…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-22 Jenthe Thienpondt , Kris Demuynck

State-of-the-art large-scale universal speech models (USMs) show a decent automatic speech recognition (ASR) performance across multiple domains and languages. However, it remains a challenge for these models to recognize overlapped speech,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-31 Chenda Li , Yao Qian , Zhuo Chen , Naoyuki Kanda , Dongmei Wang , Takuya Yoshioka , Yanmin Qian , Michael Zeng

This paper describes noisy speech recognition for an augmented reality headset that helps verbal communication within real multiparty conversational environments. A major approach that has actively been studied in simulated environments is…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-18 Yicheng Du , Aditya Arie Nugraha , Kouhei Sekiguchi , Yoshiaki Bando , Mathieu Fontaine , Kazuyoshi Yoshii

Despite the impressive performance recently achieved by automatic speech recognition (ASR), we observe two primary challenges that hinder its broader applications: (1) The difficulty of introducing scalability into the model to support more…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-29 Zhongzhi Yu , Yang Zhang , Kaizhi Qian , Yonggan Fu , Yingyan Lin

Large Language Models (LLMs) have shown remarkable performance in multi-turn dialogue. However, in multi-turn dialogue, models still struggle to stay aligned with what has been established earlier, follow dependencies across many turns, and…

Computation and Language · Computer Science 2026-01-12 Jiawei Shen , Jia Zhu , Hanghui Guo , Weijie Shi , Yue Cui , Qingyu Niu , Guoqing Ma , Yidan Liang , Jingjiang Liu , Yiling Wang , Shimin Di , Jiajie Xu

Current speech-based LLMs are predominantly trained on extensive ASR and TTS datasets, excelling in tasks related to these domains. However, their ability to handle direct speech-to-speech conversations remains notably constrained. These…

Computation and Language · Computer Science 2024-11-05 Robin Shing-Hei Yuen , Timothy Tin-Long Tse , Jian Zhu

Recent advancements in supervised automatic speech recognition (ASR) have achieved remarkable performance, largely due to the growing availability of large transcribed speech corpora. However, most languages lack sufficient paired speech…

Computation and Language · Computer Science 2025-01-10 Junrui Ni , Liming Wang , Yang Zhang , Kaizhi Qian , Heting Gao , Mark Hasegawa-Johnson , Chang D. Yoo

In recent years, automatic speech recognition (ASR) models greatly improved transcription performance both in clean, low noise, acoustic conditions and in reverberant environments. However, all these systems rely on the availability of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-18 Francesco Nespoli , Daniel Barreda , Patrick A. Naylor

Recent years have witnessed remarkable progress in automatic speech recognition (ASR), driven by advances in model architectures and large-scale training data. However, two important aspects remain underexplored. First, Word Error Rate…

Computation and Language · Computer Science 2026-04-15 Peng Wang , Yanqiao Zhu , Zixuan Jiang , Qinyuan Chen , Xingjian Zhao , Xipeng Qiu , Wupeng Wang , Zhifu Gao , Xiangang Li , Kai Yu , Xie Chen

Goal-oriented conversational interfaces are designed to accomplish specific tasks and typically have interactions that tend to span multiple turns adhering to a pre-defined structure and a goal. However, conventional neural language models…

Computation and Language · Computer Science 2021-06-08 Ashish Shenoy , Sravan Bodapati , Katrin Kirchhoff

In spite of the recent success of Dialogue Act (DA) classification, the majority of prior works focus on text-based classification with oracle transcriptions, i.e. human transcriptions, instead of Automatic Speech Recognition (ASR)'s…

Computation and Language · Computer Science 2018-10-18 Xuanli He , Quan Hung Tran , William Havard , Laurent Besacier , Ingrid Zukerman , Gholamreza Haffari

Accents play a pivotal role in shaping human communication, enhancing our ability to convey and comprehend messages with clarity and cultural nuance. While there has been significant progress in Automatic Speech Recognition (ASR),…

Computation and Language · Computer Science 2025-06-24 Bonaventure F. P. Dossou

Automatic Speech Recognition (ASR) systems can be trained to achieve remarkable performance given large amounts of manually transcribed speech, but large labeled data sets can be difficult or expensive to acquire for all languages of…

Computation and Language · Computer Science 2022-03-22 Hanan Aldarmaki , Asad Ullah , Nazar Zaki

In the future robots will interact more and more with humans and will have to communicate naturally and efficiently. Automatic speech recognition systems (ASR) will play an important role in creating natural interactions and making robots…

Robotics · Computer Science 2020-11-13 Jonas Gonzalez-Billandon , Lukas Grasse , Matthew Tata , Alessandra Sciutti , Francesco Rea

The transcription quality of automatic speech recognition (ASR) systems degrades significantly when transcribing audios coming from unseen domains. We propose an unsupervised error correction method for unsupervised ASR domain adaption,…

Sound · Computer Science 2022-09-27 Long Mai , Julie Carson-Berndsen

In the design of customer relationship management (CRM) systems, accurately identifying customer types and offering personalized services are key to enhancing customer satisfaction and loyalty. However, this process faces the challenge of…

Sound · Computer Science 2025-07-24 Zhongsheng Wang , Sijie Wang , Jia Wang , Yung-I Liang , Yuxi Zhang , Jiamou Liu