English
Related papers

Related papers: ASR Adaptation for E-commerce Chatbots using Cross…

200 papers

In spite of the recent success of Dialogue Act (DA) classification, the majority of prior works focus on text-based classification with oracle transcriptions, i.e. human transcriptions, instead of Automatic Speech Recognition (ASR)'s…

Computation and Language · Computer Science 2018-10-18 Xuanli He , Quan Hung Tran , William Havard , Laurent Besacier , Ingrid Zukerman , Gholamreza Haffari

Automatic Speech Recognition (ASR) systems are known to exhibit difficulties when transcribing children's speech. This can mainly be attributed to the absence of large children's speech corpora to train robust ASR models and the resulting…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-22 Jenthe Thienpondt , Kris Demuynck

Integrating audio encoders with LLMs through connectors has enabled these models to process and comprehend audio modalities, significantly enhancing speech-to-text tasks, including automatic speech recognition (ASR) and automatic speech…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-18 Hongfei Xue , Wei Ren , Xuelong Geng , Kun Wei , Longhao Li , Qijie Shao , Linju Yang , Kai Diao , Lei Xie

As human-machine voice interfaces provide easy access to increasingly intelligent machines, many state-of-the-art automatic speech recognition (ASR) systems are proposed. However, commercial ASR systems usually have poor performance on…

Computation and Language · Computer Science 2023-09-28 Yanan Jia

Conversational automatic speech recognition (ASR) is a task to recognize conversational speech including multiple speakers. Unlike sentence-level ASR, conversational ASR can naturally take advantages from specific characteristics of…

Sound · Computer Science 2022-02-18 Kun Wei , Yike Zhang , Sining Sun , Lei Xie , Long Ma

Adapting large language model (LLM)-based automatic speech recognition (ASR) systems to new domains using text-only data is a significant yet underexplored challenge. Standard fine-tuning of the LLM on the target domain text often disrupts…

Recently, self-supervised learning (SSL) from unlabelled speech data has gained increased attention in the automatic speech recognition (ASR) community. Typical SSL methods include autoregressive predictive coding (APC), Wav2vec2.0, and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-02 Ruchao Fan , Yunzheng Zhu , Jinhan Wang , Abeer Alwan

Large language models (LLM) have demonstrated the ability to understand human language by leveraging large amount of text data. Automatic speech recognition (ASR) systems are often limited by available transcribed speech data and benefit…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-26 Prashanth Gurunath Shivakumar , Jari Kolehmainen , Aditya Gourav , Yi Gu , Ankur Gandhe , Ariya Rastrow , Ivan Bulyko

End-to-end automatic speech recognition (ASR) systems are increasingly popular due to their relative architectural simplicity and competitive performance. However, even though the average accuracy of these systems may be high, the…

Computation and Language · Computer Science 2021-09-14 Chao-Han Huck Yang , Linda Liu , Ankur Gandhe , Yile Gu , Anirudh Raju , Denis Filimonov , Ivan Bulyko

This paper presents the architecture and performance of a novel Multilingual Automatic Speech Recognition (ASR) system developed by the Transsion Speech Team for Track 1 of the MLC-SLM 2025 Challenge. The proposed system comprises three key…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-22 Xiaoxiao Li , An Zhu , Youhai Jiang , Fengjie Zhu

We develop a large language model (LLM) based automatic speech recognition (ASR) system that can be contextualized by providing keywords as prior information in text prompts. We adopt decoder-only architecture and use our in-house LLM,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-14 Kento Nozawa , Takashi Masuko , Toru Taniguchi

Bootstrapping speech recognition on limited data resources has been an area of active research for long. The recent transition to all-neural models and end-to-end (E2E) training brought along particular challenges as these models are known…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-21 Manuel Giollo , Deniz Gunceler , Yulan Liu , Daniel Willett

We present a novel Speech Augmented Language Model (SALM) with {\em multitask} and {\em in-context} learning capabilities. SALM comprises a frozen text LLM, a audio encoder, a modality adapter module, and LoRA layers to accommodate speech…

Computation and Language · Computer Science 2023-10-17 Zhehuai Chen , He Huang , Andrei Andrusenko , Oleksii Hrinchuk , Krishna C. Puvvada , Jason Li , Subhankar Ghosh , Jagadeesh Balam , Boris Ginsburg

Automatic Speech Recognition (ASR) is the interdisciplinary subfield of computational linguistics that develops methodologies and technologies that enables the recognition and translation of spoken language into text by computers. It…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-09 Rachit Shukla

General-purpose automatic speech recognition (ASR) systems do not always perform well in goal-oriented dialogue. Existing ASR correction methods rely on prior user data or named entities. We extend correction to tasks that have no prior…

Computation and Language · Computer Science 2025-01-13 Yuya Asano , Sabit Hassan , Paras Sharma , Anthony Sicilia , Katherine Atwell , Diane Litman , Malihe Alikhani

Accurate recognition of slot values such as domain specific words or named entities by automatic speech recognition (ASR) systems forms the core of the Goal-oriented Dialogue Systems. Although it is a critical step with direct impact on…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-21 Dhanush Bekal , Ashish Shenoy , Monica Sunkara , Sravan Bodapati , Katrin Kirchhoff

Automatic speech recognition systems have undoubtedly advanced with the integration of multilingual and multitask models such as Whisper, which have shown a promising ability to understand and process speech across a wide range of…

Computation and Language · Computer Science 2025-04-14 Xabier de Zuazo , Eva Navas , Ibon Saratxaga , Inma Hernáez Rioja

It has been shown that the intelligibility of noisy speech can be improved by speech enhancement algorithms. However, speech enhancement has not been established as an effective frontend for robust automatic speech recognition (ASR) in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-22 Yufeng Yang , Ashutosh Pandey , DeLiang Wang

Scores from traditional confidence classifiers (CCs) in automatic speech recognition (ASR) systems lack universal interpretation and vary with updates to the underlying confidence or acoustic models (AMs). In this work, we build…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-02 Amber Afshan , Kshitiz Kumar , Jian Wu

Integrating Automatic Speech Recognition (ASR) into Speech Emotion Recognition (SER) enhances modeling by providing linguistic context. However, conventional feature fusion faces performance bottlenecks, and multi-task learning often…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-27 Chia-Yu Lee , Huang-Cheng Chou , Tzu-Quan Lin , Yuanchao Li , Ya-Tse Wu , Shrikanth Narayanan , Chi-Chun Lee