English
Related papers

Related papers: Beyond the Utterance: An Empirical Study of Very L…

200 papers

The machine recognition of speech spoken at a distance from the microphones, known as far-field automatic speech recognition (ASR), has received a significant increase of attention in science and industry, which caused or was caused by an…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-22 Reinhold Haeb-Umbach , Jahn Heymann , Lukas Drude , Shinji Watanabe , Marc Delcroix , Tomohiro Nakatani

State-of-the-art ASR systems have achieved promising results by modeling local and global interactions separately. While the former can be computed efficiently, global interactions are usually modeled via attention mechanisms, which are…

Computation and Language · Computer Science 2023-05-30 Florian Mai , Juan Zuluaga-Gomez , Titouan Parcollet , Petr Motlicek

Recent advancements in supervised automatic speech recognition (ASR) have achieved remarkable performance, largely due to the growing availability of large transcribed speech corpora. However, most languages lack sufficient paired speech…

Computation and Language · Computer Science 2025-01-10 Junrui Ni , Liming Wang , Yang Zhang , Kaizhi Qian , Heting Gao , Mark Hasegawa-Johnson , Chang D. Yoo

We present our experiments in training robust to noise an end-to-end automatic speech recognition (ASR) model using intensive data augmentation. We explore the efficacy of fine-tuning a pre-trained model to improve noise robustness, and we…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Jagadeesh Balam , Jocelyn Huang , Vitaly Lavrukhin , Slyne Deng , Somshubra Majumdar , Boris Ginsburg

We consider the task of personalizing ASR models while being constrained by a fixed budget on recording speaker-specific utterances. Given a speaker and an ASR model, we propose a method of identifying sentences for which the speaker's…

Sound · Computer Science 2021-06-03 Abhijeet Awasthi , Aman Kansal , Sunita Sarawagi , Preethi Jyothi

To better model the contextual information and increase the generalization ability of Speech Activity Detection (SAD) system, this paper leverages a multi-lingual Automatic Speech Recognition (ASR) system to perform SAD. Sequence…

Sound · Computer Science 2021-04-13 Seyyed Saeed Sarfjoo , Srikanth Madikeri , Petr Motlicek

Compared with automatic speech recognition (ASR), the human auditory system is more adept at handling noise-adverse situations, including environmental noise and channel distortion. To mimic this adeptness, auditory models have been widely…

Computation and Language · Computer Science 2016-09-16 Peng Dai , Xue Teng , Frank Rudzicz , Ing Yann Soon

Joint optimization of multi-channel front-end and automatic speech recognition (ASR) has attracted much interest. While promising results have been reported for various tasks, past studies on its meeting transcription application were…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-30 Xiaofei Wang , Naoyuki Kanda , Yashesh Gaur , Zhuo Chen , Zhong Meng , Takuya Yoshioka

Automatic Speech Recognition (ASR) is an imperfect process that results in certain mismatches in ASR output text when compared to plain written text or transcriptions. When plain text data is to be used to train systems for spoken language…

Computation and Language · Computer Science 2021-04-02 Prashant Serai , Vishal Sunder , Eric Fosler-Lussier

Due to the variability in characteristics of audio scenes, some scenes can naturally be recognized earlier than others. In this work, rather than using equal-length snippets for all scene categories, as is common in the literature, we study…

Sound · Computer Science 2019-05-10 Huy Phan , Oliver Y. Chén , Philipp Koch , Lam Pham , Ian McLoughlin , Alfred Mertins , Maarten De Vos

Speech segmentation is an essential part of speech translation (ST) systems in real-world scenarios. Since most ST models are designed to process speech segments, long-form audio must be partitioned into shorter segments before translation.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-18 Jaesong Lee , Soyoon Kim , Hanbyul Kim , Joon Son Chung

Automatic Speech Recognition (ASR) systems in real-world settings need to handle imperfect audio, often degraded by hardware limitations or environmental noise, while accommodating diverse user groups. In human-robot interaction (HRI),…

Robotics · Computer Science 2025-08-26 Theresa Pekarek Rosin , Julia Gachot , Henri-Leon Kordt , Matthias Kerzel , Stefan Wermter

Many consumer speech recognition systems are not tuned for people with speech disabilities, resulting in poor recognition and user experience, especially for severe speech differences. Recent studies have emphasized interest in personalized…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-12 Colin Lea , Dianna Yee , Jaya Narain , Zifang Huang , Lauren Tooley , Jeffrey P. Bigham , Leah Findlater

The rapid population aging has stimulated the development of assistive devices that provide personalized medical support to the needies suffering from various etiologies. One prominent clinical application is a computer-assisted speech…

Computation and Language · Computer Science 2019-05-22 Emre Yılmaz , Vikramjit Mitra , Ganesh Sivaraman , Horacio Franco

This work introduces \emph{cross-attention conformer}, an attention-based architecture for context modeling in speech enhancement. Given that the context information can often be sequential, and of different length as the audio that is to…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-02 Arun Narayanan , Chung-Cheng Chiu , Tom O'Malley , Quan Wang , Yanzhang He

ASR has achieved remarkable global progress, yet African low-resource languages remain rigorously underrepresented, producing barriers to digital inclusion across the continent with more than +2000 languages. This systematic literature…

Improving end-to-end speech recognition by incorporating external text data has been a longstanding research topic. There has been a recent focus on training E2E ASR models that get the performance benefits of external text data without…

Computation and Language · Computer Science 2022-02-15 Bolaji Yusuf , Ankur Gandhe , Alex Sokolov

This paper delves into the challenging task of Active Speaker Detection (ASD), where the system needs to determine in real-time whether a person is speaking or not in a series of video frames. While previous works have made significant…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Arnav Kundu , Yanzi Jin , Mohammad Sekhavat , Max Horton , Danny Tormoen , Devang Naik

The effective exploitation of richer contextual information in language models (LMs) is a long-standing research problem for automatic speech recognition (ASR). A cross-utterance LM (CULM) is proposed in this paper, which augments the input…

Computation and Language · Computer Science 2020-09-03 G. Sun , C. Zhang , P. C. Woodland

Recent methods in speech and language technology pretrain very LARGE models which are fine-tuned for specific tasks. However, the benefits of such LARGE models are often limited to a few resource rich languages of the world. In this work,…