English
Related papers

Related papers: PAREDA: A Multi-Accent Speech Dataset of Natural L…

200 papers

State-of-the-art (SOTA) Automatic Speech Recognition (ASR) systems primarily rely on acoustic information while disregarding additional multi-modal context. However, visual information are essential in disambiguation and adaptation. While…

Artificial Intelligence · Computer Science 2025-10-17 Supriti Sinhamahapatra , Jan Niehues

Building an accurate automatic speech recognition (ASR) system requires a large dataset that contains many hours of labeled speech samples produced by a diverse set of speakers. The lack of such open free datasets is one of the main issues…

Computation and Language · Computer Science 2018-11-05 Jason Li , Ravi Gadde , Boris Ginsburg , Vitaly Lavrukhin

Recent advances in artificial speech and audio technologies have improved the abilities of deep-fake operators to falsify media and spread malicious misinformation. Anyone with limited coding skills can use freely available speech synthesis…

Building inclusive speech recognition systems is a crucial step towards developing technologies that speakers of all language varieties can use. Therefore, ASR systems must work for everybody independently of the way they speak. To…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-18 Alëna Aksënova , Zhehuai Chen , Chung-Cheng Chiu , Daan van Esch , Pavel Golik , Wei Han , Levi King , Bhuvana Ramabhadran , Andrew Rosenberg , Suzan Schwartz , Gary Wang

Automatic speech recognition (ASR) systems struggle with domain-specific named entities, especially homophones. Contextual ASR improves recognition but often fails to capture fine-grained phoneme variations due to limited entity diversity.…

Computation and Language · Computer Science 2025-09-05 Jiajun He , Naoki Sawada , Koichi Miyazaki , Tomoki Toda

State-of-the-art automatic speech recognition (ASR) systems struggle with the lack of data for rare accents. For sufficiently large datasets, neural engines tend to outshine statistical models in most natural language processing problems.…

Sound · Computer Science 2018-07-11 Fedor Kitashov , Elizaveta Svitanko , Debojyoti Dutta

Automatic Speech Recognition (ASR) systems have been evolving quickly and reaching human parity in certain cases. The systems usually perform pretty well on reading style and clean speech, however, most of the available systems suffer from…

Computation and Language · Computer Science 2019-10-15 Quang Minh Nguyen , Thai Binh Nguyen , Ngoc Phuong Pham , The Loc Nguyen

Text encodings from automatic speech recognition (ASR) transcripts and audio representations have shown promise in speech emotion recognition (SER) ever since. Yet, it is challenging to explain the effect of each information stream on the…

Automatic Speech Recognition (ASR) systems have achieved remarkable performance on widely used benchmarks such as LibriSpeech and Fleurs. However, these benchmarks do not adequately reflect the complexities of real-world conversational…

Computation and Language · Computer Science 2024-09-19 Gaurav Maheshwari , Dmitry Ivanov , Théo Johannet , Kevin El Haddad

While improvements have been made in automatic speech recognition performance over the last several years, machines continue to have significantly lower performance on accented speech than humans. In addition, the most significant…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-13 Xiangyun Chu , Elizabeth Combs , Amber Wang , Michael Picheny

Interacting with a speech interface to query a Question Answering (QA) system is becoming increasingly popular. Typically, QA systems rely on passage retrieval to select candidate contexts and reading comprehension to extract the final…

Computation and Language · Computer Science 2022-09-28 Georgios Sidiropoulos , Svitlana Vakulenko , Evangelos Kanoulas

In this paper, we present a bias and sustainability focused investigation of Automatic Speech Recognition (ASR) systems, namely Whisper and Massively Multilingual Speech (MMS), which have achieved state-of-the-art (SOTA) performances.…

Computation and Language · Computer Science 2025-03-04 Ajinkya Kulkarni , Atharva Kulkarni , Miguel Couceiro , Isabel Trancoso

Recent improvements in multilingual ASR have not been equally distributed across languages and language varieties. To advance state-of-the-art (SOTA) ASR models, we present the Interspeech 2025 ML-SUPERB 2.0 Challenge. We construct a new…

State-of-the-art automatic speech recognition (ASR) systems perform well on healthy speech. However, the performance on impaired speech still remains an issue. The current study explores the usefulness of using Wav2Vec self-supervised…

Computation and Language · Computer Science 2022-04-05 Abner Hernandez , Paula Andrea Pérez-Toro , Elmar Nöth , Juan Rafael Orozco-Arroyave , Andreas Maier , Seung Hee Yang

Automatic speech recognition (ASR) systems in the medical domain that focus on transcribing clinical dictations and doctor-patient conversations often pose many challenges due to the complexity of the domain. ASR output typically undergoes…

Computation and Language · Computer Science 2020-07-14 Monica Sunkara , Srikanth Ronanki , Kalpit Dixit , Sravan Bodapati , Katrin Kirchhoff

Accent variability has posed a huge challenge to automatic speech recognition~(ASR) modeling. Although one-hot accent vector based adaptation systems are commonly used, they require prior knowledge about the target accent and cannot handle…

Sound · Computer Science 2022-04-22 Xun Gong , Yizhou Lu , Zhikai Zhou , Yanmin Qian

Error correction techniques have been used to refine the output sentences from automatic speech recognition (ASR) models and achieve a lower word error rate (WER). Previous works usually adopt end-to-end models and has strong dependency on…

Computation and Language · Computer Science 2024-01-12 Jiaxin Guo , Minghan Wang , Xiaosong Qiao , Daimeng Wei , Hengchao Shang , Zongyao Li , Zhengzhe Yu , Yinglu Li , Chang Su , Min Zhang , Shimin Tao , Hao Yang

This paper presents our latest investigation on end-to-end automatic speech recognition (ASR) for overlapped speech. We propose to train an end-to-end system conditioned on speaker embeddings and further improved by transfer learning from…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-14 Pavel Denisov , Ngoc Thang Vu

Spontaneous or conversational multilingual speech presents many challenges for state-of-the-art automatic speech recognition (ASR) systems. In this work, we present a new technique AMPS that augments a multilingual multimodal ASR system…

Computation and Language · Computer Science 2025-04-18 Abhishek Gupta , Amruta Parulekar , Sameep Chattopadhyay , Preethi Jyothi

Humans are capable of processing speech by making use of multiple sensory modalities. For example, the environment where a conversation takes place generally provides semantic and/or acoustic context that helps us to resolve ambiguities or…

Computation and Language · Computer Science 2019-02-21 Ozan Caglayan , Ramon Sanabria , Shruti Palaskar , Loïc Barrault , Florian Metze