English
Related papers

Related papers: Towards measuring fairness in speech recognition: …

200 papers

Some speech recognition tasks, such as automatic speech recognition (ASR), are approaching or have reached human performance in many reported metrics. Yet, they continue to struggle in complex, real-world, situations, such as with distanced…

Computation and Language · Computer Science 2025-07-31 Paige Tuttösí , Mantaj Dhillon , Luna Sang , Shane Eastwood , Poorvi Bhatia , Quang Minh Dinh , Avni Kapoor , Yewon Jin , Angelica Lim

Automatic speech recognition (ASR) systems are known to be sensitive to the sociolinguistic variability of speech data, in which gender plays a crucial role. This can result in disparities in recognition accuracy between male and female…

Computation and Language · Computer Science 2023-10-11 Dennis Fucci , Marco Gaido , Matteo Negri , Mauro Cettolo , Luisa Bentivogli

Speech technologies are deployed in high-stakes settings, yet fairness concerns remain fragmented across tasks and disciplines. Existing surveys either adopt a general machine-learning perspective that overlooks speech-specific properties…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-05 Yi-Cheng Lin , Yun-Shao Tsai , Kuan-Yu Chen , Hsiao-Ying Huang , Huang-Cheng Chou , Hung-yi Lee

Automatic speech recognition (ASR) systems play a key role in many commercial products including voice assistants. Typically, they require large amounts of clean speech data for training which gives an undue advantage to large organizations…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-21 Bhavya Ghai , Buvana Ramanan , Klaus Mueller

ASR has achieved remarkable global progress, yet African low-resource languages remain rigorously underrepresented, producing barriers to digital inclusion across the continent with more than +2000 languages. This systematic literature…

The audio data is increasing day by day throughout the globe with the increase of telephonic conversations, video conferences and voice messages. This research provides a mechanism for identifying a speaker in an audio file, based on the…

Sound · Computer Science 2022-05-31 Syeda Rabia Arshad , Syed Mujtaba Haider , Abdul Basit Mughal

Automatic speech recognition systems are part of people's daily lives, embedded in personal assistants and mobile phones, helping as a facilitator for human-machine interaction while allowing access to information in a practically intuitive…

Sound · Computer Science 2021-10-05 Julio Cesar Duarte , Sérgio Colcher

Automatic Speech Recognition (ASR) systems are used in the financial domain to enhance the caller experience by enabling natural language understanding and facilitating efficient and intuitive interactions. Increasing use of ASR systems…

Machine Learning · Computer Science 2024-02-08 Chirag Chhablani , Nikhita Sharma , Jordan Hosier , Vijay K. Gurbani

Automatic speech recognition (ASR) models trained on large amounts of audio data are now widely used to convert speech to written text in a variety of applications from video captioning to automated assistants used in healthcare and other…

Computation and Language · Computer Science 2024-07-22 Changye Li , Trevor Cohen , Serguei Pakhomov

Audio deepfake detection aims to detect real human voices from those generated by Artificial Intelligence (AI) and has emerged as a significant problem in the field of voice biometrics systems. With the ever-improving quality of synthetic…

Sound · Computer Science 2026-05-12 Aishwarya Fursule , Shruti Kshirsagar , Anderson R. Avila

This study investigates the impact of integrating a dataset of disordered speech recordings ($\sim$1,000 hours) into the fine-tuning of a near state-of-the-art ASR baseline system. Contrary to what one might expect, despite the data being…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-22 Jimmy Tobin , Katrin Tomanek , Subhashini Venugopalan

Audio-visual automatic speech recognition is a promising approach to robust ASR under noisy conditions. However, up until recently it had been traditionally studied in isolation assuming the video of a single speaking face matches the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-13 Otavio Braga , Olivier Siohan

We present a novel Automatic Speech Recognition (ASR) dataset for the Oromo language, a widely spoken language in Ethiopia and neighboring regions. The dataset was collected through a crowd-sourcing initiative, encompassing a diverse range…

Computation and Language · Computer Science 2025-02-04 Turi Abu , Ying Shi , Thomas Fang Zheng , Dong Wang

There is increasingly more evidence that automatic speech recognition (ASR) systems are biased against different speakers and speaker groups, e.g., due to gender, age, or accent. Research on bias in ASR has so far primarily focused on…

Computation and Language · Computer Science 2025-07-09 Tanvina Patel , Wiebke Hutiri , Aaron Yi Ding , Odette Scharenborg

Warning: This paper may contain texts with uncomfortable content. Large Language Models (LLMs) have achieved remarkable performance in various tasks, including those involving multimodal data like speech. However, these models often exhibit…

Computation and Language · Computer Science 2025-05-22 Yi-Cheng Lin , Wei-Chih Chen , Hung-yi Lee

In this work, we address the challenge of building fair English ASR systems for second-language speakers. Our analysis of widely used ASR models, Whisper and Seamless-M4T, reveals large fluctuations in word error rate (WER) across 26 accent…

Computation and Language · Computer Science 2026-01-27 Monorama Swain , Bubai Maji , Jagabandhu Mishra , Markus Schedl , Anders Søgaard , Jesper Rindom Jensen

As for other forms of AI, speech recognition has recently been examined with respect to performance disparities across different user cohorts. One approach to achieve fairness in speech recognition is to (1) identify speaker cohorts that…

We present DRES: a 1.5-hour Dutch realistic elicited (semi-spontaneous) speech dataset from 80 speakers recorded in noisy, public indoor environments. DRES was designed as a test set for the evaluation of state-of-the-art (SOTA) automatic…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-11 Dimme de Groot , Yuanyuan Zhang , Jorge Martinez , Odette Scharenborg

Speech conveys not only linguistic information but also rich non-verbal vocal events such as laughing and crying. While semantic transcription is well-studied, the precise localization of non-verbal events remains a critical yet…

Computation and Language · Computer Science 2026-01-09 Chenchen Yang , Kexin Huang , Liwei Fan , Qian Tu , Botian Jiang , Dong Zhang , Linqi Yin , Shimin Li , Zhaoye Fei , Qinyuan Cheng , Xipeng Qiu

This paper investigates methods to effectively retrieve speaker information from the personalized speaker adapted neural network acoustic models (AMs) in automatic speech recognition (ASR). This problem is especially important in the…

Computation and Language · Computer Science 2022-05-02 Natalia Tomashenko , Salima Mdhaffar , Marc Tommasi , Yannick Estève , Jean-François Bonastre