English
Related papers

Related papers: Fairness of Automatic Speech Recognition: Looking …

200 papers

Speaker recognition is increasingly used in several everyday applications including smart speakers, customer care centers and other speech-driven analytics. It is crucial to accurately evaluate and mitigate biases present in machine…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-18 Raghuveer Peri , Krishna Somandepalli , Shrikanth Narayanan

This work is an attempt to introduce a comprehensive benchmark for Arabic speech recognition, specifically tailored to address the challenges of telephone conversations in Arabic language. Arabic, characterized by its rich dialectal…

Artificial Intelligence · Computer Science 2024-05-31 Qusai Abo Obaidah , Muhy Eddin Za'ter , Adnan Jaljuli , Ali Mahboub , Asma Hakouz , Bashar Al-Rfooh , Yazan Estaitia

Dysarthria, a motor speech disorder, affects intelligibility and requires targeted interventions for effective communication. In this work, we investigate automated mispronunciation feedback by collecting a dysarthric speech dataset from…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Seohyun Park , Chitralekha Gupta , Michelle Kah Yian Kwan , Xinhui Fung , Alexander Wenjun Yip , Suranga Nanayakkara

The rapid trend of deploying artificial intelligence (AI) and machine learning (ML) systems in socially consequential domains has raised growing concerns about their trustworthiness, including potential discriminatory behaviours. Research…

Machine Learning · Computer Science 2025-09-22 Yijun Bian , Lei You , Yuya Sasaki , Haruka Maeda , Akira Igarashi

Automatic speech recognition (ASR) has benefited from advances in pretrained speech and language models, yet most systems remain constrained to monolingual settings and short, isolated utterances. While recent efforts in context-aware ASR…

Computation and Language · Computer Science 2026-03-09 Yuchen Zhang , Haralambos Mouratidis , Ravi Shekhar

Nowadays, speech is becoming a more common, if not standard, interface to technology. This can be seen in the trend of technology changes over the years. Increasingly, voice is used to control programs, appliances and personal devices…

Human-Computer Interaction · Computer Science 2019-09-10 Abraham Glasser

Wearable devices like smart glasses are approaching the compute capability to seamlessly generate real-time closed captions for live conversations. We build on our recently introduced directional Automatic Speech Recognition (ASR) for smart…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-22 Ju Lin , Niko Moritz , Yiteng Huang , Ruiming Xie , Ming Sun , Christian Fuegen , Frank Seide

The machine recognition of speech spoken at a distance from the microphones, known as far-field automatic speech recognition (ASR), has received a significant increase of attention in science and industry, which caused or was caused by an…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-22 Reinhold Haeb-Umbach , Jahn Heymann , Lukas Drude , Shinji Watanabe , Marc Delcroix , Tomohiro Nakatani

Automatic Speech Recognition (ASR) is an area of growing academic and commercial interest due to the high demand for applications that use it to provide a natural communication method. It is common for general purpose ASR systems to fail in…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-24 Rafael Viana-Cámara , Diego Campos-Sobrino , Mario Campos-Soberanis

Automatic speech recognition (ASR) systems become increasingly efficient thanks to new advances in neural network training like self-supervised learning. However, they are known to be unfair toward certain groups, for instance, people…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-07 Lucas Maison , Yannick Estève

Recently there are increasing concerns about the fairness of Artificial Intelligence (AI) in real-world applications such as computer vision and recommendations. For example, recognition algorithms in computer vision are unfair to black…

Computation and Language · Computer Science 2020-11-03 Haochen Liu , Jamell Dacon , Wenqi Fan , Hui Liu , Zitao Liu , Jiliang Tang

Automatic speech recognition (ASR) systems often falter while processing stuttering-related disfluencies -- such as involuntary blocks and word repetitions -- yielding inaccurate transcripts. A critical barrier to progress is the scarcity…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-03 Dena Mujtaba , Nihar R. Mahapatra , Megan Arney , J. Scott Yaruss , Caryn Herring , Jia Bin

The issue of fairness arises when the automatic speech recognition (ASR) systems do not perform equally well for all subgroups of the population. In any fairness measurement studies for ASR, the open questions of how to control the nuisance…

Machine Learning · Statistics 2021-09-21 Zhe Liu , Irina-Elena Veliche , Fuchun Peng

In recent years, Automatic Speech Recognition (ASR) technology has approached human-level performance on conversational speech under relatively clean listening conditions. In more demanding situations involving distant microphones,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-15 George Sterpu , Naomi Harte

The goal of multilingual speech technology is to facilitate seamless communication between individuals speaking different languages, creating the experience as though everyone were a multilingual speaker. To create this experience, speech…

Computation and Language · Computer Science 2026-05-19 Supriti Sinhamahapatra , Thai-Binh Nguyen , Yiğit Oğuz , Enes Ugan , Jan Niehues , Alexander Waibel

Automated decision systems (ADS) are increasingly used for consequential decision-making. These systems often rely on sophisticated yet opaque machine learning models, which do not allow for understanding how a given decision was arrived…

Artificial Intelligence · Computer Science 2022-05-03 Jakob Schoeffer

Automatic speech recognition (ASR) is improving ever more at mimicking human speech processing. The functioning of ASR, however, remains to a large extent obfuscated by the complex structure of the deep neural networks (DNNs) they are based…

Machine Learning · Computer Science 2022-02-03 Karla Markert , Romain Parracone , Mykhailo Kulakov , Philip Sperl , Ching-Yu Kao , Konstantin Böttinger

Automated decision systems (ADS) have become ubiquitous in many high-stakes domains. Those systems typically involve sophisticated yet opaque artificial intelligence (AI) techniques that seldom allow for full comprehension of their inner…

Human-Computer Interaction · Computer Science 2021-09-14 Jakob Schoeffer , Yvette Machowski , Niklas Kuehl

Traditional ASR metrics like WER and CER fail to capture intelligibility, especially for dysarthric and dysphonic speech, where semantic alignment matters more than exact word matches. ASR systems struggle with these speech types, often…

Machine Learning · Computer Science 2025-12-12 Bornali Phukon , Xiuwen Zheng , Mark Hasegawa-Johnson

As more users across the world are interacting with dialog agents in their daily life, there is a need for better speech understanding that calls for renewed attention to the dynamics between research in automatic speech recognition (ASR)…

Computation and Language · Computer Science 2021-12-14 Manaal Faruqui , Dilek Hakkani-Tür