English
Related papers

Related papers: Learning from human perception to improve automati…

200 papers

Code-Switching (CS) remains a challenge for Automatic Speech Recognition (ASR), especially character-based models. With the combined choice of characters from multiple languages, the outcome from character-based models suffers from phoneme…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-24 Burin Naowarat , Thananchai Kongthaworn , Korrawe Karunratanakul , Sheng Hui Wu , Ekapol Chuangsuwanich

While word error rates of automatic speech recognition (ASR) systems have consistently fallen, natural language understanding (NLU) applications built on top of ASR systems still attribute significant numbers of failures to low-quality…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-05 David M. Chan , Shalini Ghosh , Hitesh Tulsiani , Ariya Rastrow , Björn Hoffmeister

Automated speaker recognition uses data processing to identify speakers by their voice. Today, automated speaker recognition is deployed on billions of smart devices and in services such as call centres. Despite their wide-scale deployment…

Sound · Computer Science 2022-06-22 Wiebke Toussaint Hutiri , Aaron Ding

In Self-Supervised Learning (SSL), various pretext tasks are designed for learning feature representations through contrastive loss. However, previous studies have shown that this loss is less tolerant to semantically similar samples due to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-07 Shanshan Wang , Soumya Tripathy , Annamaria Mesaros

We address performance fairness for speaker verification using the adversarial reweighting (ARW) method. ARW is reformulated for speaker verification with metric learning, and shown to improve results across different subgroups of gender…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-09 Minho Jin , Chelsea J. -T. Ju , Zeya Chen , Yi-Chieh Liu , Jasha Droppo , Andreas Stolcke

On-device Automatic Speech Recognition (ASR) models trained on speech data of a large population might underperform for individuals unseen during training. This is due to a domain shift between user data and the original training data,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-23 Jisi Zhang , Vandana Rajan , Haaris Mehmood , David Tuckey , Pablo Peso Parada , Md Asif Jalal , Karthikeyan Saravanan , Gil Ho Lee , Jungin Lee , Seokyeong Jung

Decoding speaker's intent is a crucial part of spoken language understanding (SLU). The presence of noise or errors in the text transcriptions, in real life scenarios make the task more challenging. In this paper, we address the spoken…

Computation and Language · Computer Science 2019-10-24 Prashanth Gurunath Shivakumar , Mu Yang , Panayiotis Georgiou

While improvements have been made in automatic speech recognition performance over the last several years, machines continue to have significantly lower performance on accented speech than humans. In addition, the most significant…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-13 Xiangyun Chu , Elizabeth Combs , Amber Wang , Michael Picheny

Automatic Speech Recognition (ASR) systems exhibit the best performance on speech that is similar to that on which it was trained. As such, underrepresented varieties including regional dialects, minority-speakers, and low-resource…

Computation and Language · Computer Science 2023-05-15 Emma O'Neill , Julie Carson-Berndsen

This paper presents an end-to-end model designed to improve automatic speech recognition (ASR) for a particular speaker in a crowded, noisy environment. The model utilizes a single-channel speech enhancement module that isolates the…

Sound · Computer Science 2024-04-09 Thai-Binh Nguyen , Alexander Waibel

Spoken language understanding (SLU) systems extract transcriptions, as well as semantics of intent or named entities from speech, and are essential components of voice activated systems. SLU models, which either directly extract semantics…

Computation and Language · Computer Science 2021-02-16 Milind Rao , Pranav Dheram , Gautam Tiwari , Anirudh Raju , Jasha Droppo , Ariya Rastrow , Andreas Stolcke

In this work, we develop new self-learning techniques with an attention-based sequence-to-sequence (seq2seq) model for automatic speech recognition (ASR). For untranscribed speech data, the hypothesis from an ASR system must be used as a…

Computation and Language · Computer Science 2021-12-23 Kenichi Kumatani , Dimitrios Dimitriadis , Yashesh Gaur , Robert Gmyr , Sefik Emre Eskimez , Jinyu Li , Michael Zeng

The increasing use of cloud-based speech assistants has heightened the need for effective speech anonymization, which aims to obscure a speaker's identity while retaining critical information for subsequent tasks. One approach to achieving…

Artificial Intelligence · Computer Science 2024-10-22 Suhita Ghosh , Tim Thiele , Frederic Lorbeer , Frank Dreyer , Sebastian Stober

In automatic speech recognition, any factor that alters the acoustic properties of speech can pose a challenge to the system's performance. This paper presents a novel approach for automatic whispered speech recognition in the Irish dialect…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-05 Aref Farhadipour , Homa Asadi , Volker Dellwo

Speaker extraction (SE) aims to segregate the speech of a target speaker from a mixture of interfering speakers with the help of auxiliary information. Several forms of auxiliary information have been employed in single-channel SE, such as…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-18 Mohamed Elminshawi , Wolfgang Mack , Srikanth Raj Chetupalli , Soumitro Chakrabarty , Emanuël A. P. Habets

Fake audio attack becomes a major threat to the speaker verification system. Although current detection approaches have achieved promising results on dataset-specific scenarios, they encounter difficulties on unseen spoofing data.…

Sound · Computer Science 2022-07-12 Haoxin Ma , Jiangyan Yi , Jianhua Tao , Ye Bai , Zhengkun Tian , Chenglong Wang

In this study, we propose to investigate triplet loss for the purpose of an alternative feature representation for ASR. We consider a general non-semantic speech representation, which is trained with a self-supervised criteria based on…

Sound · Computer Science 2021-09-24 Szu-Jui Chen , Wei Xia , John H. L. Hansen

Selecting application scenarios matching data is important for the automatic speech recognition (ASR) training, but it is difficult to measure the matching degree of the training corpus. This study proposes a unsupervised target-aware data…

Computation and Language · Computer Science 2023-02-28 Changfeng Gao , Gaofeng Cheng , Pengyuan Zhang , Yonghong Yan

State-of-the-art speaker verification systems are inherently dependent on some kind of human supervision as they are trained on massive amounts of labeled data. However, manually annotating utterances is slow, expensive and not scalable to…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-25 Théo Lepage , Réda Dehak

End-to-end Automatic Speech Recognition (ASR) systems based on neural networks have seen large improvements in recent years. The availability of large scale hand-labeled datasets and sufficient computing resources made it possible to train…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Maxime Burchi , Radu Timofte