English
Related papers

Related papers: Structured State Space Decoder for Speech Recognit…

200 papers

Voice assistants increasingly use on-device Automatic Speech Recognition (ASR) to ensure speed and privacy. However, due to resource constraints on the device, queries pertaining to complex information domains often require further…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Iwen E. Kang , Christophe Van Gysel , Man-Hung Siu

Automatic speech recognition (ASR) allows transcribing the communications between air traffic controllers (ATCOs) and aircraft pilots. The transcriptions are used later to extract ATC named entities, e.g., aircraft callsigns. One common…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-18 Juan Zuluaga-Gomez , Seyyed Saeed Sarfjoo , Amrutha Prasad , Iuliia Nigmatulina , Petr Motlicek , Karel Ondrej , Oliver Ohneiser , Hartmut Helmke

Recent advances in text-to-speech (TTS) have enabled models to clone arbitrary unseen speakers and synthesize high-quality, natural-sounding speech. However, evaluation methods lag behind: typical mean opinion score (MOS) estimators perform…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-25 Guansu Wang , Peijie Sun

In recent Text-to-Speech (TTS) systems, a neural vocoder often generates speech samples by solely conditioning on acoustic features predicted from an acoustic model. However, there are always distortions existing in the predicted acoustic…

Sound · Computer Science 2023-04-25 Jianzong Wang , Xulong Zhang , Haobin Tang , Aolan Sun , Ning Cheng , Jing Xiao

Automatic Speech Recognition (ASR) plays a crucial role in human-machine interaction and serves as an interface for a wide range of applications. Traditionally, ASR performance has been evaluated using Word Error Rate (WER), a metric that…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-23 Sujith Pulikodan , Sahapthan K , Prasanta Kumar Ghosh , Visruth Sanka , Nihar Desai

Automatic speech recognition (ASR) systems, increasingly prevalent in education, healthcare, employment, and mobile technology, face significant challenges in inclusivity, particularly for the 80 million-strong global community of people…

Computation and Language · Computer Science 2024-05-13 Dena Mujtaba , Nihar R. Mahapatra , Megan Arney , J. Scott Yaruss , Hope Gerlach-Houck , Caryn Herring , Jia Bin

Utilizing air-traffic control (ATC) data for downstream natural-language processing tasks requires preprocessing steps. Key steps are the transcription of the data via automatic speech recognition (ASR) and speaker diarization, respectively…

Computation and Language · Computer Science 2024-06-21 Alexander Blatt , Aravind Krishnan , Dietrich Klakow

This paper presents a newly developed, simultaneous neural speech-to-speech translation system and its evaluation. The system consists of three fully-incremental neural processing modules for automatic speech recognition (ASR), machine…

Computation and Language · Computer Science 2020-11-12 Katsuhito Sudoh , Takatomo Kano , Sashi Novitasari , Tomoya Yanagita , Sakriani Sakti , Satoshi Nakamura

Transformer-based architectures are the most used architectures in many deep learning fields like Natural Language Processing, Computer Vision or Speech processing. It may encourage the direct use of Transformers in the constrained tasks,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-29 Youness Dkhissi , Valentin Vielzeuf , Elys Allesiardo , Anthony Larcher

This paper presents the Speech Technology Center (STC) speaker recognition (SR) systems submitted to the VOiCES From a Distance challenge 2019. The challenge's SR task is focused on the problem of speaker recognition in single channel…

We study speech intent classification and slot filling (SICSF) by proposing to use an encoder pretrained on speech recognition (ASR) to initialize an end-to-end (E2E) Conformer-Transformer model, which achieves the new state-of-the-art…

Computation and Language · Computer Science 2023-07-17 He Huang , Jagadeesh Balam , Boris Ginsburg

Pre-trained models, especially self-supervised learning (SSL) models, have demonstrated impressive results in automatic speech recognition (ASR) task. While most applications of SSL models focus on leveraging continuous representations as…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-03 Zehan Li , Yan Yang , Xueqing Li , Jian Kang , Xiao-Lei Zhang , Jie Li

Text to speech (TTS) is a crucial task for user interaction, but TTS model training relies on a sizable set of high-quality original datasets. Due to privacy and security issues, the original datasets are usually unavailable directly.…

Machine Learning · Computer Science 2021-07-20 Zhenhou Hong , Jianzong Wang , Xiaoyang Qu , Jie Liu , Chendong Zhao , Jing Xiao

The emergence of industrial-scale speech recognition (ASR) models such as Whisper and USM, trained on 1M hours of weakly labelled and 12M hours of audio only proprietary data respectively, has led to a stronger need for large scale public…

Computation and Language · Computer Science 2024-02-02 Ankit Gupta , George Saon , Brian Kingsbury

Recently self-supervised learning has emerged as an effective approach to improve the performance of automatic speech recognition (ASR). Under such a framework, the neural network is usually pre-trained with massive unlabeled data and then…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-16 Songjun Cao , Yueteng Kang , Yanzhe Fu , Xiaoshuo Xu , Sining Sun , Yike Zhang , Long Ma

Automatic speech recognition (ASR) models make fewer errors when more surrounding speech information is presented as context. Unfortunately, acquiring a larger future context leads to higher latency. There exists an inevitable trade-off…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-21 Kwangyoun Kim , Felix Wu , Prashant Sridhar , Kyu J. Han , Shinji Watanabe

Recent advances in Automatic Speech Recognition (ASR) have been largely fueled by massive speech corpora. However, extending coverage to diverse languages with limited resources remains a formidable challenge. This paper introduces Speech…

Computation and Language · Computer Science 2025-05-23 Tianduo Wang , Lu Xu , Wei Lu , Shanbo Cheng

End-to-End automatic speech recognition (ASR) models aim to learn a generalised speech representation to perform recognition. In this domain there is little research to analyse internal representation dependencies and their relationship to…

Computation and Language · Computer Science 2022-11-04 Anna Ollerenshaw , Md Asif Jalal , Thomas Hain

Automatic speech recognition (ASR) models with low-footprint are increasingly being deployed on edge devices for conversational agents, which enhances privacy. We study the problem of federated continual incremental learning for recurrent…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-22 Milind Rao , Gopinath Chennupati , Gautam Tiwari , Anit Kumar Sahu , Anirudh Raju , Ariya Rastrow , Jasha Droppo

This paper presents the use of non-autoregressive (NAR) approaches for joint automatic speech recognition (ASR) and spoken language understanding (SLU) tasks. The proposed NAR systems employ a Conformer encoder that applies connectionist…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-24 Mohan Li , Rama Doddipatla