English
Related papers

Related papers: Gated Recurrent Fusion with Joint Training Framewo…

200 papers

Recurrent Neural Network Transducer (RNN-T), like most end-to-end speech recognition model architectures, has an implicit neural network language model (NNLM) and cannot easily leverage unpaired text data during training. Previous work has…

Computation and Language · Computer Science 2020-10-28 Suyoun Kim , Yuan Shangguan , Jay Mahadeokar , Antoine Bruguier , Christian Fuegen , Michael L. Seltzer , Duc Le

We investigate the use of generative adversarial networks (GANs) in speech dereverberation for robust speech recognition. GANs have been recently studied for speech enhancement to remove additive noises, but there still lacks of a work to…

Sound · Computer Science 2019-01-01 Ke Wang , Junbo Zhang , Sining Sun , Yujun Wang , Fei Xiang , Lei Xie

Current Audio-Visual Source Separation methods primarily adopt two design strategies. The first strategy involves fusing audio and visual features at the bottleneck layer of the encoder, followed by processing the fused features through the…

Sound · Computer Science 2025-05-01 Yinfeng Yu , Shiyu Sun

Automatic recognition of overlapped speech remains a highly challenging task to date. Motivated by the bimodal nature of human speech perception, this paper investigates the use of audio-visual technologies for overlapped speech…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-07 Jianwei Yu , Shi-Xiong Zhang , Jian Wu , Shahram Ghorbani , Bo Wu , Shiyin Kang , Shansong Liu , Xunying Liu , Helen Meng , Dong Yu

The state-of-art models for speech synthesis and voice conversion are capable of generating synthetic speech that is perceptually indistinguishable from bonafide human speech. These methods represent a threat to the automatic speaker…

Machine Learning · Computer Science 2019-07-11 Moustafa Alzantot , Ziqi Wang , Mani B. Srivastava

To achieve robust far-field automatic speech recognition (ASR), existing techniques typically employ an acoustic front end (AFE) cascaded with a neural transducer (NT) ASR model. The AFE output, however, could be unreliable, as the…

Joint optimization of multi-channel front-end and automatic speech recognition (ASR) has attracted much interest. While promising results have been reported for various tasks, past studies on its meeting transcription application were…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-30 Xiaofei Wang , Naoyuki Kanda , Yashesh Gaur , Zhuo Chen , Zhong Meng , Takuya Yoshioka

Grammatical feedback is crucial for L2 learners, teachers, and testers. Spoken grammatical error correction (GEC) aims to supply feedback to L2 learners on their use of grammar when speaking. This process usually relies on a cascaded…

Computation and Language · Computer Science 2024-07-22 Stefano Bannò , Rao Ma , Mengjie Qian , Kate M. Knill , Mark J. F. Gales

The challenge of fairness arises when Automatic Speech Recognition (ASR) systems do not perform equally well for all sub-groups of the population. In the past few years there have been many improvements in overall speech recognition…

Sound · Computer Science 2023-06-12 Irina-Elena Veliche , Pascale Fung

A field that has directly benefited from the recent advances in deep learning is Automatic Speech Recognition (ASR). Despite the great achievements of the past decades, however, a natural and robust human-machine speech interaction still…

Audio and Speech Processing · Electrical Eng. & Systems 2018-03-29 Mirco Ravanelli , Philemon Brakel , Maurizio Omologo , Yoshua Bengio

Automatic speech recognition (ASR) systems often falter while processing stuttering-related disfluencies -- such as involuntary blocks and word repetitions -- yielding inaccurate transcripts. A critical barrier to progress is the scarcity…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-03 Dena Mujtaba , Nihar R. Mahapatra , Megan Arney , J. Scott Yaruss , Caryn Herring , Jia Bin

Speaker Verification (SV) systems trained on adults speech often underperform on children's SV due to the acoustic mismatch, and limited children speech data makes fine-tuning not very effective. In this paper, we propose an innovative…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-12 Vishwas M. Shetty , Jiusi Zheng , Abeer Alwan

Despite recent advances in voice separation methods, many challenges remain in realistic scenarios such as noisy recording and the limits of available data. In this work, we propose to explicitly incorporate the phonetic and linguistic…

Automatic speech recognition can potentially benefit from the lip motion patterns, complementing acoustic speech to improve the overall recognition performance, particularly in noise. In this paper we propose an audio-visual fusion strategy…

Audio and Speech Processing · Electrical Eng. & Systems 2019-05-02 George Sterpu , Christian Saam , Naomi Harte

We introduce GAP-URGENet, a generative-predictive fusion framework developed for Track 1 of the ICASSP 2026 URGENT Challenge. The system integrates a generative branch, which performs full-stack speech restoration in a self-supervised…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-03 Xiaobin Rong , Yushi Wang , Zheng Wang , Jing Lu

It has been shown that the intelligibility of noisy speech can be improved by speech enhancement (SE) algorithms. However, monaural SE has not been established as an effective frontend for automatic speech recognition (ASR) in noisy…

Sound · Computer Science 2024-03-12 Yufeng Yang , Ashutosh Pandey , DeLiang Wang

This paper proposes a flexible multichannel speech enhancement system with the main goal of improving robustness of automatic speech recognition (ASR) in noisy conditions. The proposed system combines a flexible neural mask estimator…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-10 Ante Jukić , Jagadeesh Balam , Boris Ginsburg

Despite the remarkable progress in end-to-end Automatic Speech Recognition (ASR) engines, accurately transcribing dysarthric speech remains a major challenge. In this work, we proposed a two-stage framework for the Speech Accessibility…

Computation and Language · Computer Science 2025-05-27 Moreno La Quatra , Alkis Koudounas , Valerio Mario Salerno , Sabato Marco Siniscalchi

Neural front-ends represent a promising approach to feature extraction for automatic speech recognition (ASR) systems as they enable to learn specifically tailored features for different tasks. Yet, many of the existing techniques remain…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-15 Peter Vieting , Benedikt Hilmes , Ralf Schlüter , Hermann Ney

This work presents our end-to-end (E2E) automatic speech recognition (ASR) model targetting at robust speech recognition, called Integraded speech Recognition with enhanced speech Input for Self-supervised learning representation (IRIS).…

Sound · Computer Science 2022-04-04 Xuankai Chang , Takashi Maekaku , Yuya Fujita , Shinji Watanabe
‹ Prev 1 4 5 6 7 8 10 Next ›