English
Related papers

Related papers: Noise Robust Speech Recognition Using Multi-Channe…

200 papers

The learning of interpretable representations from raw data presents significant challenges for time series data like speech. In this work, we propose a relevance weighting scheme that allows the interpretation of the speech representations…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-05 Purvi Agrawal , Sriram Ganapathy

This work proposes a novel support vector machine (SVM) based robust automatic speech recognition (ASR) front-end that operates on an ensemble of the subband components of high-dimensional acoustic waveforms. The key issues of selecting the…

Computation and Language · Computer Science 2014-01-15 Jibran Yousafzai , Zoran Cvetkovic , Peter Sollich , Matthew Ager

Adapting an automatic speech recognition (ASR) system to unseen noise environments is crucial. Integrating adapters into neural networks has emerged as a potent technique for transfer learning. This study thoroughly investigates…

Sound · Computer Science 2024-06-05 Hao Shi , Tatsuya Kawahara

Automatic speech recognition (ASR) models are typically designed to operate on a single input data type, e.g. a single or multi-channel audio streamed from a device. This design decision assumes the primary input data source does not change…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-30 Gokce Keskin , Minhua Wu , Brian King , Harish Mallidi , Yang Gao , Jasha Droppo , Ariya Rastrow , Roland Maas

Large language models (LLMs) have recently achieved impressive results in speech recognition across multiple modalities, including Auditory Speech Recognition (ASR), Visual Speech Recognition (VSR), and Audio-Visual Speech Recognition…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-28 Umberto Cappellazzo , Xubo Liu , Pingchuan Ma , Stavros Petridis , Maja Pantic

Channel estimation is of great importance in realizing practical intelligent reflecting surface-assisted multi-user communication (IRS-MC) systems. However, different from traditional communication systems, an IRS-MC system generally…

Signal Processing · Electrical Eng. & Systems 2020-12-02 Chang Liu , Xuemeng Liu , Derrick Wing Kwan Ng , Jinhong Yuan

We investigate the effectiveness of generative adversarial networks (GANs) for speech enhancement, in the context of improving noise robustness of automatic speech recognition (ASR) systems. Prior work demonstrates that GANs can effectively…

Sound · Computer Science 2018-11-01 Chris Donahue , Bo Li , Rohit Prabhavalkar

Most deep learning-based multi-channel speech enhancement methods focus on designing a set of beamforming coefficients to directly filter the low signal-to-noise ratio signals received by microphones, which hinders the performance of these…

Sound · Computer Science 2022-02-08 Wenzhe Liu , Andong Li , Chengshi Zheng , Xiaodong Li

In this paper, we propose a speech enhancement method us ing dual-path Multi-Channel Linear Prediction (MCLP) filters and multi-norm beamforming. Specifically, the MCLP part in the proposed method is designed with dual-path filters in both…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-25 Chengyuan Qin , Wenmeng Xiong , Jing Zhou , Maoshen Jia , Changchun Bao

In large-scale wireless acoustic sensor networks (WASNs), many of the sensors will only have a marginal contribution to a certain estimation task. Involving all sensors increases the energy budget unnecessarily and decreases the lifetime of…

Sound · Computer Science 2017-05-24 Jie Zhang , Sundeep Prabhakar Chepuri , Richard C. Hendriks , Richard Heusdens

For the task of speech enhancement, local learning objectives are agnostic to phonetic structures helpful for speech recognition. We propose to add a global criterion to ensure de-noised speech is useful for downstream tasks like ASR. We…

Sound · Computer Science 2018-03-28 Deblin Bagchi , Peter Plantinga , Adam Stiff , Eric Fosler-Lussier

In the field of multi-channel, multi-speaker Automatic Speech Recognition (ASR), the task of discerning and accurately transcribing a target speaker's speech within background noise remains a formidable challenge. Traditional approaches…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-19 Yiwen Shao , Shi-Xiong Zhang , Yong Xu , Meng Yu , Dong Yu , Daniel Povey , Sanjeev Khudanpur

Despite rapid advances in speech recognition, current models remain brittle to superficial perturbations to their inputs. Small amounts of noise can destroy the performance of an otherwise state-of-the-art model. To harden models against…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-19 Davis Liang , Zhiheng Huang , Zachary C. Lipton

Neural network-based speaker recognition has achieved significant improvement in recent years. A robust speaker representation learns meaningful knowledge from both hard and easy samples in the training set to achieve good performance.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-31 Ruijie Tao , Kong Aik Lee , Zhan Shi , Haizhou Li

To glean the benefits offered by massive multi-input multi-output (MIMO) systems, channel state information must be accurately acquired. Despite the high accuracy, the computational complexity of classical linear minimum mean squared error…

Information Theory · Computer Science 2024-04-23 Bin Li , Ziping Wei , Shaoshi Yang , Yang Zhang , Jun Zhang , Chenglin Zhao , Sheng Chen

Channel estimation is challenging for millimeter-wave (mmWave) massive MIMO with hybrid precoding, since the number of radio frequency (RF) chains is much smaller than that of antennas. Conventional compressive sensing based channel…

Information Theory · Computer Science 2018-07-10 Chen Hu , Linglong Dai , Talha Mir , Zhen Gao , Jun Fang

Robust audio-visual speech recognition (AVSR) in noisy environments remains challenging, as existing systems struggle to estimate audio reliability and dynamically adjust modality reliance. We propose router-gated cross-modal feature…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 DongHoon Lim , YoungChae Kim , Dong-Hyun Kim , Da-Hee Yang , Joon-Hyuk Chang

This paper considers a sequential estimation and sensor scheduling problem in the presence of multiple communication channels. As opposed to the classical remote estimation problem that involves one perfect (noiseless) channel and one…

Information Theory · Computer Science 2015-10-02 Xiaobin Gao , Emrah Akyol , Tamer Basar

In general, reliable communication via multiple-input multiple-output (MIMO) orthogonal frequency division multiplexing (OFDM) requires accurate channel estimation at the receiver. The existing literature largely focuses on denoising…

Signal Processing · Electrical Eng. & Systems 2025-08-12 Myeung Suk Oh , Seyyedali Hosseinalipour , Taejoon Kim , Christopher G. Brinton , David J. Love

Under noisy environments, to achieve the robust performance of speaker recognition is still a challenging task. Motivated by the promising performance of multi-task training in a variety of image processing tasks, we explore the potential…

Sound · Computer Science 2019-05-14 Jianfeng Zhou , Tao Jiang , Lin Li , Qingyang Hong , Zhe Wang , Bingyin Xia