中文
相关论文

相关论文: Multi-Talker MVDR Beamforming Based on Extended Co…

200 篇论文

Although great progresses have been made in automatic speech recognition (ASR), significant performance degradation is still observed when recognizing multi-talker mixed speech. In this paper, we propose and evaluate several architectures…

声音 · 计算机科学 2018-12-06 Yanmin Qian , Xuankai Chang , Dong Yu

The Minimum Variance Distortionless Response (MVDR) beamforming technique is widely applied in array systems to mitigate interference. However, applying MVDR to large arrays is computationally challenging; its computational complexity…

信号处理 · 电气工程与系统科学 2025-10-17 Sanjaya Herath , Armin Gerami , Kevin Wagner , Ramani Duraiswami , Christopher A. Metzler

This paper summarizes several follow-up contributions for improving our submitted NWPU speaker-dependent system for CHiME-5 challenge, which aims to solve the problem of multi-channel, highly-overlapped conversational speech recognition in…

音频与语音处理 · 电气工程与系统科学 2019-04-09 Jian Wu , Yong Xu , Shi-Xiong Zhang , Lian-Wu Chen , Meng Yu , Lei Xie , Dong Yu

This paper highlights the critical importance of multi-channel speech enhancement (MCSE) for speech emotion recognition (ER) in cocktail party scenarios. A multi-channel speech dereverberation and separation front-end integrating DNN-WPE…

Accurate recognition of cocktail party speech containing overlapping speakers, noise and reverberation remains a highly challenging task to date. Motivated by the invariance of visual modality to acoustic signal corruption, an audio-visual…

音频与语音处理 · 电气工程与系统科学 2023-07-07 Guinan Li , Jiajun Deng , Mengzhe Geng , Zengrui Jin , Tianzi Wang , Shujie Hu , Mingyu Cui , Helen Meng , Xunying Liu

Time-domain audio separation network (TasNet) has achieved remarkable performance in blind source separation (BSS). Classic multi-channel speech processing framework employs signal estimation and beamforming. For example, Beam-TasNet links…

音频与语音处理 · 电气工程与系统科学 2022-04-13 Hangting Chen , Yang Yi , Dang Feng , Pengyuan Zhang

We propose a new speaker diarization system based on a recently introduced unsupervised clustering technique namely, generative adversarial network mixture model (GANMM). The proposed system uses x-vectors as front-end representation.…

音频与语音处理 · 电气工程与系统科学 2019-10-28 Monisankha Pal , Manoj Kumar , Raghuveer Peri , Shrikanth Narayanan

Joint optimization of multi-channel front-end and automatic speech recognition (ASR) has attracted much interest. While promising results have been reported for various tasks, past studies on its meeting transcription application were…

音频与语音处理 · 电气工程与系统科学 2020-11-30 Xiaofei Wang , Naoyuki Kanda , Yashesh Gaur , Zhuo Chen , Zhong Meng , Takuya Yoshioka

Recently, our proposed recurrent neural network (RNN) based all deep learning minimum variance distortionless response (ADL-MVDR) beamformer method yielded superior performance over the conventional MVDR by replacing the matrix inversion…

声音 · 计算机科学 2021-04-27 Xiyun Li , Yong Xu , Meng Yu , Shi-Xiong Zhang , Jiaming Xu , Bo Xu , Dong Yu

This work introduces the Cleanformer, a streaming multichannel neural based enhancement frontend for automatic speech recognition (ASR). This model has a conformer-based architecture which takes as inputs a single channel each of raw and…

音频与语音处理 · 电气工程与系统科学 2023-05-05 Joseph Caroselli , Arun Narayanan , Nathan Howard , Tom O'Malley

This paper proposes a flexible multichannel speech enhancement system with the main goal of improving robustness of automatic speech recognition (ASR) in noisy conditions. The proposed system combines a flexible neural mask estimator…

音频与语音处理 · 电气工程与系统科学 2024-06-10 Ante Jukić , Jagadeesh Balam , Boris Ginsburg

Recently, end-to-end models have become a popular approach as an alternative to traditional hybrid models in automatic speech recognition (ASR). The multi-speaker speech separation and recognition task is a central task in cocktail party…

计算与语言 · 计算机科学 2018-11-07 Xuankai Chang , Yanmin Qian , Kai Yu , Shinji Watanabe

In multi-channel speech enhancement and robust automatic speech recognition (ASR), beamforming can typically improve the signal-to-noise ratio (SNR) of the target speaker and produce reliable enhancement with little distortion to target…

音频与语音处理 · 电气工程与系统科学 2025-07-22 Zhong-Qiu Wang , Ruizhe Pang

Self-supervised learning (SSL) methods which learn representations of data without explicit supervision have gained popularity in speech-processing tasks, particularly for single-talker applications. However, these models often have…

音频与语音处理 · 电气工程与系统科学 2022-11-02 Zili Huang , Desh Raj , Paola García , Sanjeev Khudanpur

Automatic speech recognition (ASR) technologies have been significantly advanced in the past few decades. However, recognition of overlapped speech remains a highly challenging task to date. To this end, multi-channel microphone array data…

音频与语音处理 · 电气工程与系统科学 2021-08-31 Jianwei Yu , Shi-Xiong Zhang , Bo Wu , Shansong Liu , Shoukang Hu , Mengzhe Geng , Xunying Liu , Helen Meng , Dong Yu

Recently, the end-to-end approach has been successfully applied to multi-speaker speech separation and recognition in both single-channel and multichannel conditions. However, severe performance degradation is still observed in the…

A promising approach for multi-microphone speech separation involves two deep neural networks (DNN), where the predicted target speech from the first DNN is used to compute signal statistics for time-invariant minimum variance…

声音 · 计算机科学 2021-10-04 Zhong-Qiu Wang , Gordon Wichern , Jonathan Le Roux

The binaural minimum-variance distortionless-response (BMVDR) beamformer is a well-known noise reduction algorithm that can be steered using the relative transfer function (RTF) vector of the desired speech source. Exploiting the…

音频与语音处理 · 电气工程与系统科学 2022-11-22 Nico Gößling , Wiebke Middelberg , Simon Doclo

This paper describes a new baseline system for automatic speech recognition (ASR) in the CHiME-4 challenge to promote the development of noisy ASR in speech processing communities by providing 1) state-of-the-art system with a simplified…

声音 · 计算机科学 2018-03-28 Szu-Jui Chen , Aswin Shanmugam Subramanian , Hainan Xu , Shinji Watanabe

This paper aims at eliminating the interfering speakers' speech, additive noise, and reverberation from the noisy multi-talker speech mixture that benefits automatic speech recognition (ASR) backend. While the recently proposed Weighted…

音频与语音处理 · 电气工程与系统科学 2020-11-19 Zhaoheng Ni , Yong Xu , Meng Yu , Bo Wu , Shixiong Zhang , Dong Yu , Michael I Mandel