中文
相关论文

相关论文: Joint Neural AEC and Beamforming with Double-Talk …

200 篇论文

We present a frontend for improving robustness of automatic speech recognition (ASR), that jointly implements three modules within a single model: acoustic echo cancellation, speech enhancement, and speech separation. This is achieved by…

音频与语音处理 · 电气工程与系统科学 2021-11-22 Tom O'Malley , Arun Narayanan , Quan Wang , Alex Park , James Walker , Nathan Howard

To achieve robust far-field automatic speech recognition (ASR), existing techniques typically employ an acoustic front end (AFE) cascaded with a neural transducer (NT) ASR model. The AFE output, however, could be unreliable, as the…

Deep learning-based methods that jointly perform the task of acoustic echo and noise reduction (AENR) often require high memory and computational resources, making them unsuitable for real-time deployment on low-resource platforms such as…

音频与语音处理 · 电气工程与系统科学 2024-08-29 Shrishti Saha Shetu , Naveen Kumar Desiraju , Jose Miguel Martinez Aponte , Emanuël A. P. Habets , Edwin Mabande

Hybrid meetings have become increasingly necessary during the post-COVID period and also brought new challenges for solving audio-related problems. In particular, the interplay between acoustic echo and acoustic howling in a hybrid meeting…

音频与语音处理 · 电气工程与系统科学 2023-05-05 Hao Zhang , Meng Yu , Dong Yu

Attention-based beamformers have recently been shown to be effective for multi-channel speech recognition. However, they are less capable at capturing local information. In this work, we propose a 2D Conv-Attention module which combines…

音频与语音处理 · 电气工程与系统科学 2021-05-18 Bhargav Pulugundla , Yang Gao , Brian King , Gokce Keskin , Harish Mallidi , Minhua Wu , Jasha Droppo , Roland Maas

Deep neural network-based systems have significantly improved the performance of speaker diarization tasks. However, end-to-end neural diarization (EEND) systems often struggle to generalize to scenarios with an unseen number of speakers,…

声音 · 计算机科学 2023-09-14 Zhengyang Chen , Bing Han , Shuai Wang , Yanmin Qian

This paper introduces the NWPU Team's entry to the ICASSP 2022 AEC Challenge. We take a hybrid approach that cascades a linear AEC with a neural post-filter. The former is used to deal with the linear echo components while the latter…

声音 · 计算机科学 2022-05-31 Shimin Zhang , Ziteng Wang , Jiayao Sun , Yihui Fu , Biao Tian , Qiang Fu , Lei Xie

The robustness of the Kalman filter to double talk and its rapid convergence make it a popular approach for addressing acoustic echo cancellation (AEC) challenges. However, the inability to model nonlinearity and the need to tune control…

音频与语音处理 · 电气工程与系统科学 2023-12-27 Yixuan Zhang , Meng Yu , Hao Zhang , Dong Yu , DeLiang Wang

Recent research advances in deep neural network (DNN)-based beamformers have shown great promise for speech enhancement under adverse acoustic conditions. Different network architectures and input features have been explored in estimating…

音频与语音处理 · 电气工程与系统科学 2023-10-24 Hsinyu Chang , Yicheng Hsu , Mingsian R. Bai

Multi-speaker speech recognition has been one of the keychallenges in conversation transcription as it breaks the singleactive speaker assumption employed by most state-of-the-artspeech recognition systems. Speech separation is consideredas…

音频与语音处理 · 电气工程与系统科学 2020-09-08 Jian Wu , Zhuo Chen , Jinyu Li , Takuya Yoshioka , Zhili Tan , Ed Lin , Yi Luo , Lei Xie

Compensation for channel mismatch and noise interference is essential for robust automatic speech recognition. Enhanced speech has been introduced into the multi-condition training of acoustic models to improve their generalization ability.…

声音 · 计算机科学 2022-11-24 Hung-Shin Lee , Pin-Yuan Chen , Yao-Fei Cheng , Yu Tsao , Hsin-Min Wang

Recently, our proposed recurrent neural network (RNN) based all deep learning minimum variance distortionless response (ADL-MVDR) beamformer method yielded superior performance over the conventional MVDR by replacing the matrix inversion…

声音 · 计算机科学 2021-04-27 Xiyun Li , Yong Xu , Meng Yu , Shi-Xiong Zhang , Jiaming Xu , Bo Xu , Dong Yu

Acoustic beamformers have been widely used to enhance audio signals. The best current methods are DNN-powered variants of the generalized eigenvalue beamformer, and DNN-based filterestimation methods that directly compute beamforming…

声音 · 计算机科学 2020-03-03 Yuichiro Koyama , Bhiksha Raj

We propose a novel method for Acoustic Event Detection (AED). In contrast to speech, sounds coming from acoustic events may be produced by a wide variety of sources. Furthermore, distinguishing them often requires analyzing an extended time…

声音 · 计算机科学 2016-12-09 Naoya Takahashi , Michael Gygli , Beat Pfister , Luc Van Gool

Acoustic beamformers have been widely used to enhance audio signals. Currently, the best methods are the deep neural network (DNN)-powered variants of the generalized eigenvalue and minimum-variance distortionless response beamformers and…

音频与语音处理 · 电气工程与系统科学 2020-08-12 Yuichiro Koyama , Bhiksha Raj

Most deep learning-based multi-channel speech enhancement methods focus on designing a set of beamforming coefficients to directly filter the low signal-to-noise ratio signals received by microphones, which hinders the performance of these…

声音 · 计算机科学 2022-02-08 Wenzhe Liu , Andong Li , Chengshi Zheng , Xiaodong Li

This study presents a deep-learning framework for controlling multichannel acoustic feedback in audio devices. Traditional digital signal processing methods struggle with convergence when dealing with highly correlated noise such as…

声音 · 计算机科学 2025-05-30 Yuan-Kuei Wu , Juan Azcarreta , Kashyap Patel , Buye Xu , Jung-Suk Lee , Sanha Lee , Ashutosh Pandey

Speech separation algorithms are often used to separate the target speech from other interfering sources. However, purely neural network based speech separation systems often cause nonlinear distortion that is harmful for automatic speech…

音频与语音处理 · 电气工程与系统科学 2021-02-10 Zhuohuang Zhang , Yong Xu , Meng Yu , Shi-Xiong Zhang , Lianwu Chen , Dong Yu

The front-end module in multi-channel automatic speech recognition (ASR) systems mainly use microphone array techniques to produce enhanced signals in noisy conditions with reverberation and echos. Recently, neural network (NN) based…

声音 · 计算机科学 2020-11-19 Yuxiang Kong , Jian Wu , Quandong Wang , Peng Gao , Weiji Zhuang , Yujun Wang , Lei Xie

In many speech recording applications, noise and acoustic echo corrupt the desired speech. Consequently, combined noise reduction (NR) and acoustic echo cancellation (AEC) is required. Generally, a cascade approach is followed, i.e., the…

音频与语音处理 · 电气工程与系统科学 2026-01-15 Arnout Roebben , Toon van Waterschoot , Jan Wouters , Marc Moonen