English
Related papers

Related papers: Microphone Array Generalization for Multichannel N…

200 papers

Building on the deep learning based acoustic echo cancellation (AEC) in the single-loudspeaker (single-channel) and single-microphone setup, this paper investigates multi-channel AEC (MCAEC) and multi-microphone AEC (MMAEC). We train a deep…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-04 Hao Zhang , DeLiang Wang

The front-end module in multi-channel automatic speech recognition (ASR) systems mainly use microphone array techniques to produce enhanced signals in noisy conditions with reverberation and echos. Recently, neural network (NN) based…

Sound · Computer Science 2020-11-19 Yuxiang Kong , Jian Wu , Quandong Wang , Peng Gao , Weiji Zhuang , Yujun Wang , Lei Xie

Deep neural networks have recently led to promising results for the task of multiple sound source localization. Yet, they require a lot of training data to cover a variety of acoustic conditions and microphone array layouts. One can…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-18 Guillaume Le Moing , Phongtharin Vinayavekhin , Don Joven Agravante , Tadanobu Inoue , Jayakorn Vongkulbhisal , Asim Munawar , Ryuki Tachibana

Speech separation has been shown effective for multi-talker speech recognition. Under the ad hoc microphone array setup where the array consists of spatially distributed asynchronous microphones, additional challenges must be overcome as…

Sound · Computer Science 2021-03-04 Dongmei Wang , Takuya Yoshioka , Zhuo Chen , Xiaofei Wang , Tianyan Zhou , Zhong Meng

A promising approach for multi-microphone speech separation involves two deep neural networks (DNN), where the predicted target speech from the first DNN is used to compute signal statistics for time-invariant minimum variance…

Sound · Computer Science 2021-10-04 Zhong-Qiu Wang , Gordon Wichern , Jonathan Le Roux

Deep Neural Networks (DNN) have been successful in en- hancing noisy speech signals. Enhancement is achieved by learning a nonlinear mapping function from the features of the corrupted speech signal to that of the reference clean speech…

Machine Learning · Computer Science 2016-06-16 Zhenzhou Wu , Sunil Sivadas , Yong Kiam Tan , Ma Bin , Rick Siow Mong Goh

We present an approach to deep neural network based (DNN-based) distance estimation in reverberant rooms for supporting geometry calibration tasks in wireless acoustic sensor networks. Signal diffuseness information from acoustic signals is…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-25 Tobias Gburrek , Joerg Schmalenstroeer , Andreas Brendel , Walter Kellermann , Reinhold Haeb-Umbach

Advancements in parallel processing have lead to a surge in multilayer perceptrons' (MLP) applications and deep learning in the past decades. Recurrent Neural Networks (RNNs) give additional representational power to feedforward MLPs by…

Machine Learning · Statistics 2014-10-22 Saahil Ognawala , Justin Bayer

Distant speech recognition is a challenge, particularly due to the corruption of speech signals by reverberation caused by large distances between the speaker and microphone. In order to cope with a wide range of reverberations in…

Computation and Language · Computer Science 2016-08-18 Jeehye Lee , Myungin Lee , Joon-Hyuk Chang

Recurrent neural networks (RNNs) have shown significant improvements in recent years for speech enhancement. However, the model complexity and inference time cost of RNNs are much higher than deep feed-forward neural networks (DNNs).…

Sound · Computer Science 2020-11-12 Cunhang Fan , Bin Liu , Jianhua Tao , Jiangyan Yi , Zhengqi Wen , Leichao Song

In the task of speaker diarization, the number of small-scale meetings accounts for a large proportion. When microphone arrays are employed as a recording device, its spatial information is usually ignored by most researchers. In this…

Sound · Computer Science 2022-10-27 Yuxuan Du , Ruohua Zhou

We present deep learning methods for the design of arrays and single instances of small antennas. Each design instance is conditioned on a target radiation pattern and is required to conform to specific spatial dimensions and to include, as…

Machine Learning · Computer Science 2021-05-11 Shahar Lutati , Lior Wolf

This paper proposes a unified deep speaker embedding framework for modeling speech data with different sampling rates. Considering the narrowband spectrogram as a sub-image of the wideband spectrogram, we tackle the joint modeling problem…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-02 Weicheng Cai , Ming Li

Many recent efforts have been devoted to designing sophisticated deep learning structures, obtaining revolutionary results on benchmark datasets. The success of these deep learning methods mostly relies on an enormous volume of labeled…

Computer Vision and Pattern Recognition · Computer Science 2015-10-20 Jiaji Huang , Qiang Qiu , Robert Calderbank , Guillermo Sapiro

A fundamental challenge in neuroscience is to understand what structure in the world is represented in spatially distributed patterns of neural activity from multiple single-trial measurements. This is often accomplished by learning a…

Neural and Evolutionary Computing · Computer Science 2020-07-01 Jesse A. Livezey , Kristofer E. Bouchard , Edward F. Chang

A DeepCAPA (Deep Learning for Continuous Aperture Array (CAPA)) framework is proposed to learn beamforming in CAPA systems. The beamforming optimization problem is firstly formulated, and it is mathematically proved that the optimal…

Signal Processing · Electrical Eng. & Systems 2024-11-15 Jia Guo , Yuanwei Liu , Hyundong Shin , Arumugam Nallanathan

In this paper, we address the problem of multichannel speech enhancement in the short-time Fourier transform (STFT) domain. A long short-time memory (LSTM) network takes as input a sequence of STFT coefficients associated with a frequency…

Sound · Computer Science 2020-09-24 Xiaofei LI , Radu Horaud

Recently, deep neural network (DNN) has been widely adopted in the design of intelligent communication systems thanks to its strong learning ability and low testing complexity. However, most current offline DNN-based methods still suffer…

Information Theory · Computer Science 2022-02-08 Jiabao Gao , Caijun Zhong , Geoffrey Ye Li , Zhaoyang Zhang

Recently, speech enhancement technologies that are based on deep learning have received considerable research attention. If the spatial information in microphone signals is exploited, microphone arrays can be advantageous under some adverse…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-19 Yicheng Hsu , Yonghan Lee , Mingsian R. Bai

Most deep learning-based multi-channel speech enhancement methods focus on designing a set of beamforming coefficients to directly filter the low signal-to-noise ratio signals received by microphones, which hinders the performance of these…

Sound · Computer Science 2022-02-08 Wenzhe Liu , Andong Li , Chengshi Zheng , Xiaodong Li