English
Related papers

Related papers: Mask-based Neural Beamforming for Moving Speakers …

200 papers

The source separation-based speech enhancement problem with multiple beamforming in reverberant indoor environments is addressed in this paper. We propose that more generic solutions should cope with time-varying dynamic scenarios with…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-05 Alejandro Díaz , Diego Pincheira , Rodrigo Mahu , Nestor Becerra Yoma

Millimeter wave (mmWave) communication, utilizing beamforming techniques to address the inherent path loss limitation, is considered as one of the key technologies to support ever increasing high throughput and low latency demands of…

Networking and Internet Architecture · Computer Science 2026-02-17 Muhammad Baqer Mollah , Honggang Wang , Mohammad Ataul Karim , Hua Fang

Transformer-based acoustic modeling has achieved great suc-cess for both hybrid and sequence-to-sequence speech recogni-tion. However, it requires access to the full sequence, and thecomputational cost grows quadratically with respect to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Chunyang Wu , Yongqiang Wang , Yangyang Shi , Ching-Feng Yeh , Frank Zhang

Recently, deep learning-based beamforming algorithms have shown promising performance in target speech extraction tasks. However, most systems do not fully utilize spatial information. In this paper, we propose a target speech extraction…

Sound · Computer Science 2023-06-29 Aoqi Guo , Junnan Wu , Peng Gao , Wenbo Zhu , Qinwen Guo , Dazhi Gao , Yujun Wang

In this paper, we introduce spatial attention for refining the information in multi-direction neural beamformer for far-field automatic speech recognition. Previous approaches of neural beamformers with multiple look directions, such as the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-10 Weipeng He , Lu Lu , Biqiao Zhang , Jay Mahadeokar , Kaustubh Kalgaonkar , Christian Fuegen

For supervised speech enhancement, contextual information is important for accurate spectral mapping. However, commonly used deep neural networks (DNNs) are limited in capturing temporal contexts. To leverage long-term contexts for tracking…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-13 Xinmeng Xu , Jianjun Hao

The pervasive nature of wireless telecommunication has made it the foundation for mainstream technologies like automation, smart vehicles, virtual reality, and unmanned aerial vehicles. As these technologies experience widespread adoption…

Information Theory · Computer Science 2023-07-21 Jaspreet Kaur , Satyam Bhatti , Olaoluwa R Popoola , Muhammad Ali Imran , Rami Ghannam , Qammer H Abbasi , Hasan T Abbas

This paper proposes an approach for optimizing a Convolutional BeamFormer (CBF) that can jointly perform denoising (DN), dereverberation (DR), and source separation (SS). First, we develop a blind CBF optimization algorithm that requires no…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-05 Tomohiro Nakatani , Rintaro Ikeshita , Keisuke Kinoshita , Hiroshi Sawada , Shoko Araki

Spectral mask estimation using bidirectional long short-term memory (BLSTM) neural networks has been widely used in various speech enhancement applications, and it has achieved great success when it is applied to multichannel enhancement…

Audio and Speech Processing · Electrical Eng. & Systems 2018-03-28 Aswin Shanmugam Subramanian , Szu-Jui Chen , Shinji Watanabe

Recently, our proposed recurrent neural network (RNN) based all deep learning minimum variance distortionless response (ADL-MVDR) beamformer method yielded superior performance over the conventional MVDR by replacing the matrix inversion…

Sound · Computer Science 2021-04-27 Xiyun Li , Yong Xu , Meng Yu , Shi-Xiong Zhang , Jiaming Xu , Bo Xu , Dong Yu

Beamforming techniques are utilized in millimeter wave (mmWave) communication to address the inherent path loss limitation, thereby establishing and maintaining reliable connections. However, adopting standard defined beamforming approach…

Networking and Internet Architecture · Computer Science 2025-09-16 Muhammad Baqer Mollah , Honggang Wang , Hua Fang

Beamforming structures with fixed beam codebooks provide economical solutions for millimeter wave (mmWave) communications due to the low hardware cost. However, the training overhead to search for the optimal beamforming configuration is…

Information Theory · Computer Science 2019-12-30 Ruichen Deng , Sheng Chen , Sheng Zhou , Zhisheng Niu , Wei Zhang

Transmit beamforming for underwater acoustic communication is challenging because it requires perfect knowledge of the channel to the receiver in advance. In practice, channel estimates must be learned through feedback and are often noisy…

Signal Processing · Electrical Eng. & Systems 2026-05-15 Diego A. Cuji , Andrew C. Singer , Milica Stojanovic

Deep spatially selective filters achieve high-quality enhancement with real-time capable architectures for stationary speakers of known directions. To retain this level of performance in dynamic scenarios when only the speakers' initial…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-26 Jakob Kienegger , Timo Gerkmann

The performance of single channel source separation algorithms has improved greatly in recent times with the development and deployment of neural networks. However, many such networks continue to operate on the magnitude spectrogram of a…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-08 Shrikant Venkataramani , Paris Smaragdis

Far-field speech recognition in noisy and reverberant conditions remains a challenging problem despite recent deep learning breakthroughs. This problem is commonly addressed by acquiring a speech signal from multiple microphones and…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-17 Zhong Meng , Shinji Watanabe , John R. Hershey , Hakan Erdogan

The state of the art in learning meaningful semantic representations of words is the Transformer model and its attention mechanisms. Simply put, the attention mechanisms learn to attend to specific parts of the input dispensing recurrence…

Computation and Language · Computer Science 2020-12-24 Dongsheng Wang , Casper Hansen , Lucas Chaves Lima , Christian Hansen , Maria Maistro , Jakob Grue Simonsen , Christina Lioma

Far-field speech recognition is a challenging task that conventionally uses signal processing beamforming to attack noise and interference problem. But the performance has been found usually limited due to heavy reliance on environmental…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-08 Dongdi Zhao , Jianbo Ma , Lu Lu , Jinke Li , Xuan Ji , Lei Zhu , Fuming Fang , Ming Liu , Feijun Jiang

Recent works on deep non-linear spatially selective filters demonstrate exceptional enhancement performance with computationally lightweight architectures for stationary speakers of known directions. However, to maintain this performance in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-08 Jakob Kienegger , Alina Mannanova , Huajian Fang , Timo Gerkmann

Deep learning-based direction-of-arrival (DoA) estimation has gained increasing popularity. A popular family of DoA estimation algorithms is beamforming methods, which operate by constructing a spatial filter that is applied to array…

Computational Engineering, Finance, and Science · Computer Science 2025-12-25 Xuyao Deng , Yong Dou , Kele Xu