English
Related papers

Related papers: DBNET: DOA-driven beamforming network for end-to-e…

200 papers

Deep learning techniques have been used recently to tackle the audio source separation problem. In this work, we propose to use deep fully convolutional denoising autoencoders (CDAEs) for monaural audio source separation. We use as many…

Sound · Computer Science 2017-10-16 Emad M. Grais , Mark D. Plumbley

We propose a method for the blind separation of sounds of musical instruments in audio signals. We describe the individual tones via a parametric model, training a dictionary to capture the relative amplitudes of the harmonics. The model…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-10 Sören Schulze , Johannes Leuschner , Emily J. King

We study the single-channel source separation problem involving orthogonal frequency-division multiplexing (OFDM) signals, which are ubiquitous in many modern-day digital communication systems. Related efforts have been pursued in monaural…

Signal Processing · Electrical Eng. & Systems 2023-06-28 Gary C. F. Lee , Amir Weiss , Alejandro Lancho , Yury Polyanskiy , Gregory W. Wornell

Modern smart glasses leverage advanced audio sensing and machine learning technologies to offer real-time transcribing and captioning services, considerably enriching human experiences in daily communications. However, such systems…

This paper proposes an approach for optimizing a Convolutional BeamFormer (CBF) that can jointly perform denoising (DN), dereverberation (DR), and source separation (SS). First, we develop a blind CBF optimization algorithm that requires no…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-05 Tomohiro Nakatani , Rintaro Ikeshita , Keisuke Kinoshita , Hiroshi Sawada , Shoko Araki

Recent work on monaural source separation has shown that performance can be increased by using fully learned filterbanks with short windows. On the other hand it is widely known that, for conventional beamforming techniques, performance…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-22 Samuele Cornell , Manuel Pariente , François Grondin , Stefano Squartini

Recently, deep learning-based beamforming algorithms have shown promising performance in target speech extraction tasks. However, most systems do not fully utilize spatial information. In this paper, we propose a target speech extraction…

Sound · Computer Science 2023-06-29 Aoqi Guo , Junnan Wu , Peng Gao , Wenbo Zhu , Qinwen Guo , Dazhi Gao , Yujun Wang

A convolution neural network (CNN) based classification method for broadband DOA estimation is proposed, where the phase component of the short-time Fourier transform coefficients of the received microphone signals are directly fed into the…

Sound · Computer Science 2019-12-18 Soumitro Chakrabarty , Emanuël. A. P. Habets

On-device directional hearing requires audio source separation from a given direction while achieving stringent human-imperceptible latency requirements. While neural nets can achieve significantly better performance than traditional…

Sound · Computer Science 2021-12-14 Anran Wang , Maruchi Kim , Hao Zhang , Shyamnath Gollakota

In this paper, we propose a two-step training procedure for source separation via a deep neural network. In the first step we learn a transform (and it's inverse) to a latent space where masking-based separation performance using oracles is…

Machine Learning · Computer Science 2021-05-12 Efthymios Tzinis , Shrikant Venkataramani , Zhepei Wang , Cem Subakan , Paris Smaragdis

Invariance to microphone array configuration is a rare attribute in neural beamformers. Filter-and-sum (FS) methods in this class define the target signal with respect to a reference channel. However, this not only complicates formulation…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-28 Anton Kovalyov , Kashyap Patel , Issa Panahi

Recent research advances in deep neural network (DNN)-based beamformers have shown great promise for speech enhancement under adverse acoustic conditions. Different network architectures and input features have been explored in estimating…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-24 Hsinyu Chang , Yicheng Hsu , Mingsian R. Bai

Far-field speech recognition in noisy and reverberant conditions remains a challenging problem despite recent deep learning breakthroughs. This problem is commonly addressed by acquiring a speech signal from multiple microphones and…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-17 Zhong Meng , Shinji Watanabe , John R. Hershey , Hakan Erdogan

To satisfy the high-resolution requirements of direction-of-arrival (DOA) estimation, conventional deep neural network (DNN)-based methods using grid idea need to significantly increase the number of output classifications and also produce…

Signal Processing · Electrical Eng. & Systems 2024-03-13 Yifan Li , Feng Shu , Jun Zou , Wei Gao , Yaoliang Song , Jiangzhou Wang

We introduce an interpretable deep learning approach for direction of arrival (DOA) estimation with a single snapshot. Classical subspace-based methods like MUSIC and ESPRIT use spatial smoothing on uniform linear arrays for single snapshot…

Signal Processing · Electrical Eng. & Systems 2023-12-01 Ruxin Zheng , Shunqiao Sun , Hongshan Liu , Honglei Chen , Jian Li

Most deep learning-based multi-channel speech enhancement methods focus on designing a set of beamforming coefficients to directly filter the low signal-to-noise ratio signals received by microphones, which hinders the performance of these…

Sound · Computer Science 2022-02-08 Wenzhe Liu , Andong Li , Chengshi Zheng , Xiaodong Li

Acoustic echo cancellation (AEC) in full-duplex communication systems eliminates acoustic feedback. However, nonlinear distortions induced by audio devices, background noise, reverberation, and double-talk reduce the efficiency of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-29 Vinay Kothapally , Yong Xu , Meng Yu , Shi-Xiong Zhang , Dong Yu

We address monaural multi-speaker-image separation in reverberant conditions, aiming at separating mixed speakers but preserving the reverberation of each speaker. A straightforward approach for this task is to directly train end-to-end DNN…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-08 Jingqi Sun , Shulin He , Ruizhe Pang , Zhong-Qiu Wang

The sources separated by most single channel audio source separation techniques are usually distorted and each separated source contains residual signals from the other sources. To tackle this problem, we propose to enhance the separated…

Sound · Computer Science 2016-12-21 Emad M. Grais , Gerard Roma , Andrew J. R. Simpson , Mark D. Plumbley

Network connectivity is one of the major design issues in the context of mobile sensor networks. Due to diverse communication patterns, some nodes lying in high-traffic zones may consume more energy and eventually die out resulting in…

Networking and Internet Architecture · Computer Science 2023-08-10 Abbas Mirzaei , Shahram Zandiyan