English
Related papers

Related papers: Multichannel Loss Function for Supervised Speech S…

200 papers

This paper presents, in the context of multi-channel ASR, a method to adapt a mask based, statistically optimal beamforming approach to a speaker of interest. The beamforming vector of the statistically optimal beamformer is computed by…

Computation and Language · Computer Science 2018-06-21 Tobias Menne , Ralf Schlüter , Hermann Ney

In ultrasound (US) imaging, various types of adaptive beamforming techniques have been investigated to improve the resolution and contrast-to-noise ratio of the delay and sum (DAS) beamformers. Unfortunately, the performance of these…

Image and Video Processing · Electrical Eng. & Systems 2020-02-25 Shujaat Khan , Jaeyoung Huh , Jong Chul Ye

Single-channel, speaker-independent speech separation methods have recently seen great progress. However, the accuracy, latency, and computational cost of such methods remain insufficient. The majority of the previous methods have…

Sound · Computer Science 2019-05-16 Yi Luo , Nima Mesgarani

We present a novel model designed for resource-efficient multichannel speech enhancement in the time domain, with a focus on low latency, lightweight, and low computational requirements. The proposed model incorporates explicit spatial and…

Sound · Computer Science 2024-01-17 Ashutosh Pandey , Buye Xu

Far-field speech recognition is a challenging task that conventionally uses signal processing beamforming to attack noise and interference problem. But the performance has been found usually limited due to heavy reliance on environmental…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-08 Dongdi Zhao , Jianbo Ma , Lu Lu , Jinke Li , Xuan Ji , Lei Zhu , Fuming Fang , Ming Liu , Feijun Jiang

Estimating time-frequency domain masks for speech enhancement using deep learning approaches has recently become a popular field of research. In this paper, we propose a mask-based speech enhancement framework by using concatenated…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-29 Ziyi Xu , Maximilian Strake , Tim Fingscheidt

Deep neural networks are often coupled with traditional spatial filters, such as MVDR beamformers for effectively exploiting spatial information. Even though single-stage end-to-end supervised models can obtain impressive enhancement,…

Sound · Computer Science 2022-04-07 Asutosh Pandey , Buye Xu , Anurag Kumar , Jacob Donley , Paul Calamia , DeLiang Wang

This paper proposes an end-to-end approach for single-channel speaker-independent multi-speaker speech separation, where time-frequency (T-F) masking, the short-time Fourier transform (STFT), and its inverse are represented as layers within…

Sound · Computer Science 2018-04-30 Zhong-Qiu Wang , Jonathan Le Roux , DeLiang Wang , John R. Hershey

Recent single-channel speech enhancement methods based on deep neural networks (DNNs) have achieved remarkable results, but there are still generalization problems in real scenes. Like other data-driven methods, DNN-based speech enhancement…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-12 Lu Zhang , Mingjiang Wang , Andong Li , Zehua Zhang , Xuyi Zhuang

We propose TF-GridNet for speech separation. The model is a novel deep neural network (DNN) integrating full- and sub-band modeling in the time-frequency (T-F) domain. It stacks several blocks, each consisting of an intra-frame full-band…

Beamforming has been extensively investigated for multi-channel audio processing tasks. Recently, learning-based beamforming methods, sometimes called \textit{neural beamformers}, have achieved significant improvements in both signal…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-02 Yi Luo , Enea Ceolini , Cong Han , Shih-Chii Liu , Nima Mesgarani

Time-domain audio separation network (TasNet) has achieved remarkable performance in blind source separation (BSS). Classic multi-channel speech processing framework employs signal estimation and beamforming. For example, Beam-TasNet links…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-13 Hangting Chen , Yang Yi , Dang Feng , Pengyuan Zhang

Time-domain training criteria have proven to be very effective for the separation of single-channel non-reverberant speech mixtures. Likewise, mask-based beamforming has shown impressive performance in multi-channel reverberant speech…

This paper shows that deep neural network (DNN) can be used for efficient and distributed channel estimation, quantization, feedback, and downlink multiuser precoding for a frequency-division duplex massive multiple-input multiple-output…

Information Theory · Computer Science 2021-01-27 Foad Sohrabi , Kareem M. Attiah , Wei Yu

Speaker-independent speech separation has achieved remarkable performance in recent years with the development of deep neural network (DNN). Various network architectures, from traditional convolutional neural network (CNN) and recurrent…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-17 Xue Yang , Changchun Bao

This paper introduces a deep learning (DL)-based framework for task-based ultrasound (US) beamforming, aiming to enhance clinical outcomes by integrating specific clinical tasks directly into the beamforming process. Task-based beamforming…

Image and Video Processing · Electrical Eng. & Systems 2025-02-04 Ariel Amar , Ahuva Grubstein , Eli Atar , Keren Peri-Hanania , Nimrod Glazer , Ronnie Rosen , Shlomi Savariego , Yonina C. Eldar

This paper describes our submission to the L3DAS22 Challenge Task 1, which consists of speech enhancement with 3D Ambisonic microphones. The core of our approach combines Deep Neural Network (DNN) driven complex spectral mapping with linear…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-25 Yen-Ju Lu , Samuele Cornell , Xuankai Chang , Wangyou Zhang , Chenda Li , Zhaoheng Ni , Zhong-Qiu Wang , Shinji Watanabe

In this paper, we present the Blind Speech Separation and Dereverberation (BSSD) network, which performs simultaneous speaker separation, dereverberation and speaker identification in a single neural network. Speaker separation is guided by…

Sound · Computer Science 2021-11-08 Lukas Pfeifenberger , Franz Pernkopf

This paper investigates a learning solution for robust beamforming optimization in downlink multi-user systems. A base station (BS) identifies efficient multi-antenna transmission strategies only with imperfect channel state information…

Information Theory · Computer Science 2021-03-03 Junbeom Kim , Hoon Lee , Seok-Hwan Park

Spatial aliasing affects spaced microphone arrays, causing directional ambiguity above certain frequencies, degrading spatial and spectral accuracy of beamformers. Given the limitations of conventional signal processing and the scarcity of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-21 Mateusz Guzik , Giulio Cengarle , Daniel Arteaga