English
Related papers

Related papers: Microphone Array Signal Processing and Deep Learni…

200 papers

Analysis of respiratory sounds increases its importance every day. Many different methods are available in the analysis, and new techniques are continuing to be developed to further improve these methods. Features are extracted from audio…

Sound · Computer Science 2021-01-22 Osman Balli , Yakup Kutlu

Multi-channel speech enhancement extracts speech using multiple microphones that capture spatial cues. Effectively utilizing directional information is key for multi-channel enhancement. Deep learning shows great potential on multi-channel…

Sound · Computer Science 2023-09-21 Jiahui Pan , Pengjie Shen , Hui Zhang , Xueliang Zhang

Multi-channel speech enhancement utilizes spatial information from multiple microphones to extract the target speech. However, most existing methods do not explicitly model spatial cues, instead relying on implicit learning from…

Sound · Computer Science 2023-09-20 Jiahui Pan , Shulin He , Hui Zhang , Xueliang Zhang

We consider the problem of separating speech sources captured by multiple spatially separated devices, each of which has multiple microphones and samples its signals at a slightly different rate. Most asynchronous array processing methods…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-12 Ryan M. Corey , Andrew C. Singer

We consider the task of region-based source separation of reverberant multi-microphone recordings. We assume pre-defined spatial regions with a single active source per region. The objective is to estimate the signals from the individual…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Julian Wechsler , Srikanth Raj Chetupalli , Wolfgang Mack , Emanuël A. P. Habets

Noise reduction techniques based on deep learning have demonstrated impressive performance in enhancing the overall quality of recorded speech. While these approaches are highly performant, their application in audio engineering can be…

Sound · Computer Science 2023-10-18 Christian J. Steinmetz , Thomas Walther , Joshua D. Reiss

In multi-speaker scenarios, leveraging spatial features is essential for enhancing target speech. While with limited microphone arrays, developing a compact multi-channel speech enhancement system remains challenging, especially in…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-31 Wen Wen , Qiang Zhou , Yu Xi , Haoyu Li , Ziqi Gong , Kai Yu

One key aspect differentiating data-driven single- and multi-channel speech enhancement and dereverberation methods is that both the problem formulation and complexity of the solutions are considerably more challenging in the latter case.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-24 Arthur N. dos Santos , Bruno S. Masiero , Túlio C. L. Mateus

Fully exploiting ad-hoc microphone networks for distant speech recognition is still an open issue. Empirical evidence shows that being able to select the best microphone leads to significant improvements in recognition without any…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-15 Samuele Cornell , Alessio Brutti , Marco Matassoni , Stefano Squartini

We present a novel model designed for resource-efficient multichannel speech enhancement in the time domain, with a focus on low latency, lightweight, and low computational requirements. The proposed model incorporates explicit spatial and…

Sound · Computer Science 2024-01-17 Ashutosh Pandey , Buye Xu

Speech enhancement in ad-hoc microphone arrays is often hindered by the asynchronization of the devices composing the microphone array. Asynchronization comes from sampling time offset and sampling rate offset which inevitably occur when…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-01 Nicolas Furnon , Romain Serizel , Slim Essid , Irina Illina

Recently, speech enhancement technologies that are based on deep learning have received considerable research attention. If the spatial information in microphone signals is exploited, microphone arrays can be advantageous under some adverse…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-19 Yicheng Hsu , Yonghan Lee , Mingsian R. Bai

In this contribution, we present a novel online approach to multichannel speech enhancement. The proposed method estimates the enhanced signal through a filter-and-sum framework. More specifically, complex-valued masks are estimated by a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-09 Mhd Modar Halimeh , Walter Kellermann

Eliminating the negative effect of non-stationary environmental noise is a long-standing research topic for automatic speech recognition that stills remains an important challenge. Data-driven supervised approaches, including ones based on…

To phased microphone array for sound source localization, algorithm with both high computational efficiency and high precision is a persistent pursuit. In this paper convolutional neural network (CNN) a kind of deep learning is…

Audio and Speech Processing · Electrical Eng. & Systems 2018-02-14 Wei Ma , Xun Liu

Deep learning has dramatically improved the performance of speech recognition systems through learning hierarchies of features optimized for the task at hand. However, true end-to-end learning, where features are learned directly from…

Computation and Language · Computer Science 2016-04-06 Zhenyao Zhu , Jesse H. Engel , Awni Hannun

Deep neural networks (DNNs) are very effective for multichannel speech enhancement with fixed array geometries. However, it is not trivial to use DNNs for ad-hoc arrays with unknown order and placement of microphones. We propose a novel…

Sound · Computer Science 2022-07-06 Ashutosh Pandey , Buye Xu , Anurag Kumar , Jacob Donley , Paul Calamia , DeLiang Wang

We present a deep neural network approach for encoding microphone array signals into Ambisonics that generalizes to arbitrary microphone array configurations with fixed microphone count but varying locations and frequency-dependent…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-02 Mikko Heikkinen , Archontis Politis , Konstantinos Drossos , Tuomas Virtanen

Recent works on deep non-linear spatially selective filters demonstrate exceptional enhancement performance with computationally lightweight architectures for stationary speakers of known directions. However, to maintain this performance in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-08 Jakob Kienegger , Alina Mannanova , Huajian Fang , Timo Gerkmann

We present a hybrid framework that leverages the trade-off between temporal and frequency precision in audio representations to improve the performance of speech enhancement task. We first show that conventional approaches using specific…

Audio and Speech Processing · Electrical Eng. & Systems 2018-12-24 Jang-Hyun Kim , Jaejun Yoo , Sanghyuk Chun , Adrian Kim , Jung-Woo Ha