English
Related papers

Related papers: TRUNet: Transformer-Recurrent-U Network for Multi-…

200 papers

Separation of simultaneously active multiple speakers is a difficult task in environments with strong reverberation and many background noise sources. This paper uses the relative transfer matrix (ReTM), a generalization of the relative…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-13 Wageesha N. Manamperi , Thushara D. Abhayapala

In real-world settings, speech signals are almost always affected by reverberation produced by the working environment; these corrupted signals need to be \emph{dereverberated} prior to performing, e.g., speech recognition, speech-to-text…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-06 Diego León , Felipe Tobar

Beamforming has been extensively investigated for multi-channel audio processing tasks. Recently, learning-based beamforming methods, sometimes called \textit{neural beamformers}, have achieved significant improvements in both signal…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-02 Yi Luo , Enea Ceolini , Cong Han , Shih-Chii Liu , Nima Mesgarani

This paper introduces an area-based source separation method designed for virtual meeting scenarios. The aim is to preserve speech signals from an unspecified number of sources within a defined spatial area in front of a linear microphone…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-20 Martin Strauss , Okan Köpüklü

Deep clustering is the first method to handle general audio separation scenarios with multiple sources of the same type and an arbitrary number of sources, performing impressively in speaker-independent speech separation tasks. However,…

Machine Learning · Statistics 2017-11-30 Yi Luo , Zhuo Chen , John R. Hershey , Jonathan Le Roux , Nima Mesgarani

We present a novel model designed for resource-efficient multichannel speech enhancement in the time domain, with a focus on low latency, lightweight, and low computational requirements. The proposed model incorporates explicit spatial and…

Sound · Computer Science 2024-01-17 Ashutosh Pandey , Buye Xu

We propose a neural network model that can separate target speech sources from interfering sources at different angular regions using two microphones. The model is trained with simulated room impulse responses (RIRs) using omni-directional…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-18 Yang Yang , George Sung , Shao-Fu Shih , Hakan Erdogan , Chehung Lee , Matthias Grundmann

Automatic medical image segmentation has made great progress benefit from the development of deep learning. However, most existing methods are based on convolutional neural networks (CNNs), which fail to build long-range dependencies and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Ailiang Lin , Bingzhi Chen , Jiayu Xu , Zheng Zhang , Guangming Lu

We present a single-stage casual waveform-to-waveform multichannel model that can separate moving sound sources based on their broad spatial locations in a dynamic acoustic scene. We divide the scene into two spatial regions containing,…

Sound · Computer Science 2022-07-01 Dejan Markovic , Alexandre Defossez , Alexander Richard

Recent advances in the design of neural network architectures, in particular those specialized in modeling sequences, have provided significant improvements in speech separation performance. In this work, we propose to use a bio-inspired…

Sound · Computer Science 2021-12-07 Xiaolin Hu , Kai Li , Weiyi Zhang , Yi Luo , Jean-Marie Lemercier , Timo Gerkmann

Spatially distributed peripheral nerve recordings can be used to reconstruct motor intention and improve natural control of prosthetics However, many existing clinical solutions rely on percutaneous wires to access peripheral nerves; these…

Systems and Control · Electrical Eng. & Systems 2026-04-28 Jade Pinkenburg , Changuk Lee , Mohammad Meraj Ghanbari , Cem Yalcin , Miguel Montalban , Rikky Muller

Integration of multiple microphone data is one of the key ways to achieve robust speech recognition in noisy environments or when the speaker is located at some distance from the input device. Signal processing techniques such as…

Machine Learning · Computer Science 2016-01-11 Suyoun Kim , Ian Lane

Ultrasound tongue imaging (UTI) is a non-invasive and cost-effective tool for studying speech articulation, motor control, and related disorders. However, real-time tongue contour segmentation remains challenging due to low signal-to-noise…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Alisher Myrgyyassov , Zhen Song , Yu Sun , Bruce Xiao Wang , Min Ney Wong , Yongping Zheng

This study proposes a multi-microphone complex spectral mapping approach for speech dereverberation on a fixed array geometry. In the proposed approach, a deep neural network (DNN) is trained to predict the real and imaginary (RI)…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-05 Zhong-Qiu Wang , DeLiang Wang

The presence of multiple talkers in the surrounding environment poses a difficult challenge for real-time speech communication systems considering the constraints on network size and complexity. In this paper, we present Personalized…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-09 Ritwik Giri , Shrikant Venkataramani , Jean-Marc Valin , Umut Isik , Arvindh Krishnaswamy

Inspired by the tremendous success of deep Convolutional Neural Networks as generic feature extractors for images, we propose TimeNet: a deep recurrent neural network (RNN) trained on diverse time series in an unsupervised manner using…

Machine Learning · Computer Science 2017-06-28 Pankaj Malhotra , Vishnu TV , Lovekesh Vig , Puneet Agarwal , Gautam Shroff

Multi-channel speech enhancement seeks to utilize spatial information to distinguish target speech from interfering signals. While deep learning approaches like the dual-path convolutional recurrent network (DPCRN) have made strides,…

Sound · Computer Science 2023-09-20 Jiahui Pan , Shulin He , Tianci Wu , Hui Zhang , Xueliang Zhang

In daily listening environments, speech is always distorted by background noise, room reverberation and interference speakers. With the developing of deep learning approaches, much progress has been performed on monaural multi-speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-04 Chao Ma , Dongmei Li , Xupeng Jia

Deep neural networks have become an indispensable technique for audio source separation (ASS). It was recently reported that a variant of CNN architecture called MMDenseNet was successfully employed to solve the ASS problem of estimating…

Sound · Computer Science 2018-05-30 Naoya Takahashi , Nabarun Goswami , Yuki Mitsufuji

Multiple moving sound source localization in real-world scenarios remains a challenging issue due to interaction between sources, time-varying trajectories, distorted spatial cues, etc. In this work, we propose to use deep learning…

Sound · Computer Science 2022-02-17 Bing Yang , Hong Liu , Xiaofei Li