English
Related papers

Related papers: WTFormer: A Wavelet Conformer Network for MIMO Spe…

200 papers

Transformer has obtained promising results on cognitive speech signal processing field, which is of interest in various applications ranging from emotion to neurocognitive disorder analysis. However, most works treat speech signal as a…

Sound · Computer Science 2022-03-11 Weidong Chen , Xiaofen Xing , Xiangmin Xu , Jianxin Pang , Lan Du

We consider the task of region-based source separation of reverberant multi-microphone recordings. We assume pre-defined spatial regions with a single active source per region. The objective is to estimate the signals from the individual…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Julian Wechsler , Srikanth Raj Chetupalli , Wolfgang Mack , Emanuël A. P. Habets

With the advent of gravitational-wave astronomy and the discovery of more compact binary coalescences, data quality improvement techniques are desired to handle the complex and overwhelming noise in gravitational wave (GW) observational…

General Relativity and Quantum Cosmology · Physics 2024-02-21 He Wang , Yue Zhou , Zhoujian Cao , Zong-Kuan Guo , Zhixiang Ren

We present a hybrid framework that leverages the trade-off between temporal and frequency precision in audio representations to improve the performance of speech enhancement task. We first show that conventional approaches using specific…

Audio and Speech Processing · Electrical Eng. & Systems 2018-12-24 Jang-Hyun Kim , Jaejun Yoo , Sanghyuk Chun , Adrian Kim , Jung-Woo Ha

Studies have shown that in noisy acoustic environments, providing binaural signals to the user of an assistive listening device may improve speech intelligibility and spatial awareness. This paper presents a binaural speech enhancement…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-11 Vikas Tokala , Eric Grinstein , Mike Brookes , Simon Doclo , Jesper Jensen , Patrick A. Naylor

Identifying multiple speakers without knowing where a speaker's voice is in a recording is a challenging task. This paper proposes a hierarchical network with transformer encoders and memory mechanism to address this problem. The proposed…

Sound · Computer Science 2020-11-02 Yanpei Shi , Mingjie Chen , Qiang Huang , Thomas Hain

This paper introduces a new method for multi-channel time domain speech separation in reverberant environments. A fully-convolutional neural network structure has been used to directly separate speech from multiple microphone recordings,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-12 Jisi Zhang , Catalin Zorila , Rama Doddipatla , Jon Barker

The SepFormer architecture shows very good results in speech separation. Like other learned-encoder models, it uses short frames, as they have been shown to obtain better performance in these cases. This results in a large number of frames…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-06 Danilo de Oliveira , Tal Peer , Timo Gerkmann

While existing end-to-end beamformers achieve impressive performance in various front-end speech processing tasks, they usually encapsulate the whole process into a black box and thus lack adequate interpretability. As an attempt to fill…

Sound · Computer Science 2022-03-17 Andong Li , Guochen Yu , Chengshi Zheng , Xiaodong Li

Transformer has shown advanced performance in speech separation, benefiting from its ability to capture global features. However, capturing local features and channel information of audio sequences in speech separation is equally important.…

Sound · Computer Science 2023-03-08 Zhaoxi Mu , Xinyu Yang , Wenjing Zhu

Recently, multi-channel speech enhancement has drawn much interest due to the use of spatial information to distinguish target speech from interfering signal. To make full use of spatial information and neural network based masking…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-18 Shubo Lv , Yihui Fu , Yukai Jv , Lei Xie , Weixin Zhu , Wei Rao , Yannan Wang

Consumer electronic (CE) devices increasingly rely on wireless local area networks (WLANs). Next generation WLANs will continue to exploit multiple antenna systems to satisfy the growing need for WLAN system capacity. Multiple-input…

Signal Processing · Electrical Eng. & Systems 2018-12-05 Xiaofu Ma , Qinghai Gao , Ji Wang , Vuk Marojevic , Jeffrey H. Reed

For speech-related applications in IoT environments, identifying effective methods to handle interference noises and compress the amount of data in transmissions is essential to achieve high-quality services. In this study, we propose a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-08 You-Jin Li , Syu-Siang Wang , Yu Tsao , Borching Su

We present a novel model designed for resource-efficient multichannel speech enhancement in the time domain, with a focus on low latency, lightweight, and low computational requirements. The proposed model incorporates explicit spatial and…

Sound · Computer Science 2024-01-17 Ashutosh Pandey , Buye Xu

To improve speech intelligibility and speech quality in noisy environments, binaural noise reduction algorithms for head-mounted assistive listening devices are of crucial importance. Several binaural noise reduction algorithms such as the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-15 Marvin Tammen , Simon Doclo

Biomedical signal classification presents unique challenges due to long sequences, complex temporal dynamics, and multi-scale frequency patterns that are poorly captured by standard transformer architectures. We propose WaveFormer, a…

Machine Learning · Computer Science 2026-02-13 Habib Irani , Bikram De , Vangelis Metsis

Multi-channel speech enhancement utilizes spatial information from multiple microphones to extract the target speech. However, most existing methods do not explicitly model spatial cues, instead relying on implicit learning from…

Sound · Computer Science 2023-09-20 Jiahui Pan , Shulin He , Hui Zhang , Xueliang Zhang

In this paper, we address the problem of multichannel speech enhancement in the short-time Fourier transform (STFT) domain. A long short-time memory (LSTM) network takes as input a sequence of STFT coefficients associated with a frequency…

Sound · Computer Science 2020-09-24 Xiaofei LI , Radu Horaud

Semantic communications focus on prioritizing the understanding of the meaning behind transmitted data and ensuring the successful completion of tasks that motivate the exchange of information. However, when devices rely on different…

Machine Learning · Computer Science 2025-07-25 Mario Edoardo Pandolfo , Simone Fiorellino , Emilio Calvanese Strinati , Paolo Di Lorenzo

Speech emotion recognition is crucial to human-computer interaction. The temporal regions that represent different emotions scatter in different parts of the speech locally. Moreover, the temporal scales of important information may vary…

Sound · Computer Science 2023-03-06 Shuaiqi Chen , Xiaofen Xing , Weibin Zhang , Weidong Chen , Xiangmin Xu