English
Related papers

Related papers: Learning an Interpretable End-to-End Network for R…

200 papers

The field of speech recognition is in the midst of a paradigm shift: end-to-end neural networks are challenging the dominance of hidden Markov models as a core technology. Using an attention mechanism in a recurrent encoder-decoder…

Sound · Computer Science 2017-03-16 Tsubasa Ochiai , Shinji Watanabe , Takaaki Hori , John R. Hershey

We introduce an interpretable deep learning approach for direction of arrival (DOA) estimation with a single snapshot. Classical subspace-based methods like MUSIC and ESPRIT use spatial smoothing on uniform linear arrays for single snapshot…

Signal Processing · Electrical Eng. & Systems 2023-12-01 Ruxin Zheng , Shunqiao Sun , Hongshan Liu , Honglei Chen , Jian Li

Recent studies have demonstrated that incorporating auxiliary information, such as speaker voiceprint or visual cues, can substantially improve Speech Enhancement (SE) performance. However, single-channel methods often yield suboptimal…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-06 Chihyun Liu , Jiaxuan Fan , Mingtung Sun , Michael Anthony , Mingsian R. Bai , Yu Tsao

The spatial covariance matrix has been considered to be significant for beamformers. Standing upon the intersection of traditional beamformers and deep neural networks, we propose a causal neural beamformer paradigm called Embedding and…

Sound · Computer Science 2021-09-03 Andong Li , Wenzhe Liu , Chengshi Zheng , Xiaodong Li

Recently, direct modeling of raw waveforms using deep neural networks has been widely studied for a number of tasks in audio domains. In speaker verification, however, utilization of raw waveforms is in its preliminary phase, requiring…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-18 Jee-weon Jung , Hee-Soo Heo , Ju-ho Kim , Hye-jin Shim , Ha-Jin Yu

This paper introduces an explainable DNN-based beamformer with a postfilter (ExNet-BF+PF) for multichannel signal processing. Our approach combines the U-Net network with a beamformer structure to address this problem. The method involves a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-19 Adi Cohen , Daniel Wong , Jung-Suk Lee , Sharon Gannot

In this paper, we propose a novel deep unsupervised learning-based approach that jointly optimizes antenna selection and hybrid beamforming to improve the hardware and spectral efficiencies of massive multiple-input-multiple-output (MIMO)…

Signal Processing · Electrical Eng. & Systems 2022-01-24 Zhiyan Liu , Yuwen Yang , Feifei Gao , Ting Zhou , Hongbing Ma

Audio classification can distinguish different kinds of sounds, which is helpful for intelligent applications in daily life. However, it remains a challenging task since the sound events in an audio clip is probably multiple, even…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-22 Jiaxu Chen , Jing Hao , Kai Chen , Di Xie , Shicai Yang , Shiliang Pu

While deep neural networks have achieved impressive success in image compressive sensing (CS), most of them lack flexibility when dealing with multi-ratio tasks and multi-scene images in practical applications. To tackle these challenges,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Di You , Jingfen Xie , Jian Zhang

Invariance to microphone array configuration is a rare attribute in neural beamformers. Filter-and-sum (FS) methods in this class define the target signal with respect to a reference channel. However, this not only complicates formulation…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-28 Anton Kovalyov , Kashyap Patel , Issa Panahi

We present a novel end-to-end deep learning-based adaptation control algorithm for frequency-domain adaptive system identification. The proposed method exploits a deep neural network to map observed signal features to corresponding…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-07 Thomas Haubner , Andreas Brendel , Walter Kellermann

Acoustic mapping techniques have long been used in spatial audio processing for direction of arrival estimation (DoAE). Traditional beamforming methods for acoustic mapping, while interpretable, often rely on iterative solvers that can be…

Sound · Computer Science 2025-07-10 Adrian S. Roman , Iran R. Roman , Juan P. Bello

This paper investigates a flexible intelligent metasurface (FIM)-enabled wireless communication system that integrates simultaneously transmitting and reflecting beyond diagonal reconfigurable intelligent surfaces (STAR-BD-RIS) with…

Signal Processing · Electrical Eng. & Systems 2026-04-23 Armin Farhadi , Maryam Cheraghy , Eduard Jorswieck

It is critical to design efficient beamforming in reconfigurable intelligent surface (RIS)-aided integrated sensing and communication (ISAC) systems for enhancing spectrum utilization. However, conventional methods often have limitations,…

Signal Processing · Electrical Eng. & Systems 2024-05-16 Junjie Ye , Lei Huang , Zhen Chen , Peichang Zhang , Mohamed Rihan

Machine learning approaches to auditory object recognition are traditionally based on engineered features such as those derived from the spectrum or cepstrum. More recently, end-to-end classification systems in image and auditory…

Dynamic metasurface antennas (DMAs) are a promising hybrid analog/digital beamforming technology to realize next-generation wireless systems with low cost, footprint, and power consumption. The research on DMA-empowered wireless systems is…

Signal Processing · Electrical Eng. & Systems 2025-06-12 François Yven , Jean Tapie , Jérôme Sol , Philipp del Hougne

Beamforming is one of the key techniques in millimeter wave (mmWave) multi-input multi-output (MIMO) communications. Designing appropriate beamforming not only improves the quality and strength of the received signal, but also can help…

Signal Processing · Electrical Eng. & Systems 2020-08-14 Xueyuan Wang , M. Cenk Gursoy

With the aim of developing a fast yet accurate algorithm for compressive sensing (CS) reconstruction of natural images, we combine in this paper the merits of two existing categories of CS methods: the structure insights of traditional…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Jian Zhang , Bernard Ghanem

Channel estimation and beamforming play critical roles in frequency-division duplexing (FDD) massive multiple-input multiple-output (MIMO) systems. However, these two modules have been treated as two stand-alone components, which makes it…

Signal Processing · Electrical Eng. & Systems 2021-08-04 Yifan Ma , Yifei Shen , Xianghao Yu , Jun Zhang , S. H. Song , Khaled B. Letaief

This paper introduces a novel convolutional neural networks (CNN) framework tailored for end-to-end audio deep learning models, presenting advancements in efficiency and explainability. By benchmarking experiments on three standard speech…

Sound · Computer Science 2024-05-06 Linh Vu , Thu Tran , Wern-Han Lim , Raphael Phan