English
Related papers

Related papers: Learning Deep Direct-Path Relative Transfer Functi…

200 papers

Transfer learning is critical for efficient information transfer across multiple related learning problems. A simple, yet effective transfer learning approach utilizes deep neural networks trained on a large-scale task for feature…

Sound · Computer Science 2021-06-23 Anurag Kumar , Yun Wang , Vamsi Krishna Ithapu , Christian Fuegen

The Forward-Forward (FF) algorithm was recently proposed as a local learning method to address the limitations of backpropagation (BP), offering biological plausibility along with memory-efficient and highly parallelized computational…

Neural and Evolutionary Computing · Computer Science 2024-08-28 Yujie Wu , Siyuan Xu , Jibin Wu , Lei Deng , Mingkun Xu , Qinghao Wen , Guoqi Li

Deep neural networks (DNNs) have greatly benefited direction of arrival (DoA) estimation methods for speech source localization in noisy environments. However, their localization accuracy is still far from satisfactory due to the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-21 Kuan-Lin Chen , Ching-Hua Lee , Bhaskar D. Rao , Harinath Garudadri

In this paper we present a new robust sound source localization and tracking method using an array of eight microphones (US patent pending) . The method uses a steered beamformer based on the reliability-weighted phase transform (RWPHAT)…

Robotics · Computer Science 2016-04-07 Jean-Marc Valin , François Michaud , Jean Rouat

A neural network is essentially a high-dimensional complex mapping model by adjusting network weights for feature fitting. However, the spectral bias in network training leads to unbearable training epochs for fitting the high-frequency…

Signal Processing · Electrical Eng. & Systems 2021-06-22 Zhi Zeng , Pengpeng Shi , Fulei Ma , Peihan Qi

In many multi-microphone algorithms, an estimate of the relative transfer functions (RTFs) of the desired speaker is required. Recently, a computationally efficient RTF vector estimation method was proposed for acoustic sensor networks,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-07 Wiebke Middelberg , Simon Doclo

In this paper we consider a binaural hearing aid setup, where in addition to the head-mounted microphones an external microphone is available. For this setup, we investigate the performance of several relative transfer function (RTF) vector…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-19 Daniel Fejgin , Simon Doclo

We propose a direct domain adaptation (DDA) approach to enrich the training of supervised neural networks on synthetic data by features from real-world data. The process involves a series of linear operations on the input features to the NN…

Machine Learning · Computer Science 2021-08-18 Tariq Alkhalifah , Oleg Ovcharenko

Measuring personal head-related transfer functions (HRTFs) is essential in binaural audio. Personal HRTFs are not only required for binaural rendering and for loudspeaker-based binaural reproduction using crosstalk cancellation, but they…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-12 Tobias Kabzinski , Peter Jax

Studies have shown that in noisy acoustic environments, providing binaural signals to the user of an assistive listening device may improve speech intelligibility and spatial awareness. This paper presents a binaural speech enhancement…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-11 Vikas Tokala , Eric Grinstein , Mike Brookes , Simon Doclo , Jesper Jensen , Patrick A. Naylor

This paper introduces a new localization method called SVD-PHAT. The SVD-PHAT method relies on Singular Value Decomposition of the SRP-PHAT projection matrix. A k-d tree is also proposed to speed up the search for the most likely direction…

Audio and Speech Processing · Electrical Eng. & Systems 2019-02-12 Francois Grondin , James Glass

The decoupling-style concept begins to ignite in the speech enhancement area, which decouples the original complex spectrum estimation task into multiple easier sub-tasks i.e., magnitude-only recovery and the residual complex spectrum…

Sound · Computer Science 2022-08-02 Guochen Yu , Andong Li , Hui Wang , Yutian Wang , Yuxuan Ke , Chengshi Zheng

Humans can robustly recognize and localize objects by using visual and/or auditory cues. While machines are able to do the same with visual data already, less work has been done with sounds. This work develops an approach for scene…

Sound · Computer Science 2022-03-01 Dengxin Dai , Arun Balajee Vasudevan , Jiri Matas , Luc Van Gool

A significant research problem of recent interest is the localization of targets like vessels, surgical needles, and tumors in photoacoustic (PA) images. To achieve accurate localization, a high photoacoustic signal-to-noise ratio (SNR) is…

Image and Video Processing · Electrical Eng. & Systems 2021-05-03 Amirsaeed Yazdani , Sumit Agrawal , Kerrick Johnstonbaugh , Sri-Rajasekhar Kothapalli , Vishal Monga

Deep neural networks have frequently been used to directly learn representations useful for a given task from raw input data. In terms of overall performance metrics, machine learning solutions employing deep representations frequently have…

Machine Learning · Computer Science 2019-10-21 Jaehun Kim , Julián Urbano , Cynthia C. S. Liem , Alan Hanjalic

Decentralized learning strategies allow a collection of agents to learn efficiently from local data sets without the need for central aggregation or orchestration. Current decentralized learning paradigms typically rely on an averaging…

Machine Learning · Computer Science 2025-01-24 Muyun Li , Aaron Fainman , Stefan Vlaski

The images and sounds that we perceive undergo subtle but geometrically consistent changes as we rotate our heads. In this paper, we use these cues to solve a problem we call Sound Localization from Motion (SLfM): jointly estimating camera…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Ziyang Chen , Shengyi Qian , Andrew Owens

We propose an end-to-end speech enhancement method with trainable time-frequency~(T-F) transform based on invertible deep neural network~(DNN). The resent development of speech enhancement is brought by using DNN. The ordinary DNN-based…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-17 Daiki Takeuchi , Kohei Yatabe , Yuma Koizumi , Yasuhiro Oikawa , Noboru Harada

Improving the generalization ability of Deep Neural Networks (DNNs) is critical for their practical uses, which has been a longstanding challenge. Some theoretical studies have uncovered that DNNs have preferences for some frequency…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Shiqi Lin , Zhizheng Zhang , Zhipeng Huang , Yan Lu , Cuiling Lan , Peng Chu , Quanzeng You , Jiang Wang , Zicheng Liu , Amey Parulkar , Viraj Navkal , Zhibo Chen

This paper presents SSLIDE, Sound Source Localization for Indoors using DEep learning, which applies deep neural networks (DNNs) with encoder-decoder structure to localize sound sources with random positions in a continuous space. The…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-17 Yifan Wu , Roshan Ayyalasomayajula , Michael J. Bianco , Dinesh Bharadia , Peter Gerstoft