English
Related papers

Related papers: Neural Kalman Filtering for Speech Enhancement

200 papers

This paper introduces a novel state estimation framework for robots using differentiable ensemble Kalman filters (DEnKF). DEnKF is a reformulation of the traditional ensemble Kalman filter that employs stochastic neural networks to model…

Robotics · Computer Science 2023-08-22 Xiao Liu , Geoffrey Clark , Joseph Campbell , Yifan Zhou , Heni Ben Amor

The Kalman filter is a fundamental tool for state estimation in dynamical systems. While originally developed for linear Gaussian settings, it has been extended to nonlinear problems through approaches such as the extended and unscented…

Optimization and Control · Mathematics 2025-09-10 Yuan Wu , Sicheng He

In this article, we propose a new filtering algorithm based in the Koopman operator, showing that a nonlinear filtering problem can be seen as an equivalent problem where the dynamics is infinite dimensional, but linear. Using Extended…

Dynamical Systems · Mathematics 2025-11-07 Diego Olguín , Axel Osses , Héctor Ramírez

The Kalman filter is a fundamental filtering algorithm that fuses noisy sensory data, a previous state estimate, and a dynamics model to produce a principled estimate of the current state. It assumes, and is optimal for, linear models and…

Neural and Evolutionary Computing · Computer Science 2021-04-30 Beren Millidge , Alexander Tschantz , Anil Seth , Christopher Buckley

Compensation for channel mismatch and noise interference is essential for robust automatic speech recognition. Enhanced speech has been introduced into the multi-condition training of acoustic models to improve their generalization ability.…

Sound · Computer Science 2022-11-24 Hung-Shin Lee , Pin-Yuan Chen , Yao-Fei Cheng , Yu Tsao , Hsin-Min Wang

The frequency-domain Kalman filter (FKF) has been utilized in many audio signal processing applications due to its fast convergence speed and robustness. However, the performance of the FKF in under-modeling situations has not been…

Signal Processing · Electrical Eng. & Systems 2019-02-20 Wenzhi Fan , Kai Chen , Jing Lu , Jiancheng Tao

The Kalman filter (KF) is used in a variety of applications for computing the posterior distribution of latent states in a state space model. The model requires a linear relationship between states and observations. Extensions to the Kalman…

Machine Learning · Statistics 2016-08-31 Michael C. Burkhart , David M. Brandman , Carlos E. Vargas-Irwin , Matthew T. Harrison

State estimation of dynamical systems in real-time is a fundamental task in signal processing. For systems that are well-represented by a fully known linear Gaussian state space (SS) model, the celebrated Kalman filter (KF) is a low…

Signal Processing · Electrical Eng. & Systems 2022-04-13 Guy Revach , Nir Shlezinger , Xiaoyong Ni , Adria Lopez Escoriza , Ruud J. G. van Sloun , Yonina C. Eldar

Nonlinear extensions of the Kalman filter (KF), such as the extended Kalman filter (EKF) and the unscented Kalman filter (UKF), are indispensable for state estimation in complex dynamical systems, yet the conditions for a nonlinear KF to…

Systems and Control · Electrical Eng. & Systems 2026-03-25 Shida Jiang , Jaewoong Lee , Shengyu Tao , Scott Moura

The traditional Kalman filter (KF) is widely applied in control systems, but it relies heavily on the accuracy of the system model and noise parameters, leading to potential performance degradation when facing inaccuracies. To address this…

Systems and Control · Electrical Eng. & Systems 2024-04-08 Jiaming Wang , Xinyu Geng , Jun Xu

We propose Hypernetwork Kalman Filter (HKF) for tracking applications with multiple different dynamics. The HKF combines generalization power of Kalman filters with expressive power of neural networks. Instead of keeping a bank of Kalman…

Signal Processing · Electrical Eng. & Systems 2022-02-23 Kumar Pratik , Rana Ali Amjad , Arash Behboodi , Joseph B. Soriaga , Max Welling

In this paper, a neural network-augmented algorithm for noise-robust online dereverberation with a Kalman filtering variant of the weighted prediction error (WPE) method is proposed. The filter stochastic variations are predicted by a deep…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-24 Jean-Marie Lemercier , Joachim Thiemann , Raphael Koning , Timo Gerkmann

The ensemble Kalman filter (EnKF) is a data assimilation technique that uses an ensemble of models, updated with data, to track the time evolution of a usually non-linear system. It does so by using an empirical approximation to the…

Applications · Statistics 2021-03-12 Elizabeth Hou , Earl Lawrence , Alfred O. Hero

This paper proposes a novel lip-reading driven deep learning framework for speech enhancement. The proposed approach leverages the complementary strengths of both deep learning and analytical acoustic modelling (filtering based approach) as…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Ahsan Adeel , Mandar Gogate , Amir Hussain , William M. Whitmer

This paper proposes SEFGAN, a Deep Neural Network (DNN) combining maximum likelihood training and Generative Adversarial Networks (GANs) for efficient speech enhancement (SE). For this, a DNN is trained to synthesize the enhanced speech…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-05 Martin Strauss , Nicola Pia , Nagashree K. S. Rao , Bernd Edler

In many applications of state estimation, the process noise is colored; this case is addressed by applying the standard Kalman filter (KF) to dynamics that are augmented with the coloring dynamics. The present paper considers the case where…

Systems and Control · Electrical Eng. & Systems 2026-04-24 Mohammad Almuhaihi , Dennis Bernstein

In this paper we address the problem of enhancing speech signals in noisy mixtures using a source separation approach. We explore the use of neural networks as an alternative to a popular speech variance model based on supervised…

Sound · Computer Science 2019-02-06 Simon Leglaive , Laurent Girin , Radu Horaud

In this paper, we address the problem of multichannel speech enhancement in the short-time Fourier transform (STFT) domain. A long short-time memory (LSTM) network takes as input a sequence of STFT coefficients associated with a frequency…

Sound · Computer Science 2020-09-24 Xiaofei LI , Radu Horaud

Energy efficiency and reliability have long been crucial factors for ensuring cost-effective and safe missions in autonomous systems computers. With the rapid evolution of industries such as space robotics and advanced air mobility, the…

Machine Learning · Computer Science 2023-07-18 Reza Ahmadvand , Sarah Safura Sharif , Yaser Mike Banad

Most neural network speech enhancement models ignore speech production mathematical models by directly mapping Fourier transform spectrums or waveforms. In this work, we propose a neural source filter network for speech enhancement.…

Sound · Computer Science 2022-10-31 Shulin He , Wei Rao , Jinjiang Liu , Jun Chen , Yukai Ju , Xueliang Zhang , Yannan Wang , Shidong Shang