English
Related papers

Related papers: Using the SEKF to Transfer NN Models of Dynamical …

200 papers

Complex systems are often described with competing models. Such divergence of interpretation on the system may stem from model fidelity, mathematical simplicity, and more generally, our limited knowledge of the underlying processes.…

Numerical Analysis · Mathematics 2017-07-21 Lun Yang , Akil Narayan , Peng Wang

The application of neural networks in modeling dynamic systems has become prominent due to their ability to estimate complex nonlinear functions. Despite their effectiveness, neural networks face challenges in long-term predictions, where…

Machine Learning · Computer Science 2025-06-10 Parham Oveissi , Turibius Rozario , Ankit Goel

Data-driven modelling techniques provide a method for deriving models of dynamical systems directly from complicated data streams. However, tracking and forecasting such data streams poses a significant challenge to most methods, as they…

Dynamical Systems · Mathematics 2025-03-25 Stephen A Falconer , David J. B. Lloyd , Naratip Santitissadeekorn

Extended Kalman Filtering (EKF) can be used to propagate and quantify input uncertainty through a Deep Neural Network (DNN) assuming mild hypotheses on the input distribution. This methodology yields results comparable to existing methods…

Machine Learning · Computer Science 2018-09-18 Jessica S. Titensky , Hayden Jananthan , Jeremy Kepner

The ensemble Kalman filter (EnKF) is a data assimilation technique that uses an ensemble of models, updated with data, to track the time evolution of a usually non-linear system. It does so by using an empirical approximation to the…

Applications · Statistics 2021-03-12 Elizabeth Hou , Earl Lawrence , Alfred O. Hero

Ensemble transform Kalman filtering (ETKF) data assimilation is often used to combine available observations with numerical simulations to obtain statistically accurate and reliable state representations in dynamical systems. However, it is…

Numerical Analysis · Mathematics 2024-03-07 Tongtong Li , Anne Gelb , Yoonsang Lee

Large-scale dynamic inverse problems are often ill-posed due to model complexity and the high dimensionality of the unknown parameters. Regularization is commonly employed to mitigate ill-posedness by incorporating prior information and…

Numerical Analysis · Mathematics 2026-01-21 Aryeh Keating , Mirjeta Pasha

We propose a Neural-Enhanced Distributed Kalman Filter (NDKF) for multi-sensor state estimation in nonlinear systems. Unlike traditional Kalman filters that rely on explicit analytical models and assume centralized fusion, NDKF leverages…

Systems and Control · Electrical Eng. & Systems 2026-03-17 Siavash Farzan , Bennett Parisi

Low dimensional representations of words allow accurate NLP models to be trained on limited annotated data. While most representations ignore words' local context, a natural way to induce context-dependent representations is to perform…

Machine Learning · Statistics 2015-06-02 David Belanger , Sham Kakade

We propose Hypernetwork Kalman Filter (HKF) for tracking applications with multiple different dynamics. The HKF combines generalization power of Kalman filters with expressive power of neural networks. Instead of keeping a bank of Kalman…

Signal Processing · Electrical Eng. & Systems 2022-02-23 Kumar Pratik , Rana Ali Amjad , Arash Behboodi , Joseph B. Soriaga , Max Welling

Significant efforts have gone into the development of statistical models for analyzing data in the form of networks, such as social networks. Most existing work has focused on modeling static networks, which represent either a single time…

Social and Information Networks · Computer Science 2014-11-03 Kevin S. Xu , Alfred O. Hero

Accurate estimation of power system dynamics is very important for the enhancement of power system reliability, resilience, security, and stability of power system. With the increasing integration of inverter-based distributed energy…

Systems and Control · Electrical Eng. & Systems 2020-12-14 Narayan Bhusal , Mukesh Gautam

Accurate data assimilation (DA) for systems with piecewise-smooth or discontinuous state variables remains a significant challenge, as conventional covariance-based ensemble Kalman filter approaches often fail to effectively balance…

Numerical Analysis · Mathematics 2025-10-09 Tongtong Li , Anne Gelb , Yoonsang Lee

Data assimilation (DA) is a key component of many forecasting models in science and engineering. DA allows one to estimate better initial conditions using an imperfect dynamical model of the system and noisy/sparse observations available…

Machine Learning · Computer Science 2023-02-01 Ashesh Chattopadhyay , Ebrahim Nabizadeh , Eviatar Bach , Pedram Hassanzadeh

Forecasting driving behavior or other sensor measurements is an essential component of autonomous driving systems. Often real-world multivariate time series data is hard to model because the underlying dynamics are nonlinear and the…

Machine Learning · Computer Science 2021-11-17 Giao Nguyen-Quynh , Philipp Becker , Chen Qiu , Maja Rudolph , Gerhard Neumann

Compressed Estimation approaches, such as the Generalised Compressed Kalman Filter (GCKF), reduce the computational cost and complexity of high dimensional and high frequency data assimilation problems; usually without sacrificing…

Systems and Control · Computer Science 2018-11-21 Karan Narula , Jose Guivant

In this article, we propose a new filtering algorithm based in the Koopman operator, showing that a nonlinear filtering problem can be seen as an equivalent problem where the dynamics is infinite dimensional, but linear. Using Extended…

Dynamical Systems · Mathematics 2025-11-07 Diego Olguín , Axel Osses , Héctor Ramírez

One hidden yet important issue for developing neural network potentials (NNPs) is the choice of training algorithm. Here we compare the performance of two popular training algorithms, the adaptive moment estimation algorithm (Adam) and the…

Chemical Physics · Physics 2021-12-15 Yunqi Shao , Florian M. Dietrich , Carl Nettelblad , Chao Zhang

We study adaptive (or online) nonlinear regression with Long-Short-Term-Memory (LSTM) based networks, i.e., LSTM-based adaptive learning. In this context, we introduce an efficient Extended Kalman filter (EKF) based second-order training…

Machine Learning · Computer Science 2021-06-01 N. Mert Vural , Salih Ergüt , Suleyman S. Kozat

The Kalman filter (KF) is used in a variety of applications for computing the posterior distribution of latent states in a state space model. The model requires a linear relationship between states and observations. Extensions to the Kalman…

Machine Learning · Statistics 2016-08-31 Michael C. Burkhart , David M. Brandman , Carlos E. Vargas-Irwin , Matthew T. Harrison