English
Related papers

Related papers: Informative Neural Ensemble Kalman Learning

200 papers

The modeling and simulation of high-dimensional multiscale systems is a critical challenge across all areas of science and engineering. It is broadly believed that even with today's computer advances resolving all spatiotemporal scales…

Machine Learning · Statistics 2023-09-13 Emmanuel Menier , Sebastian Kaltenbach , Mouadh Yagoubi , Marc Schoenauer , Petros Koumoutsakos

The investigation of input-output systems often requires a sophisticated choice of test inputs to make best use of limited experimental time. Here we present an iterative algorithm that continuously adjusts an ensemble of test inputs…

Biological Physics · Physics 2009-11-07 Christian K. Machens

Learning in a non-stationary environment is an inevitable problem when applying machine learning algorithm to real world environment. Learning new tasks without forgetting the previous knowledge is a challenge issue in machine learning. We…

Machine Learning · Computer Science 2018-11-07 Honglin Li , Frieder Ganz , Shirin Enshaeifar , Payam Barnaghi

Optimal decision-making under partial observability requires reasoning about the uncertainty of the environment's hidden state. However, most reinforcement learning architectures handle partial observability with sequence models that have…

Machine Learning · Computer Science 2025-02-20 Carlos E. Luis , Alessandro G. Bottero , Julia Vinogradska , Felix Berkenkamp , Jan Peters

Interleaved learning in machine learning algorithms is a biologically inspired training method with promising results. In this short note, we illustrate the interleaving mechanism via a simple statistical and optimization framework based on…

Signal Processing · Electrical Eng. & Systems 2023-11-14 Majnu John , Yihren Wu

The mutual information is a core statistical quantity that has applications in all areas of machine learning, whether this is in training of density models over multiple data modalities, in maximising the efficiency of noisy transmission…

Machine Learning · Statistics 2015-09-30 Shakir Mohamed , Danilo Jimenez Rezende

In order to integrate uncertainty estimates into deep time-series modelling, Kalman Filters (KFs) (Kalman et al., 1960) have been integrated with deep learning models, however, such approaches typically rely on approximate inference…

Machine Learning · Computer Science 2019-05-20 Philipp Becker , Harit Pandya , Gregor Gebhardt , Cheng Zhao , James Taylor , Gerhard Neumann

This paper studies an output feedback stabilization control framework for discrete-time linear systems with stochastic dynamics determined by an independent and identically distributed (i.i.d.) process. The controller is constructed with an…

Systems and Control · Computer Science 2019-04-11 Yohei Hosoe , Dimitri Peaucelle

Autonomous platforms require accurate positioning to complete their tasks. To this end, a Kalman filter-based algorithms, such as the extended Kalman filter or invariant Kalman filter, utilizing inertial and external sensor fusion are…

Systems and Control · Electrical Eng. & Systems 2026-03-31 Barak Diker , Itzik Klein

The iterative ensemble Kalman filter (IEnKF) in a deterministic framework was introduced in Sakov et al. (2012) to extend the ensemble Kalman filter (EnKF) and improve its performance in mildly up to strongly nonlinear cases. However, the…

Atmospheric and Oceanic Physics · Physics 2018-10-17 Pavel Sakov , Jean-Matthieu Haussaire , Marc Bocquet

Kalman filter is a key tool for time-series forecasting and analysis. We show that the dependence of a prediction of Kalman filter on the past is decaying exponentially, whenever the process noise is non-degenerate. Therefore, Kalman filter…

Statistics Theory · Mathematics 2019-09-24 Mark Kozdoba , Jakub Marecek , Tigran Tchrakian , Shie Mannor

Adversarially robust training has been shown to reduce the susceptibility of learned models to targeted input data perturbations. However, it has also been observed that such adversarially robust models suffer a degradation in accuracy when…

Systems and Control · Electrical Eng. & Systems 2023-02-07 Thomas T. C. K. Zhang , Bruce D. Lee , Hamed Hassani , Nikolai Matni

Distilling data into compact and interpretable analytic equations is one of the goals of science. Instead, contemporary supervised machine learning methods mostly produce unstructured and dense maps from input to output. Particularly in…

Machine Learning · Computer Science 2021-05-14 Matthias Werner , Andrej Junginger , Philipp Hennig , Georg Martius

This paper introduces a computational framework to reconstruct and forecast a partially observed state that evolves according to an unknown or expensive-to-simulate dynamical system. Our reduced-order autodifferentiable ensemble Kalman…

Machine Learning · Statistics 2023-01-31 Yuming Chen , Daniel Sanz-Alonso , Rebecca Willett

In a recent methodological paper, we showed how to learn chaotic dynamics along with the state trajectory from sequentially acquired observations, using local ensemble Kalman filters. Here, we more systematically investigate the possibility…

Machine Learning · Statistics 2022-10-19 Quentin Malartic , Alban Farchi , Marc Bocquet

Kalman Filters (KF) are fundamental to real-time state estimation applications, including radar-based tracking systems used in modern driver assistance and safety technologies. In a linear dynamical system with Gaussian noise distributions…

Robotics · Computer Science 2024-11-27 Arian Mehrfard , Bharanidhar Duraisamy , Stefan Haag , Florian Geiss

We study reinforcement learning for partially observed Markov decision processes (POMDPs) with infinite observation and state spaces, which remains less investigated theoretically. To this end, we make the first attempt at bridging partial…

Machine Learning · Computer Science 2024-04-02 Qi Cai , Zhuoran Yang , Zhaoran Wang

The filtering distribution in hidden Markov models evolves according to the law of a mean-field model in state-observation space. The ensemble Kalman filter (EnKF) approximates this mean-field model with an ensemble of interacting…

Machine Learning · Statistics 2025-12-25 Eviatar Bach , Ricardo Baptista , Edoardo Calvello , Bohan Chen , Andrew Stuart

Data assimilation is concerned with sequentially estimating a temporally-evolving state. This task, which arises in a wide range of scientific and engineering applications, is particularly challenging when the state is high-dimensional and…

Machine Learning · Statistics 2021-07-21 Yuming Chen , Daniel Sanz-Alonso , Rebecca Willett

It is well recognized that discontinuous analysis increments of sequential data assimilation systems, such as ensemble Kalman filters, might lead to spurious high frequency adjustment processes in the model dynamics. Various methods have…

Numerical Analysis · Mathematics 2015-05-18 Kay Bergemann , Sebastian Reich