English
Related papers

Related papers: Informative Neural Ensemble Kalman Learning

200 papers

The Kalman filter is an algorithm for the estimation of hidden variables in dynamical systems under linear Gauss-Markov assumptions with widespread applications across different fields. Recently, its Bayesian interpretation has received a…

Neurons and Cognition · Quantitative Biology 2021-11-23 Manuel Baltieri , Takuya Isomura

This paper tackles the intricate task of jointly estimating state and parameters in data assimilation for stochastic dynamical systems that are affected by noise and observed only partially. While the concept of ``optimal filtering'' serves…

Optimization and Control · Mathematics 2023-12-19 Feng Bao , Guannan Zhang , Zezhong Zhang

Automated model selection is an important application in science and engineering. In this work, we develop a learning approach for identifying structured dynamical systems from undersampled and noisy spatiotemporal data. The learning is…

Machine Learning · Statistics 2023-05-31 Xiaofan Lu , Linan Zhang , Hongjin He

Ensemble transform Kalman filtering (ETKF) data assimilation is often used to combine available observations with numerical simulations to obtain statistically accurate and reliable state representations in dynamical systems. However, it is…

Numerical Analysis · Mathematics 2024-03-07 Tongtong Li , Anne Gelb , Yoonsang Lee

Combining the predictions of collections of neural networks often outperforms the best single network. Such ensembles are typically trained independently, and their superior `wisdom of the crowd' originates from the differences between…

Machine Learning · Computer Science 2020-06-23 Benjamin Brazowski , Elad Schneidman

Continuous navigation in complex environments is critical for Unmanned Aerial Vehicle (UAV). However, the existing Vision-Language Navigation (VLN) models follow the dead-reckoning, which iteratively updates its position for the next…

Robotics · Computer Science 2026-05-08 Yin Tang , Jiawei Ma , Jinrui Zhang , Alex Jinpeng Wang , Deyu Zhang

The reconstruction of the dynamics of an observed physical system as a surrogate model has been brought to the fore by recent advances in machine learning. To deal with partial and noisy observations in that endeavor, machine learning…

Machine Learning · Statistics 2020-10-06 Marc Bocquet , Alban Farchi , Quentin Malartic

Collaborative information from user-item interactions is a fundamental source of signal in successful recommender systems. Recently, researchers have attempted to incorporate this knowledge into large language model-based recommender…

Information Retrieval · Computer Science 2026-03-24 Shahrooz Pouryousef , Ali Montazeralghaem

One of the main challenges in the field of embodied artificial intelligence is the open-ended autonomous learning of complex behaviours. Our approach is to use task-independent, information-driven intrinsic motivation(s) to support…

Artificial Intelligence · Computer Science 2013-09-27 Keyan Zahedi , Georg Martius , Nihat Ay

We introduce a derivative-free computational framework for approximating solutions to nonlinear PDE-constrained inverse problems. The aim is to merge ideas from iterative regularization with ensemble Kalman methods from Bayesian inference…

Optimization and Control · Mathematics 2016-01-20 Marco A. Iglesias

A computationally efficient method for online joint state inference and dynamical model learning is presented. The dynamical model combines an a priori known, physically derived, state-space model with a radial basis function expansion…

Systems and Control · Electrical Eng. & Systems 2021-07-12 Anton Kullberg , Isaac Skog , Gustaf Hendeby

Generative models for sequential data often struggle with sparsely sampled and high-dimensional trajectories, typically reducing the learning of dynamics to pairwise transitions. We propose Interpolative Multi-Marginal Flow Matching…

Model-based reinforcement learning (RL) algorithms designed for handling complex visual observations typically learn some sort of latent state representation, either explicitly or implicitly. Standard methods of this sort do not distinguish…

Robotics · Computer Science 2022-04-20 Homanga Bharadhwaj , Mohammad Babaeizadeh , Dumitru Erhan , Sergey Levine

We study adaptive (or online) nonlinear regression with Long-Short-Term-Memory (LSTM) based networks, i.e., LSTM-based adaptive learning. In this context, we introduce an efficient Extended Kalman filter (EKF) based second-order training…

Machine Learning · Computer Science 2021-06-01 N. Mert Vural , Salih Ergüt , Suleyman S. Kozat

In this paper, we design a novel distributed learning algorithm using stochastic compressed communications. In detail, we pursue a modular approach, merging ADMM and a gradient-based approach, benefiting from the robustness of the former…

Optimization and Control · Mathematics 2025-07-01 Guido Carnevale , Nicola Bastianello

Recently proposed methods in data subset selection, that is active learning and active sampling, use Fisher information, Hessians, similarity matrices based on gradients, and gradient lengths to estimate how informative data is for a…

Machine Learning · Computer Science 2022-11-08 Andreas Kirsch , Yarin Gal

Ensembles of classification and regression trees remain popular machine learning methods because they define flexible non-parametric models that predict well and are computationally efficient both during training and testing. During…

Machine Learning · Computer Science 2012-06-22 Sebastian Nowozin

We introduce the "NoBackTrack" algorithm to train the parameters of dynamical systems such as recurrent neural networks. This algorithm works in an online, memoryless setting, thus requiring no backpropagation through time, and is scalable,…

Neural and Evolutionary Computing · Computer Science 2015-11-24 Yann Ollivier , Corentin Tallec , Guillaume Charpiat

In this article, the state estimation problems with unknown process noise and measurement noise covariances for both linear and nonlinear systems are considered. By formulating the joint estimation of system state and noise parameters into…

Systems and Control · Electrical Eng. & Systems 2023-12-18 Hua Lan , Shijie Zhao , Jinjie Hu , Zengfu Wang , Jing Fu

Estimating the state of a dynamical system from a series of noise-corrupted observations is fundamental in many areas of science and engineering. The most well-known method, the Kalman smoother (and the related Kalman filter), relies on…

Machine Learning · Statistics 2017-04-24 Luca Ambrogioni , Umut Güçlü , Eric Maris , Marcel van Gerven