English
Related papers

Related papers: Linear theory for filtering nonlinear multiscale s…

200 papers

This work proposes a machine-learning framework for constructing statistical models of errors incurred by approximate solutions to parameterized systems of nonlinear equations. These approximate solutions may arise from early termination of…

Numerical Analysis · Computer Science 2019-02-18 Brian A. Freno , Kevin T. Carlberg

This article develops a comprehensive framework for stability analysis of a broad class of commonly used continuous and discrete time-filters for stochastic dynamic systems with non-linear state dynamics and linear measurements under…

Methodology · Statistics 2020-06-11 Toni Karvonen , Silvère Bonnabel , Eric Moulines , Simo Särkkä

This book is meant to provide an introduction to linear models and the theories behind them. Our goal is to give a rigorous introduction to the readers with prior exposure to ordinary least squares. In machine learning, the output is…

Machine Learning · Computer Science 2025-05-12 Jun Lu

This paper examines learning the optimal filtering policy, known as the Kalman gain, for a linear system with unknown noise covariance matrices using noisy output data. The learning problem is formulated as a stochastic policy optimization…

Systems and Control · Electrical Eng. & Systems 2023-10-27 Shahriar Talebi , Amirhossein Taghvaei , Mehran Mesbahi

Model uncertainty quantification is an essential component of effective data assimilation. Model errors associated with sub-grid scale processes are often represented through stochastic parameterizations of the unresolved process. Many…

Methodology · Statistics 2021-04-13 Sahani Pathiraja , Peter Jan van Leeuwen

Linear regression on network-linked observations has been an essential tool in modeling the relationship between response and covariates with additional network structures. Previous methods either lack inference tools or rely on restrictive…

Methodology · Statistics 2022-08-22 Can M. Le , Tianxi Li

Can stochastic gradient methods track a moving target? We study the problem of tracking multidimensional time-varying parameters under noisy observations and possible model misspecification. Gradient-based filters update the time-varying…

Methodology · Statistics 2026-05-05 Simon Donker van Heel , Rutger-Jan Lange , Bram van Os , Dick van Dijk

In simulations of multiscale dynamical systems, not all relevant processes can be resolved explicitly. Taking the effect of the unresolved processes into account is important, which introduces the need for paramerizations. We present a…

Numerical Analysis · Mathematics 2021-04-14 Daan Crommelin , Wouter Edeling

Online joint estimation of unknown parameters and states in a dynamical system with uncertainty quantification is crucial in many applications. For example, digital twins dynamically update their knowledge of model parameters and states to…

Methodology · Statistics 2026-01-01 Liliang Wang , Alex Gorodetsky

We propose an algorithm to actively estimate the parameters of a linear dynamical system. Given complete control over the system's input, our algorithm adaptively chooses the inputs to accelerate estimation. We show a finite time bound…

Machine Learning · Computer Science 2020-06-23 Andrew Wagenmaker , Kevin Jamieson

Dynamical systems describe the changes in processes that arise naturally from their underlying physical principles, such as the laws of motion or the conservation of mass, energy or momentum. These models facilitate a causal explanation for…

Methodology · Statistics 2023-10-11 Michelle Carey , James O. Ramsay

In this paper, we present an optimal filter for linear time-varying continuous-time stochastic systems that simultaneously estimates the states and unknown inputs in an unbiased minimum-variance sense. We first show that the unknown inputs…

Optimization and Control · Mathematics 2016-11-17 Sze Zheng Yong , Minghui Zhu , Emilio Frazzoli

This work proposes a general framework for capturing noise-driven transitions in spatially extended non-equilibrium systems and explains the emergence of coherent patterns beyond the instability onset. The framework relies on stochastic…

Dynamical Systems · Mathematics 2024-12-16 Mickaël D. Chekroun , Honghu Liu , James C. McWilliams

We consider the problem of stabilization of a linear system, under state and control constraints, and subject to bounded disturbances and unknown parameters in the state matrix. First, using a simple least square solution and available…

Systems and Control · Electrical Eng. & Systems 2020-07-22 Edouard Leurent , Denis Efimov , Odalric-Ambrym Maillard

We consider the Bayesian optimal filtering problem: i.e. estimating some conditional statistics of a latent time-series signal from an observation sequence. Classical approaches often rely on the use of assumed or estimated transition and…

Machine Learning · Statistics 2023-03-16 Adrian N. Bishop , Edwin V. Bonilla

This paper proposes a probabilistic approach to the problem of intrinsic filtering of a system on a matrix Lie group with invariance properties. The problem of an invariant continuous-time model with discrete-time measurements is cast into…

Systems and Control · Computer Science 2016-02-22 Axel Barrau , Silvere Bonnabel

The multivariate linear regression model with shuffled data and additive Gaussian noise arises in various correspondence estimation and matching problems. Focusing on the denoising aspect of this problem, we provide a characterization the…

Machine Learning · Statistics 2017-04-26 Ashwin Pananjady , Martin J. Wainwright , Thomas A. Courtade

For many nonlinear Bayesian state estimation problems, the posterior recursion is not analytically tractable, leading to algorithms that are influenced by numerical approximation errors. These algorithms depend on parameters that affect the…

Systems and Control · Electrical Eng. & Systems 2026-05-14 Ondrej Straka , Felipe Giraldo-Grueso , Renato Zanetti

Linear non-Gaussian causal models postulate that each random variable is a linear function of parent variables and non-Gaussian exogenous error terms. We study identification of the linear coefficients when such models contain latent…

Methodology · Statistics 2026-03-05 Daniele Tramontano , Mathias Drton , Jalal Etesami

Stochastic parameterizations are increasingly being used to represent the uncertainty associated with model errors in ensemble forecasting and data assimilation. One of the challenges associated with the use of these parameterizations is…

Computation · Statistics 2019-10-23 Guillermo Scheffler , Juan Ruiz , Manuel Pulido