English
Related papers

Related papers: Likelihood Gradient Evaluation Using Square-Root C…

200 papers

We introduce the inverse Kalman filter, which enables exact matrix-vector multiplication between a covariance matrix from a dynamic linear model and any real-valued vector with linear computational cost. We integrate the inverse Kalman…

Methodology · Statistics 2026-01-27 Xinyi Fang , Mengyang Gu

Considering the problem of nonlinear and non-gaussian filtering of the graph signal, in this paper, a robust square root unscented Kalman filter based on graph signal processing is proposed. The algorithm uses a graph topology to generate…

Signal Processing · Electrical Eng. & Systems 2024-09-12 Jinhui Hu , Haiquan Zhao , Yi Peng

Contemporary data assimilation often involves millions of prediction variables. The classical Kalman filter is no longer computationally feasible in such a high dimensional context. This problem can often be resolved by exploiting the…

Statistics Theory · Mathematics 2016-06-30 Andrew J. Majda , Xin T. Tong

This technical note addresses the UD factorization based Kalman filtering (KF) algorithms. Using this important class of numerically stable KF schemes, we extend its functionality and develop an elegant and simple method for computation of…

Systems and Control · Computer Science 2016-11-28 Julia V. Tsyganova , Maria V. Kulikova

There has been much recent work on inference after model selection when the noise level is known, however, $\sigma$ is rarely known in practice and its estimation is difficult in high-dimensional settings. In this work we propose using the…

Statistics Theory · Mathematics 2017-02-13 Xiaoying Tian , Joshua R. Loftus , Jonathan E. Taylor

We study the multivariate square-root lasso, a method for fitting the multivariate response linear regression model with dependent errors. This estimator minimizes the nuclear norm of the residual matrix plus a convex penalty. Unlike…

Methodology · Statistics 2022-04-06 Aaron J. Molstad

We develop a fast algorithm for Kalman Filter applied to the random walk forecast model. The key idea is an efficient representation of the estimate covariance matrix at each time-step as a weighted sum of two contributions - the process…

Numerical Analysis · Mathematics 2015-05-13 Arvind K. Saibaba , Eric Miller , Peter K. Kitanidis

Researchers collecting intensive longitudinal data (ILD) are increasingly looking to model psychological processes, such as emotional dynamics, that organize and adapt across time in complex and meaningful ways. This is also the case for…

Geoscientific applications of ensemble Kalman filters face several computational challenges arising from the high dimensionality of the forecast covariance matrix, particularly when this matrix incorporates localization. For square-root…

Computational Physics · Physics 2025-10-15 Robin Armstrong , Ian Grooms

In simulation-based inferences for partially observed Markov process models (POMP), the by-product of the Monte Carlo filtering is an approximation of the log likelihood function. Recently, iterated filtering [14, 13] has originally been…

Methodology · Statistics 2018-02-26 Dao Nguyen

Covariance selection seeks to estimate a covariance matrix by maximum likelihood while restricting the number of nonzero inverse covariance matrix coefficients. A single penalty parameter usually controls the tradeoff between log likelihood…

Optimization and Control · Mathematics 2010-10-12 Vijay Krishnamurthy , Alexandre d'Aspremont

Uncertainty estimation in large deep-learning models is a computationally challenging task, where it is difficult to form even a Gaussian approximation to the posterior distribution. In such situations, existing methods usually resort to a…

Machine Learning · Computer Science 2019-01-15 Aaron Mishkin , Frederik Kunstner , Didrik Nielsen , Mark Schmidt , Mohammad Emtiyaz Khan

Using a perturbation technique, we derive a new approximate filtering and smoothing methodology generalizing along different directions several existing approaches to robust filtering based on the score and the Hessian matrix of the…

Methodology · Statistics 2023-06-06 Giuseppe Buccheri , Giacomo Bormetti , Fulvio Corsi , Fabrizio Lillo

Covariance steering (CS) synthesizes a control policy which drives the state's mean and covariance matrix towards desired values. Offering tractable computation of a closed-loop policy which can obey chance constraints in uncertain…

Optimization and Control · Mathematics 2026-02-02 Naoya Kumagai , Kenshiro Oguri

State estimation when only a partial model of a considered system is available remains a major challenge in many engineering fields. This work proposes a joint, square-root unscented Kalman filter to estimate states and model uncertainties…

Signal Processing · Electrical Eng. & Systems 2022-07-11 Ricarda-Samantha Götte , Julia Timmermann

The L1-regularized Gaussian maximum likelihood estimator (MLE) has been shown to have strong statistical guarantees in recovering a sparse inverse covariance matrix, or alternatively the underlying graph structure of a Gaussian Markov…

Machine Learning · Computer Science 2013-06-14 Cho-Jui Hsieh , Matyas A. Sustik , Inderjit S. Dhillon , Pradeep Ravikumar

Likelihood functions evaluated using particle filters are typically noisy, computationally expensive, and non-differentiable due to Monte Carlo variability. These characteristics make conventional optimization methods difficult to apply…

Methodology · Statistics 2026-01-13 Genshiro Kitagawa

Stochastic models in biomolecular contexts can have a state-dependent process noise covariance. The choice of the process noise covariance is an important parameter in the design of a Kalman Filter for state estimation and the theoretical…

Systems and Control · Electrical Eng. & Systems 2025-08-05 Krishan Kumar Gola , Shaunak Sen

The Kalman filter is an established tool for the analysis of dynamic systems with normally distributed noise, and it has been successfully applied in numerous application areas. It provides sequentially calculated estimates of the system…

Systems and Control · Computer Science 2016-10-26 S. Eichstädt , N. Makarava , C. Elster

In high-dimensions, many variable selection methods, such as the lasso, are often limited by excessive variability and rank deficiency of the sample covariance matrix. Covariance sparsity is a natural phenomenon in high-dimensional…

Methodology · Statistics 2010-06-08 X. Jessie Jeng And Z. John Daye