English
Related papers

Related papers: On the stable Cholesky factorization-based method …

200 papers

This paper studies the estimation of a large covariance matrix. We introduce a novel procedure called ChoSelect based on the Cholesky factor of the inverse covariance. This method uses a dimension reduction strategy by selecting the pattern…

Statistics Theory · Mathematics 2010-10-13 Nicolas Verzelen

We examine a special case of the multilevel factor model, with covariance given by multilevel low rank (MLR) matrix~\cite{parshakova2023factor}. We develop a novel, fast implementation of the expectation-maximization algorithm, tailored for…

Machine Learning · Statistics 2025-08-26 Tetiana Parshakova , Trevor Hastie , Stephen Boyd

This paper presents two efficient and stable algorithms for recovering phase factors in quantum signal processing (QSP), a crucial component of many quantum algorithms. The first algorithm, the ``Half Cholesky" method, which is based on…

Quantum Physics · Physics 2024-10-29 Hongkang Ni , Lexing Ying

Robustness and adaptivity are two competing objectives in Kalman filters (KF). Robustness involves temporarily inflating prior estimates of noise covariances, while adaptivity updates prior beliefs by exploiting measurements. In practical…

Information Theory · Computer Science 2026-05-11 Shilei Li , Dawei Shi , Hao Yu , Ling Shi

The Kalman Filter (KF) parameters are traditionally determined by noise estimation, since under the KF assumptions, the state prediction errors are minimized when the parameters correspond to the noise covariance. However, noise estimation…

Machine Learning · Computer Science 2022-07-04 Ido Greenberg , Shie Mannor , Netanel Yannay

Sparse adaptive channel estimation problem is one of the most important topics in broadband wireless communications systems due to its simplicity and robustness. So far many sparsity-aware channel estimation algorithms have been developed…

Information Theory · Computer Science 2015-04-15 Wentao Ma , Hua Qua , Guan Gui , Li Xu , Jihong Zhaoa , Badong Chen

In this article, we propose a new filtering algorithm based in the Koopman operator, showing that a nonlinear filtering problem can be seen as an equivalent problem where the dynamics is infinite dimensional, but linear. Using Extended…

Dynamical Systems · Mathematics 2025-11-07 Diego Olguín , Axel Osses , Héctor Ramírez

This paper investigates the robustness and optimality of the multi-kernel correntropy (MKC) on linear regression. We first derive an upper error bound for a scalar regression problem in the presence of arbitrarily large outliers and reveal…

Systems and Control · Electrical Eng. & Systems 2023-10-12 Shilei Li , Yunjiang Lou , Dawei Shi , Lijing Li , Ling Shi

LU and Cholesky matrix factorization algorithms are core subroutines used to solve systems of linear equations (SLEs) encountered while solving an optimization problem. Standard factorization algorithms are highly efficient but remain…

Numerical Analysis · Mathematics 2022-07-25 Adolfo R. Escobedo

Constrained adaptive filtering algorithms inculding constrained least mean square (CLMS), constrained affine projection (CAP) and constrained recursive least squares (CRLS) have been extensively studied in many applications. Most existing…

Machine Learning · Statistics 2016-12-15 Siyuan Peng , Badong Chen , Lei Sun , Zhiping Lin , Wee Ser

Kalman Filter (KF) is an optimal linear state prediction algorithm, with applications in fields as diverse as engineering, economics, robotics, and space exploration. Here, we develop an extension of the KF, called a Pathspace Kalman Filter…

Machine Learning · Statistics 2024-04-03 Chaitra Agrahar , William Poole , Simone Bianco , Hana El-Samad

Collaborative filtering (CF) is a popular technique in today's recommender systems, and matrix approximation-based CF methods have achieved great success in both rating prediction and top-N recommendation tasks. However, real-world…

Machine Learning · Computer Science 2018-11-07 Dongsheng Li , Chao Chen , Qin Lv , Junchi Yan , Li Shang , Stephen M. Chu

Recent research in nonlinear filtering and signal processing has suggested an efficient derivative-free Extended Kalman filter (EKF) designed for discrete-time stochastic systems. Such approach, however, has failed to address the estimation…

Optimization and Control · Mathematics 2024-02-20 Maria V. Kulikova , Gennady Yu. Kulikov

Recently, the motion averaging method has been introduced as an effective means to solve the multi-view registration problem. This method aims to recover global motions from a set of relative motions, where the original method is sensitive…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Jihua Zhu , Jie Hu , Huimin Lu , Badong Chen , Zhongyu Li

This paper focuses on designing a consistent and efficient filter for map-based visual-inertial localization. First, we propose a new Lie group with its algebra, based on which a novel invariant extended Kalman filter (invariant EKF) is…

Robotics · Computer Science 2022-04-27 Zhuqing Zhang , Yang Song , Shoudong Huang , Rong Xiong , Yue Wang

The modified Cholesky decomposition is commonly used for precision matrix estimation given a specified order of random variables. However, the order of variables is often not available or cannot be pre-determined. In this work, we propose…

Machine Learning · Statistics 2021-11-23 Xiaoning Kang , Xinwei Deng

Robust compressive sensing(CS) reconstruction has become an attractive research topic in recent years. Robust CS aims to reconstruct the sparse signals under non-Gaussian(i.e. heavy tailed) noises where traditional CS reconstruction…

Information Theory · Computer Science 2017-06-13 Yicong He , Fei Wang , Shiyuan Wang , Jiuwen Cao , Badong Chen

The Kalman filter (KF) is a widely-used algorithm for tracking the latent state of a dynamical system from noisy observations. For systems that are well-described by linear Gaussian state space models, the KF minimizes the mean-squared…

Signal Processing · Electrical Eng. & Systems 2022-10-13 Shunit Truzman , Guy Revach , Nir Shlezinger , Itzik Klein

Factor extraction from systems of variables with a large cross-sectional dimension, $N$, is often based on either Principal Components (PC)-based procedures, or Kalman filter (KF)-based procedures. Measuring the uncertainty of the extracted…

Econometrics · Economics 2026-01-08 Matteo Barigozzi , Diego Fresoli , Esther Ruiz

This paper is concerned with sequential filtering based stochastic optimization (FSO) approaches that leverage a probabilistic perspective to implement the incremental proximity method (IPM). The present FSO methods are derived based on the…

Machine Learning · Computer Science 2020-01-08 Bin Liu