English
Related papers

Related papers: Likelihood Gradient Evaluation Using Square-Root C…

200 papers

Relying on recent advances in statistical estimation of covariance distances based on random matrix theory, this article proposes an improved covariance and precision matrix estimation for a wide family of metrics. The method is shown to…

Machine Learning · Statistics 2021-02-03 Malik Tiomoko , Florent Bouchard , Guillaume Ginholac , Romain Couillet

This paper investigates covariance operator estimation via thresholding. For Gaussian random fields with approximately sparse covariance operators, we establish non-asymptotic bounds on the estimation error in terms of the sparsity level of…

Statistics Theory · Mathematics 2024-03-26 Omar Al-Ghattas , Jiaheng Chen , Daniel Sanz-Alonso , Nathan Waniorek

This paper presents preliminary work on computing upper bounds on the estimation error covariance in the framework of the extended Kalman filter. The approach taken is using quadratic constraints to bound the dynamic nonlinearities and use…

Optimization and Control · Mathematics 2024-10-14 Sze Kwan Cheah , Yingjie Hu

The paper proposes a numerically stable recursive algorithm for the exact computation of the linear-chain conditional random field gradient. It operates as a forward algorithm over the log-domain expectation semiring and has the purpose of…

Artificial Intelligence · Computer Science 2012-05-31 Velimir M. Ilic , Dejan I. Mancev , Branimir T. Todorovic , Miomir S. Stankovic

Orbit determination (OD) is a fundamental problem in space surveillance and tracking, crucial for ensuring the safety of space assets. Real-world ground-based optical tracking scenarios often involve challenges such as limited measurement…

Applications · Statistics 2024-05-07 Yang Yang

Common filters are usually based on the linear approximation of the optimal minimum mean square error estimator. The Extended and Unscented Kalman Filters handle nonlinearity through linearization and unscented transformation, respectively,…

Information Theory · Computer Science 2025-06-09 Simone Servadio , Chiran Cherian

This paper is triggered by the preprint "\emph{Computing Matrix Squareroot via Non Convex Local Search}" by Jain et al. (\textit{\textcolor{blue}{arXiv:1507.05854}}), which analyzes gradient-descent for computing the square root of a…

Numerical Analysis · Mathematics 2015-12-17 Suvrit Sra

Gradient-based solvers risk convergence to local optima, leading to incorrect researcher inference. Heuristic-based algorithms are able to ``break free" of these local optima to eventually converge to the true global optimum. However, given…

Econometrics · Economics 2024-01-17 Zachary Porreca

Many real-world applications are addressed through a linear least-squares problem formulation, whose solution is calculated by means of an iterative approach. A huge amount of studies has been carried out in the optimization field to…

Numerical Analysis · Mathematics 2013-11-25 Anastasia Cornelio , Federica Porta , Marco Prato , Luca Zanni

Least squares support vector machines are a commonly used supervised learning method for nonlinear regression and classification. They can be implemented in either their primal or dual form. The latter requires solving a linear system,…

Machine Learning · Computer Science 2021-10-27 Maximilian Lucassen , Johan A. K. Suykens , Kim Batselier

A Schmidt filter is a modification of the Kalman filter that allows to append system parameters as states and considers their uncertainty effect in the filtering process without attempting to estimate such parameters. The states that are…

Systems and Control · Electrical Eng. & Systems 2022-08-29 J Humberto Ramos

The paper proposes a new recursive filter for non-linear systems that inherently computes a valid bound on the mean square estimation error. The proposed filter, bound based extended Kalman, (BEKF) is in the form of an extended Kalman…

Optimization and Control · Mathematics 2014-10-02 Gyorgy Hexner , Haim Weiss

The maximum correntropy criterion (MCC) methodology is recognized to be a robust filtering strategy with respect to outliers and shown to outperform the classical Kalman filter (KF) for estimation accuracy in the presence of non-Gaussian…

Systems and Control · Electrical Eng. & Systems 2023-11-07 Maria V. Kulikova

Bilinear pooling of Convolutional Neural Network (CNN) features [22, 23], and their compact variants [10], have been shown to be effective at fine-grained recognition, scene categorization, texture recognition, and visual question-answering…

Computer Vision and Pattern Recognition · Computer Science 2017-07-24 Tsung-Yu Lin , Subhransu Maji

Poisson likelihood models have been prevalently used in imaging, social networks, and time series analysis. We propose fast, simple, theoretically-grounded, and versatile, optimization algorithms for Poisson likelihood modeling. The Poisson…

Machine Learning · Computer Science 2016-08-04 Niao He , Zaid Harchaoui , Yichen Wang , Le Song

This article introduces a new algorithm for nonlinear state estimation based on deterministic sigma point and EKF linearized framework for priori mean and covariance respectively. This method reduces the computation cost of UKF about 50%…

Systems and Control · Electrical Eng. & Systems 2019-07-25 Milad Behvandi , Mohammad Azam Khosravi , Amir Abolfazl Suratgar

Quantum algorithms offer significant speed-ups over their classical counterparts in various applications. In this paper, we develop quantum algorithms for the Kalman filter widely used in classical control engineering using the block…

Quantum Algebra · Mathematics 2024-04-09 Hao Shi , Guofeng Zhang , Ming Zhang

In this paper, we propose two new algorithms for maximum-likelihood estimation (MLE) of high dimensional sparse covariance matrices. Unlike most of the state of-the-art methods, which either use regularization techniques or penalize the…

Methodology · Statistics 2023-05-12 Ghania Fatima , Prabhu Babu , Petre Stoica

In many practical situations we would like to estimate the covariance matrix of a set of variables from an insufficient amount of data. More specifically, if we have a set of $N$ independent, identically distributed measurements of an $M$…

Probability · Mathematics 2010-10-05 Thomas L. Marzetta , Gabriel H. Tucci , Steven H. Simon

Many problems in data science can be treated as estimating a low-rank matrix from highly incomplete, sometimes even corrupted, observations. One popular approach is to resort to matrix factorization, where the low-rank matrix factors are…

Machine Learning · Computer Science 2021-04-23 Tian Tong , Cong Ma , Yuejie Chi