English
Related papers

Related papers: Approximate linear minimum variance filters for co…

200 papers

Non-linear least squares solvers are used across a broad range of offline and real-time model fitting problems. Most improvements of the basic Gauss-Newton algorithm tackle convergence guarantees or leverage the sparsity of the underlying…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Huu Le , Christopher Zach , Edward Rosten , Oliver J. Woodford

Inspired by recent developments in subdivision schemes founded on the Weighted Least Squares technique, we construct linear approximants for noisy data in which the weighting strategy minimizes the output variance, thereby establishing a…

Numerical Analysis · Mathematics 2025-12-23 Sergio López Ureña , Dionisio F. Yáñez

This work studies the linear approximation of high-dimensional dynamical systems using low-rank dynamic mode decomposition (DMD). Searching this approximation in a data-driven approach is formalised as attempting to solve a low-rank…

Machine Learning · Statistics 2021-08-23 Patrick Héas , Cédric Herzet

The problem of state estimation has a long history with many successful algorithms that allow analytical derivation or approximation of posterior filtering distribution given the noisy observations. This report tries to conclude previous…

Machine Learning · Computer Science 2025-01-06 Nikita Kostin

We introduce the Locally Linear Latent Variable Model (LL-LVM), a probabilistic model for non-linear manifold discovery that describes a joint distribution over observations, their manifold coordinates and locally linear maps conditioned on…

Machine Learning · Statistics 2015-12-02 Mijung Park , Wittawat Jitkrittum , Ahmad Qamar , Zoltan Szabo , Lars Buesing , Maneesh Sahani

Latent variable models have been playing a central role in psychometrics and related fields. In many modern applications, the inference based on latent variable models involves one or several of the following features: (1) the presence of…

Methodology · Statistics 2025-01-08 Siliang Zhang , Yunxiao Chen

Stochastic gradient descent type methods are ubiquitous in machine learning, but they are only applicable to the optimization of differentiable functions. Proximal algorithms are more general and applicable to nonsmooth functions. We…

Optimization and Control · Mathematics 2025-05-20 Laurent Condat , Elnur Gasanov , Peter Richtárik

In this paper, we propose a new model reduction technique for linear stochastic systems that builds upon knowledge filtering and utilizes optimal Kalman filtering techniques. This new technique will reduce the dimension of the noise…

Systems and Control · Electrical Eng. & Systems 2023-09-18 Maico Hendrikus Wilhelmus Engelaar , Licio Romao , Yulong Gao , Mircea Lazar , Alessandro Abate , Sofie Haesaert

A local algorithm is a distributed algorithm where each node must operate solely based on the information that was available at system startup within a constant-size neighbourhood of the node. We study the applicability of local algorithms…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-09-09 Patrik Floréen , Petteri Kaski , Topi Musto , Jukka Suomela

Although projection-based reduced-order models (ROMs) for parameterized nonlinear dynamical systems have demonstrated exciting results across a range of applications, their broad adoption has been limited by their intrusivity: implementing…

Machine Learning · Computer Science 2021-06-18 Zhe Bai , Liqian Peng

This paper examines the impact of approximation steps that become necessary when particle filters are implemented on resource-constrained platforms. We consider particle filters that perform intermittent approximation, either by subsampling…

Probability · Mathematics 2012-02-27 Boris N. Oreshkin , Mark J. Coates

We present an adaptive smoother for linear state-space models with unknown process and measurement noise covariances. The proposed method utilizes the variational Bayes technique to perform approximate inference. The resulting smoother is…

Systems and Control · Computer Science 2023-07-19 Tohid Ardeshiri , Emre Özkan , Umut Orguner , Fredrik Gustafsson

Sequential Monte Carlo (SMC) methods, also known as particle filters, are simulation-based recursive algorithms for the approximation of the a posteriori probability measures generated by state-space dynamical models. At any given time $t$,…

Computation · Statistics 2016-11-24 Dan Crisan , Joaquín Míguez

Motivated by the maneuvering target tracking with sensors such as radar and sonar, this paper considers the joint and recursive estimation of the dynamic state and the time-varying process noise covariance in nonlinear state space models.…

Systems and Control · Electrical Eng. & Systems 2023-05-09 Hua Lan , Jinjie Hu , Zengfu Wang , Qiang Cheng

In this paper, both semidiscrete and completely discrete finite volume element methods (FVEMs) are analyzed for approximating solutions of a class of linear hyperbolic integro- differential equations in a two-dimensional convex polygonal…

Numerical Analysis · Mathematics 2014-01-22 Samir Karaa , Amiya K. Pani

Particle filtering methods can be applied to estimation problems in discrete spaces on bounded domains, to sample from and marginalise over unknown hidden states. As in continuous settings, problems such as particle degradation can arise:…

Standard model-based control design deteriorates when the system dynamics change during operation. To overcome this challenge, online and adaptive methods have been proposed in the literature. In this work, we consider the class of…

Systems and Control · Electrical Eng. & Systems 2026-04-16 Marcell Bartos , Johannes Köhler , Florian Dörfler , Melanie N. Zeilinger

We formulate a recursive estimation problem for multiple dynamical systems coupled through a low dimensional stochastic input, and we propose an efficient sub-optimal solution. The suggested approach is an approximation of the Kalman filter…

Optimization and Control · Mathematics 2019-11-26 Leonid Pogorelyuk , Clarence W. Rowley , N. Jeremy Kasdin

We provide performance guarantees for a variant of simulation-based policy iteration for controlling Markov decision processes that involves the use of stochastic approximation algorithms along with state-of-the-art techniques that are…

Machine Learning · Computer Science 2022-10-17 Anna Winnicki , R. Srikant

Convergence failure and slow convergence rates are among the biggest challenges with solving the system of non-linear equations numerically. Although mitigated, such issues still linger when using strictly small time steps and…

Numerical Analysis · Mathematics 2019-12-05 Hanyu Li , Wing Tat Leung , Mary F. Wheeler