English
Related papers

Related papers: Regularized adaptive long autoregressive spectral …

200 papers

We present a Kalman smoothing framework based on modeling errors using the heavy tailed Student's t distribution, along with algorithms, convergence theory, open-source general implementation, and several important applications. The…

Optimization and Control · Mathematics 2013-03-25 Aleksandr Y. Aravkin , James V. Burke , Gianluigi Pillonetto

Slow feature analysis (SFA), as a method for learning slowly varying features in classification and signal analysis, has attracted increasing attention in recent years. Recent probabilistic extensions to SFA learn effective representations…

Machine Learning · Computer Science 2025-09-10 Vishal Rishi

In the previous paper an adaptive filtering based on a reference recursive recipe was developed and tested on a simulated dynamics of a spring, mass, and damper with a weak nonlinear spring. In this paper the above recipe is applied to a…

Methodology · Statistics 2015-05-28 Shyam Mohan M , Naren Naik , R. M. O. Gemson , M. R. Ananthasayanam

The paper considers the computation of L1 regularization paths in a state space setting, which includes L1 regularized Kalman smoothing, linear SVM, LASSO, and more. The paper proposes two new algorithms, which are duals of each other; the…

Machine Learning · Computer Science 2026-04-21 Yun-Peng Li , Hans-Andrea Loeliger

The augmented, iterated Kalman smoother is applied to system identification for inverse problems in evolutionary differential equations. In the augmented smoother, the unknown, time-dependent coefficients are included in the state vector,…

Methodology · Statistics 2019-11-19 Kurt S. Riedel

We present a novel spectral learning algorithm for simultaneous localization and mapping (SLAM) from range data with known correspondences. This algorithm is an instance of a general spectral system identification framework, from which it…

Machine Learning · Computer Science 2012-07-12 Byron Boots , Geoffrey J. Gordon

This paper presents an adaptive Kalman filter for a linear dynamic system perturbed by an additive disturbance. The objective is to estimate both of the state and the unknown disturbance concurrently, while learning the disturbance as a…

Optimization and Control · Mathematics 2019-10-23 Taeyoung Lee

Longitudinal data often involve heterogeneity, sparse signals, and contamination from response outliers or high-leverage observations especially in biomedical science. Existing methods usually address only part of this problem, either…

Methodology · Statistics 2026-02-26 Yuyao Wang , Yu Lu , Tianni Zhang , Mengfei Ran

The optimal predictor for a linear dynamical system (with hidden state and Gaussian noise) takes the form of an autoregressive linear filter, namely the Kalman filter. However, a fundamental problem in reinforcement learning and control…

Machine Learning · Computer Science 2019-05-27 Holden Lee , Cyril Zhang

This report provides a brief historical evolution of the concepts in the Kalman filtering theory since ancient times to the present. A brief description of the filter equations its aesthetics, beauty, truth, fascinating perspectives and…

Methodology · Statistics 2015-03-17 Shyam Mohan M , Naren Naik , R. M. O. Gemson , M. R. Ananthasayanam

In this paper, we propose a new framework for solving state estimation problems with an additional sparsity-promoting $L_1$-regularizer term. We first formulate such problems as minimization of the sum of linear or nonlinear quadratic error…

Information Theory · Computer Science 2019-10-02 Rui Gao , Filip Tronarp , Simo Särkkä

We introduce a derivative-free computational framework for approximating solutions to nonlinear PDE-constrained inverse problems. The aim is to merge ideas from iterative regularization with ensemble Kalman methods from Bayesian inference…

Optimization and Control · Mathematics 2016-01-20 Marco A. Iglesias

Based on Bellman's dynamic-programming principle, Lange (2024) presents an approximate method for filtering, smoothing and parameter estimation for possibly non-linear and/or non-Gaussian state-space models. While the approach applies more…

Methodology · Statistics 2024-05-22 Rutger-Jan Lange

A nonlinear optimization method is proposed for the solution of inverse medium problems with spatially varying properties. To avoid the prohibitively large number of unknown control variables resulting from standard grid-based…

Numerical Analysis · Mathematics 2023-07-28 Yannik G. Gleichmann , Marcus J. Grote

The literature dealing with data-driven analysis and control problems has significantly grown in the recent years. Most of the recent literature deals with linear time-invariant systems in which the uncertainty (if any) is assumed to be…

Optimization and Control · Mathematics 2020-05-12 Daniele Alpago , Florian Dorfler , John Lygeros

This work highlights the duality between state estimation methods and model predictive control. A predictive controller, observed control, is presented that uses this duality to efficiently compute control actions with linear time-horizon…

Optimization and Control · Mathematics 2025-08-20 Eugene T. Hamzezadeh , Andrew J. Petruska

Ensemble Kalman inversion is a parallelizable methodology for solving inverse or parameter estimation problems. Although it is based on ideas from Kalman filtering, it may be viewed as a derivative-free optimization method. In its most…

Numerical Analysis · Mathematics 2024-12-20 Neil K. Chada , Andrew M. Stuart , Xin T. Tong

In this paper, we are motivated by two important applications: entropy-regularized optimal transport problem and road or IP traffic demand matrix estimation by entropy model. Both of them include solving a special type of optimization…

Optimization and Control · Mathematics 2017-09-27 Pavel Dvurechensky , Alexander Gasnikov , Sergey Omelchenko , Alexander Tiurin

Sparse training reduces the memory and computational costs of deep neural networks. However, sparse optimization methods, e.g., those adding an $\ell_1$ penalty, often control sparsity only indirectly through a regularization parameter…

Machine Learning · Computer Science 2026-05-21 Ahmad Aloradi , Tim Roith , Emanuël A. P. Habets , Daniel Tenbrinck

We propose a new regularisation strategy for the classical ensemble Kalman inversion (EKI) framework. The strategy consists of: (i) an adaptive choice for the regularisation parameter in the update formula in EKI, and (ii) criteria for the…

Numerical Analysis · Mathematics 2020-09-24 Marco Iglesias , Yuchen Yang