English
Related papers

Related papers: Adaptive regularisation for ensemble Kalman invers…

200 papers

Parameter estimation has a high importance in the geosciences. The ensemble Kalman filter (EnKF) allows parameter estimation for large, time-dependent systems. For large systems, the EnKF is applied using small ensembles, which may lead to…

Applications · Statistics 2021-08-05 Johannes Keller , Harrie-Jan Hendricks Franssen , Wolfgang Nowak

In this article, we propose a novel regularization method for a class of nonlinear inverse problems that is inspired by an application in quantitative magnetic resonance imaging (qMRI). The latter is a special instance of a general…

Optimization and Control · Mathematics 2025-06-16 Guozhi Dong , Michael Hintermüller , Clemens Sirotenko

Approximate Bayesian computation (ABC) is the most popular approach to inferring parameters in the case where the data model is specified in the form of a simulator. It is not possible to directly implement standard Monte Carlo methods for…

Methodology · Statistics 2024-07-29 Richard G Everitt

We introduce a novel nonlinear Kalman filter that utilizes reparametrization gradients. The widely used parametric approximation is based on a jointly Gaussian assumption of the state-space model, which is in turn equivalent to minimizing…

Machine Learning · Computer Science 2023-03-09 San Gultekin , Brendan Kitts , Aaron Flores , John Paisley

We investigate continuous regularization methods for linear inverse problems of static and dynamic type. These methods are based on dynamic programming approaches for linear quadratic optimal control problems. We prove regularization…

Optimization and Control · Mathematics 2021-01-27 S. Kindermann , A. Leitao

This paper presents a novel theoretical framework, called explicit ensemble mean (EEM) synchronization. This framework unifies time scale generation, clock synchronization, and oscillator frequency regulation within the systems and control…

Systems and Control · Electrical Eng. & Systems 2026-03-31 Takayuki Ishizaki , Takahiro Kawaguchi , Yuichiro Yano , Yuko Hanado

The Kalman filter (KF) is an optimal linear state estimator for linear systems, and numerous extensions, including the extended Kalman filter (EKF), unscented Kalman filter (UKF), and cubature Kalman filter (CKF), have been developed for…

Systems and Control · Electrical Eng. & Systems 2026-04-07 Shida Jiang , Junzhe Shi , Scott Moura

This paper focuses on parameter selection issues of kernel ridge regression (KRR). Due to special spectral properties of KRR, we find that delicate subdivision of the parameter interval shrinks the difference between two successive KRR…

Machine Learning · Computer Science 2023-12-12 Shao-Bo Lin

We here adapt an extended version of the adaptive cubic regularisation method with dynamic inexact Hessian information for nonconvex optimisation in [3] to the stochastic optimisation setting. While exact function evaluations are still…

Numerical Analysis · Mathematics 2020-09-15 Stefania Bellavia , Gianmarco Gurioli

In recent years, several ensemble-based filtering methods have been proposed and studied. The main challenge in such procedures is the updating of a prior ensemble to a posterior ensemble at every step of the filtering recursions. In the…

Methodology · Statistics 2019-04-11 Margrethe Kvale Loe , Håkon Tjelmeland

We consider the problem of performing Bayesian inference for logistic regression using appropriate extensions of the ensemble Kalman filter. Two interacting particle systems are proposed that sample from an approximate posterior and prove…

Machine Learning · Statistics 2024-07-02 Diksha Bhandari , Jakiw Pidstrigach , Sebastian Reich

Choosing the regularization parameter for inverse problems is of major importance for the performance of the regularization method. We will introduce a fast version of the Lepskij balancing principle and show that it is a valid parameter…

Numerical Analysis · Mathematics 2010-08-04 Frank Bauer

We present an approach to identify a quasi Linear Parameter Varying (qLPV) model of a plant, with the qLPV model guaranteed to admit a robust control invariant (RCI) set. It builds upon the concurrent synthesis framework presented in [1],…

Optimization and Control · Mathematics 2025-05-13 Sampath Kumar Mulagaleti , Alberto Bemporad

Ensemble methods have become ubiquitous for the solution of Bayesian inference problems. State-of-the-art Langevin samplers such as the Ensemble Kalman Sampler (EKS), Affine Invariant Langevin Dynamics (ALDI) or its extension using weighted…

Numerical Analysis · Mathematics 2022-12-23 Martin Eigel , Robert Gruhlke , David Sommer

$\ell_1$ regularization is used to preserve edges or enforce sparsity in a solution to an inverse problem. We investigate the Split Bregman and the Majorization-Minimization iterative methods that turn this non-smooth minimization problem…

Numerical Analysis · Mathematics 2024-12-16 Brian Sweeney , Rosemary Renaut , Malena Español

Kalman filtering is a widely used framework for Bayesian estimation. The partitioned update Kalman filter applies a Kalman filter update in parts so that the most linear parts of measurements are applied first. In this paper, we generalize…

Optimization and Control · Mathematics 2016-03-16 Matti Raitoharju , Ángel F. García-Fernández , Robert Piché

We develop a generalized inverse optimization framework for fitting the cost vector of a single linear optimization problem given multiple observed decisions. This setting is motivated by ensemble learning, where building consensus from…

Optimization and Control · Mathematics 2020-06-08 Aaron Babier , Timothy C. Y. Chan , Taewoo Lee , Rafid Mahmood , Daria Terekhov

We propose a novel iterative algorithm for solving a large sparse linear system. The method is based on the EM algorithm. If the system has a unique solution, the algorithm guarantees convergence with a geometric rate. Otherwise,…

Numerical Analysis · Mathematics 2018-08-03 Minwoo Chae , Stephen G. Walker

Legged robots require knowledge of pose and velocity in order to maintain stability and execute walking paths. Current solutions either rely on vision data, which is susceptible to environmental and lighting conditions, or fusion of…

Robotics · Computer Science 2019-11-13 Ross Hartley , Maani Ghaffari , Ryan M. Eustice , Jessy W. Grizzle

In this paper, we propose a new framework for solving state estimation problems with an additional sparsity-promoting $L_1$-regularizer term. We first formulate such problems as minimization of the sum of linear or nonlinear quadratic error…

Information Theory · Computer Science 2019-10-02 Rui Gao , Filip Tronarp , Simo Särkkä