English
Related papers

Related papers: Ensemble Kalman inversion with non-smooth regulari…

200 papers

A new type of ensemble Kalman filter is developed, which is based on replacing the sample covariance in the analysis step by its diagonal in a spectral basis. It is proved that this technique improves the aproximation of the covariance when…

Methodology · Statistics 2015-08-19 Ivan Kasanický , Jan Mandel , Martin Vejmelka

The inverse Kohn-Sham (KS) problem seeks a local effective potential whose noninteracting ground state reproduces a prescribed electron density. Existing inversion formulations are often expressed in disparate languages, including reduced…

Chemical Physics · Physics 2026-04-27 Nan Sheng

We further develop a new framework, called PDE Acceleration, by applying it to calculus of variations problems defined for general functions on $\mathbb{R}^n$, obtaining efficient numerical algorithms to solve the resulting class of…

Numerical Analysis · Computer Science 2018-10-02 Minas Benyamin , Jeff Calder , Ganesh Sundaramoorthi , Anthony Yezzi

We propose a penalty-based smoothing framework for convex nonsmooth functions with a supremum structure. The regularization yields a differentiable surrogate with controlled approximation error, a single-valued dual maximizer, and explicit…

Optimization and Control · Mathematics 2026-01-22 Samir Adly , Juan José Maulén , Emilio Vilches

Ensemble methods, such as the ensemble Kalman filter (EnKF), the local ensemble transform Kalman filter (LETKF), and the ensemble Kalman smoother (EnKS) are widely used in sequential data assimilation, where state vectors are of huge…

Probability · Mathematics 2019-01-03 El houcine Bergou , Serge Gratton , Jan Mandel

In regularized risk minimization, the associated optimization problem becomes particularly difficult when both the loss and regularizer are nonsmooth. Existing approaches either have slow or unclear convergence properties, are restricted to…

Machine Learning · Computer Science 2016-10-14 Shuai Zheng , Ruiliang Zhang , James T. Kwok

This work introduces a new, distributed implementation of the Ensemble Kalman Filter (EnKF) that allows for non-sequential assimilation of large datasets in high-dimensional problems. The traditional EnKF algorithm is computationally…

Machine Learning · Statistics 2023-11-23 Cédric Travelletti , Jörg Franke , David Ginsbourger , Stefan Brönnimann

We consider the nonstationary iterated Tikhonov regularization in Banach spaces which defines the iterates via minimization problems with uniformly convex penalty term. The penalty term is allowed to be non-smooth to include $L^1$ and total…

Numerical Analysis · Mathematics 2014-01-21 Qinian Jin , Min Zhong

Sparse learning is a very important tool for mining useful information and patterns from high dimensional data. Non-convex non-smooth regularized learning problems play essential roles in sparse learning, and have drawn extensive attentions…

Machine Learning · Computer Science 2020-10-22 Guannan Liang , Qianqian Tong , Jiahao Ding , Miao Pan , Jinbo Bi

We provide a rigorous derivation of the Ensemble Kalman-Bucy Filter as well as the Ensemble Transform Kalman-Bucy Filter in case of nonlinear, unbounded model and observation operators. We identify them as the continuous time limit of the…

Probability · Mathematics 2021-11-29 Theresa Lange

State-space smoothing has found many applications in science and engineering. Under linear and Gaussian assumptions, smoothed estimates can be obtained using efficient recursions, for example Rauch-Tung-Striebel and Mayne-Fraser algorithms.…

Optimization and Control · Mathematics 2016-09-27 A. Y. Aravkin , J. V. Burke , L. Ljung , A. Lozano , G. Pillonetto

The Ensemble Kalman Filter method can be used as an iterative particle numerical scheme for state dynamics estimation and control--to--observable identification problems. In applications it may be required to enforce the solution to satisfy…

Numerical Analysis · Mathematics 2020-08-26 Michael Herty , Giuseppe Visconti

We look at a stochastic time-varying optimization problem and we formulate online algorithms to find and track its optimizers in expectation. The algorithms are derived from the intuition that standard prediction and correction steps can be…

Optimization and Control · Mathematics 2024-04-11 Andrea Simonetto , Paolo Massioni

Ensemble randomized maximum likelihood (EnRML) is an iterative (stochastic) ensemble smoother, used for large and nonlinear inverse problems, such as history matching and data assimilation. Its current formulation is overly complicated and…

Data Analysis, Statistics and Probability · Physics 2019-09-12 Patrick N. Raanes , Geir Evensen , Andreas S. Stordal

Equivariant and invariant deep learning models have been developed to exploit intrinsic symmetries in data, demonstrating significant effectiveness in certain scenarios. However, these methods often suffer from limited representation…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Yulu Bai , Jiahong Fu , Qi Xie , Deyu Meng

We present new convolution based smooth approximations to the absolute value function and apply them to construct gradient based algorithms such as the nonlinear conjugate gradient scheme to obtain sparse, regularized solutions of linear…

Numerical Analysis · Mathematics 2015-07-02 Sergey Voronin , Gorkem Ozkaya , Davis Yoshida

This paper discusses an efficient parallel implementation of the ensemble Kalman filter based on the modified Cholesky decomposition. The proposed implementation starts with decomposing the domain into sub-domains. In each sub-domain a…

Numerical Analysis · Computer Science 2016-06-03 Elias D. Nino , Adrian Sandu , Xinwei Deng

Long-horizon dynamical prediction is fundamental in robotics and control, underpinning canonical methods like model predictive control. Yet, many systems and disturbance phenomena are difficult to model due to effects like nonlinearity,…

Robotics · Computer Science 2025-12-04 Albert H. Li , Ivan Dario Jimenez Rodriguez , Joel W. Burdick , Yisong Yue , Aaron D. Ames

In this paper we analyze the finite element approximation of the Stokes equations with non-smooth Dirichlet boundary data. To define the discrete solution, we first approximate the boundary datum by a smooth one and then apply a standard…

Numerical Analysis · Mathematics 2019-12-12 Ricardo G. Durán , Lucia Gastaldi , Ariel L. Lombardi

We study the use of novel techniques arising in machine learning for inverse problems. Our approach replaces the complex forward model by a neural network, which is trained simultaneously in a one-shot sense when estimating the unknown…

Numerical Analysis · Mathematics 2020-09-15 Philipp A. Guth , Claudia Schillings , Simon Weissmann