English
Related papers

Related papers: Stochastic convergence of regularized solutions fo…

200 papers

Backward parabolic equations, such as the backward heat equation, are classical examples of ill-posed problems where solutions may not exist or depend continuously on the data. In this work, we study a least squares finite element method to…

Numerical Analysis · Mathematics 2025-10-28 Harald Monsuur

Stochastic optimisation algorithms are the de facto standard for machine learning with large amounts of data. Handling only a subset of available data in each optimisation step dramatically reduces the per-iteration computational costs,…

Numerical Analysis · Mathematics 2024-12-19 Matthias J. Ehrhardt , Zeljko Kereta , Jingwei Liang , Junqi Tang

We develop a quadratic regularization approach for the solution of high-dimensional multistage stochastic optimization problems characterized by a potentially large number of time periods/stages (e.g. hundreds), a high-dimensional resource…

Optimization and Control · Mathematics 2017-02-28 Tsvetan Asamov , Warren B. Powell

Recovering a low-complexity signal from its noisy observations by regularization methods is a cornerstone of inverse problems and compressed sensing. Stable recovery ensures that the original signal can be approximated linearly by optimal…

Optimization and Control · Mathematics 2025-05-30 Tran T. A. Nghia , Huy N. Pham , Nghia V. Vo

The recently developed data-driven eigenmatrix method shows very promising reconstruction accuracy in sparse recovery for a wide range of kernel functions and random sample locations. However, its current implementation can lead to…

Numerical Analysis · Mathematics 2024-05-15 Koung Hee Leem , Jun Liu , George Pelekanos

A number of regularization methods for discrete inverse problems consist in considering weighted versions of the usual least square solution. However, these so-called filter methods are generally restricted to monotonic transformations,…

Statistics Theory · Mathematics 2011-05-05 Paul Rochet

We present a new approach to convexification of the Tikhonov regularization using a continuation method strategy. We embed the original minimization problem into a one-parameter family of minimization problems. Both the penalty term and the…

Numerical Analysis · Mathematics 2015-06-15 Valdemar Melicher , Vladimir Vrabel

We propose a time-implicit, finite-element based space-time discretization of the necessary and sufficient optimality conditions for the stochastic linear-quadratic optimal control problem with the stochastic heat equation driven by linear…

Optimization and Control · Mathematics 2020-12-09 Andreas Prohl , Yanqing Wang

We consider a modified Tikhonov-type functional for the solution of ill-posed nonlinear inverse problems. Motivated by applications in the field of production engineering, we allow small deviations in the solution, which are modeled through…

Numerical Analysis · Mathematics 2020-07-14 Iwona Piotrowska-Kurczewski , Georgia Sfakianaki

The joint bidiagonalization process of a matrix pair $\{A,L\}$ can be used to develop iterative regularization algorithms for large scale ill-posed problems in general-form Tikhonov regularization…

Numerical Analysis · Mathematics 2020-12-29 Haibo Li

We study Tikhonov regularization for solving ill--posed operator equations where the solutions are functions defined on surfaces. One contribution of this paper is an error analysis of Tikhonov regularization which takes into account…

Numerical Analysis · Mathematics 2016-12-15 Guozhi Dong , Bert Juettler , Otmar Scherzer , Thomas Takacs

In this paper the approximate solution of the heat exchange problem by A.N. Tikhonov regularization method is presented. The errror estimation of this approximate is obtained.

Numerical Analysis · Mathematics 2013-10-03 V. F. Mirasov , A. I. Sidikova

Tikhonov regularization is a common technique used when solving poorly behaved optimization problems. Often, and with good reason, this technique is applied by practitioners in an ad hoc fashion. In this note, we systematically illustrate…

Optimization and Control · Mathematics 2022-12-16 J. Adriazola

The objective of this work is to quantify the reconstruction error in sparse inverse problems with measures and stochastic noise, motivated by optimal sensor placement. To be useful in this context, the error quantities must be explicit in…

Numerical Analysis · Mathematics 2024-04-19 Phuoc-Truong Huynh , Konstantin Pieper , Daniel Walter

The problem of numerical differentiation can be thought of as an inverse problem by considering it as solving a Volterra equation. It is well known that such inverse integral problems are ill-posed and one requires regularization methods to…

Numerical Analysis · Mathematics 2020-04-15 Abinash Nayak

Tikhonov regularization involves minimizing the combination of a data discrepancy term and a regularizing term, and is the standard approach for solving inverse problems. The use of non-convex regularizers, such as those defined by trained…

Optimization and Control · Mathematics 2023-02-20 Daniel Obmann , Markus Haltmeier

The Tikhonov regularization of linear ill-posed problems with an $\ell^1$ penalty is considered. We recall results for linear convergence rates and results on exact recovery of the support. Moreover, we derive conditions for exact support…

Functional Analysis · Mathematics 2015-05-18 Dirk A. Lorenz , Stefan Schiffler , Dennis Trede

In this paper we formulate and solve a robust least squares problem for a system of linear equations subject to quantization error in the data matrix. Ordinary least squares fails to consider uncertainty in the operator, modeling all noise…

Optimization and Control · Mathematics 2021-04-09 Richard Clancy , Stephen Becker

We develop and analyze stochastic optimization algorithms for problems in which the expected loss is strongly convex, and the optimum is (approximately) sparse. Previous approaches are able to exploit only one of these two structures,…

Machine Learning · Statistics 2012-07-19 Alekh Agarwal , Sahand Negahban , Martin J. Wainwright

We study kernel least-squares estimation under a norm constraint. This form of regularisation is known as Ivanov regularisation and it provides better control of the norm of the estimator than the well-established Tikhonov regularisation.…

Statistics Theory · Mathematics 2019-06-17 Stephen Page , Steffen Grünewälder