English
Related papers

Related papers: Beyond convergence rates: Exact recovery with Tikh…

200 papers

In this paper we discuss a deterministic form of ensemble Kalman inversion as a regularization method for linear inverse problems. By interpreting ensemble Kalman inversion as a low-rank approximation of Tikhonov regularization, we are able…

Numerical Analysis · Mathematics 2023-10-31 Fabian Parzer , Otmar Scherzer

In this paper we consider under-determined systems of linear equations that have sparse solutions. This subject attracted enormous amount of interest in recent years primarily due to influential works \cite{CRT,DonohoPol}. In a statistical…

Information Theory · Computer Science 2013-04-01 Mihailo Stojnic

We consider linear inverse problems that are formulated in the continuous domain. The object of recovery is a function that is assumed to minimize a convex objective functional. The solutions are constrained by imposing a continuous-domain…

Information Theory · Computer Science 2018-08-15 Harshit Gupta , Julien Fageot , Michael Unser

Regularization is a critical technique for ensuring well-posedness in solving inverse problems with incomplete measurement data. Traditionally, the regularization term is designed based on prior knowledge of the unknown signal's…

Numerical Analysis · Mathematics 2024-12-16 Bosu Choi , Jihun Han , Yoonsang Lee

This paper is concerned with second-order optimality conditions for Tikhonov regularized optimal control problems governed by the obstacle problem. Using a simple observation that allows to characterize the structure of optimal controls on…

Optimization and Control · Mathematics 2019-06-24 Constantin Christof , Gerd Wachsmuth

Tikhonov regularization for projected solutions of large-scale ill-posed problems is considered. The Golub-Kahan iterative bidiagonalization is used to project the problem onto a subspace and regularization then applied to find a subspace…

Numerical Analysis · Mathematics 2022-08-16 Rosemary A. Renaut , Saeed Vatankhah , Vahid E. Ardestani

We discuss a general notion of "sparsity structure" and associated recoveries of a sparse signal from its linear image of reduced dimension possibly corrupted with noise. Our approach allows for unified treatment of (a) the "usual sparsity"…

Optimization and Control · Mathematics 2016-11-26 Anatoli Juditsky , Fatma Kilinc Karzan , Arkadi Nemirovski

Total Generalized Variation (TGV) has recently been introduced as penalty functional for modelling images with edges as well as smooth variations. It can be interpreted as a "sparse" penalization of optimal balancing from the first up to…

Numerical Analysis · Mathematics 2020-05-21 Kristian Bredies , Tuomo Valkonen

In this paper, we study the support recovery guarantees of underdetermined sparse regression using the $\ell_1$-norm as a regularizer and a non-smooth loss function for data fidelity. More precisely, we focus in detail on the cases of…

Information Theory · Computer Science 2016-11-04 Kévin Degraux , Gabriel Peyré , Jalal M. Fadili , Laurent Jacques

We consider the problem of recovering sparse vectors from underdetermined linear measurements via $\ell_p$-constrained basis pursuit. Previous analyses of this problem based on generalized restricted isometry properties have suggested that…

Information Theory · Computer Science 2015-04-21 Sjoerd Dirksen , Guillaume Lecué , Holger Rauhut

We consider the general nonlinear optimization problem where the objective function has an additional term defined by the $ \ell_0 $-quasi-norm in order to promote sparsity of a solution. This problem is highly difficult due to its…

Optimization and Control · Mathematics 2023-12-27 Christian Kanzow , Felix Weiß

We consider perturbed nonlinear ill-posed equations in Hilbert spaces, with operators that are monotone on a given closed convex subset. A simple stable approach is Lavrentiev regularization, but existence of solutions of the regularized…

Numerical Analysis · Mathematics 2018-06-05 Robert Plato , Bernd Hofmann

The theory of spectral filtering is a remarkable tool to understand the statistical properties of learning with kernels. For least squares, it allows to derive various regularization schemes that yield faster convergence rates of the excess…

Machine Learning · Computer Science 2021-11-11 Gaspard Beugnot , Julien Mairal , Alessandro Rudi

We consider solving a probably infinite dimensional operator equation, where the operator is not modeled by physical laws but is specified indirectly via training pairs of the input-output relation of the operator. Neural operators have…

Numerical Analysis · Mathematics 2026-05-06 Otmar Scherzer , Thi Lan Nhi Vu , Jikai Yan

This work addresses the robust reconstruction problem of a sparse signal from compressed measurements. We propose a robust formulation for sparse reconstruction which employs the $\ell_1$-norm as the loss function for the residual error and…

Information Theory · Computer Science 2017-03-30 Fei Wen , Yuan Yang , Ling Pei , Wenxian Yu , Peilin Liu

Sparsity inducing regularization is an important part for learning over-complete visual representations. Despite the popularity of $\ell_1$ regularization, in this paper, we investigate the usage of non-convex regularizations in this…

Machine Learning · Computer Science 2017-11-09 Jianqiao Wangni , Dahua Lin

In this paper we investigate the problem of identifying the source term in an elliptic system from a single noisy measurement couple of the Neumann and Dirichlet data. A variational method of Tikhonov-type regularization with specific…

Analysis of PDEs · Mathematics 2019-03-15 Michael Hinze , Bernd Hofmann , Tran Nhan Tam Quyen

We study filter based regularization methods for linear ill-posed problems between Hilbert spaces. We derive optimal order conditions under a-priori choice rules for the regularization parameter. Such analysis is applied to the fractional…

Numerical Analysis · Mathematics 2014-05-09 Davide Bianchi , Marco Donatelli , Stefano Serra-Capizzano

Tikhonov regularization is a popular approach to obtain a meaningful solution for ill-conditioned linear least squares problems. A relatively simple way of choosing a good regularization parameter is given by Morozov's discrepancy…

Numerical Analysis · Mathematics 2020-06-24 Jeffrey Cornelis , Nick Schenkels , Wim Vanroose

This is a survey, which is a continuation of the previous survey of the author about applications of Carleman estimates to Inverse Problems, J. Inverse and Ill-Posed Problems, 21, 477-560, 2013. It is shown here that Tikhonov functionals…

Mathematical Physics · Physics 2014-10-29 Michael V. Klibanov