English
Related papers

Related papers: Applying the $\chi^2$ Regularization Parameter Est…

200 papers

We study a non-linear statistical inverse learning problem, where we observe the noisy image of a quantity through a non-linear operator at some random design points. We consider the widely used Tikhonov regularization (or method of…

Statistics Theory · Mathematics 2024-04-09 Abhishake Rastogi , Gilles Blanchard , Peter Mathé

We consider radial complex scaling/perfectly matched layer methods for scalar resonance problems in homogeneous exterior domains. We introduce a new abstract framework to analyze the convergence of domain truncations and discretizations.…

Numerical Analysis · Mathematics 2020-07-21 Martin Halla

This paper discusses weighted tensor Golub-Kahan-type bidiagonalization processes using the t-product. This product was introduced in [M. E. Kilmer and C. D. Martin, Factorization strategies for third order tensors, Linear Algebra Appl.,…

Numerical Analysis · Mathematics 2021-09-10 Lothar Reichel , Ugochukwu O Ugwu

Regularized kernel methods such as support vector machines (SVM) and support vector regression (SVR) constitute a broad and flexible class of methods which are theoretically well investigated and commonly used in nonparametric…

Methodology · Statistics 2013-05-07 Robert Hable

Analysis sparsity is a common prior in inverse problem or machine learning including special cases such as Total Variation regularization, Edge Lasso and Fused Lasso. We study the geometry of the solution set (a polyhedron) of the analysis…

Optimization and Control · Mathematics 2022-04-14 Xavier Dupuis , Samuel Vaiter

This paper introduces new solvers for the computation of low-rank approximate solutions to large-scale linear problems, with a particular focus on the regularization of linear inverse problems. Although Krylov methods incorporating explicit…

Numerical Analysis · Mathematics 2019-11-05 Silvia Gazzola , Chang Meng , James Nagy

Trigonometric polynomials are widely used for the approximation of a smooth function $f$ from a set of nonuniformly spaced samples $\{f(x_j)\}_{j=0}^{N-1}$. If the samples are perturbed by noise, controlling the smoothness of the…

Numerical Analysis · Mathematics 2025-10-20 Thomas Strohmer

In this paper we establish a best approximation property of fully discrete Galerkin finite element solutions of second order parabolic problems on convex polygonal and polyhedral domains in the $L^\infty$ norm. The discretization method…

Numerical Analysis · Mathematics 2018-08-20 Dmitriy Leykekhman , Boris Vexler

This paper presents an error analysis of classical and learned Tikhonov regularization schemes for inverse problems. We first demonstrate, both theoretically and numerically, that using a fixed regularization parameter across varying noise…

Numerical Analysis · Mathematics 2026-04-02 Arne Behrens , Meira Iske , Ming Jiang , Peter Maass , Sebastian Neumayer

This paper describes and compares some structure preserving techniques for the solution of linear discrete ill-posed problems with the t-product. A new randomized tensor singular value decomposition (R-tSVD) with a t-product is presented…

Numerical Analysis · Mathematics 2021-10-18 Ugochukwu O. Ugwu , Lothar Reichel

We present a converged algorithm for Tikhonov regularized nonnegative matrix factorization (NMF). We specially choose this regularization because it is known that Tikhonov regularized least square (LS) is the more preferable form in solving…

Machine Learning · Computer Science 2015-03-20 Andri Mirzal

It is common to have to process signals, whose values are points on the 3-D sphere. We consider a Tikhonov-type regularization model to smoothen or interpolate sphere-valued signals defined on arbitrary graphs. We propose a convex…

Optimization and Control · Mathematics 2022-07-26 Laurent Condat

Despite being a key bottleneck in many machine learning tasks, the cost of solving large linear systems has proven challenging to quantify due to problem-dependent quantities such as condition numbers. To tackle this, we consider a…

Data Structures and Algorithms · Computer Science 2025-06-18 Michał Dereziński , Daniel LeJeune , Deanna Needell , Elizaveta Rebrova

This paper focuses on regularisation methods using models up to the third order to search for up to second-order critical points of a finite-sum minimisation problem. The variant presented belongs to the framework of [3]: it employs random…

Numerical Analysis · Mathematics 2021-04-05 Stefania Bellavia , Gianmarco Gurioli , Benedetta Morini , Philippe L. Toint

We study whether a modified version of Tikhonov regularization can be used to identify several local sources from Dirichlet boundary data for a prototypical elliptic PDE. This paper extends the results presented in [5]. It turns out that…

Optimization and Control · Mathematics 2020-11-10 Ole Løseth Elvetun , Bjørn Fredrik Nielsen

This paper develops a discrete data-driven approach for solving the inverse source problem of the wave equation with final time measurements. Focusing on the $L^2$-Tikhonov regularization method, we analyze its convergence under two…

Numerical Analysis · Mathematics 2026-01-01 Qiling Gu , Wenlong Zhang , Zhidong Zhang

LSQR, a Lanczos bidiagonalization based Krylov subspace iterative method, and its mathematically equivalent CGLS applied to normal equations system, are commonly used for large-scale discrete ill-posed problems. It is well known that LSQR…

Numerical Analysis · Mathematics 2019-09-24 Yi Huang , Zhongxiao Jia

For large scale symmetric discrete ill-posed problems, MINRES and MR-II are often used iterative regularization solvers. We call a regularized solution best possible if it is at least as accurate as the best regularized solution obtained by…

Numerical Analysis · Mathematics 2019-09-24 Yi Huang , Zhongxiao Jia

Despite recent advances in regularisation theory, the issue of parameter selection still remains a challenge for most applications. In a recent work the framework of statistical learning was used to approximate the optimal Tikhonov…

Machine Learning · Statistics 2019-05-30 Ernesto de Vito , Zeljko Kereta , Valeria Naumova

This paper presents a novel approach to construct regularizing operators for severely ill-posed Fredholm integral equations of the first kind by introducing parametrized discretization. The optimal values of discretization and…

Numerical Analysis · Mathematics 2023-09-12 Vladimir V Kryzhniy