English
Related papers

Related papers: Regularization Parameter Estimation for Underdeter…

200 papers

We study the choice of the regularisation parameter for linear ill-posed problems in the presence of noise that is possibly unbounded but only finite in a weaker norm, and when the noise-level is unknown. For this task, we analyse several…

Numerical Analysis · Mathematics 2021-04-14 Stefan Kindermann , Kemal Raik

We consider the inverse problem of reconstructing inhomogeneities by performing a finite number of scattering measurements of acoustic type in the time-harmonic setting. We set up the reconstruction as a fully discrete variational problem…

Analysis of PDEs · Mathematics 2026-02-24 Daniela Di Donato , Luca Rondi

Problems in machine learning (ML) can involve noisy input data, and ML classification methods have reached limiting accuracies when based on standard ML data sets consisting of feature vectors and their classes. Greater accuracy will…

Machine Learning · Statistics 2013-12-31 Yue Fan , Louise Raphael , Mark Kon

In this work, we introduce a novel approach to regularization in multivariable regression problems. Our regularizer, called DLoss, penalises differences between the model's derivatives and derivatives of the data generating function as…

Machine Learning · Computer Science 2024-05-02 Enrico Lopedoto , Maksim Shekhunov , Vitaly Aksenov , Kizito Salako , Tillman Weyde

In this paper, we study an explicit Tikhonov-regularized inertial gradient algorithm for smooth convex minimization with Lipschitz continuous gradient. The method is derived via an explicit time discretization of a damped inertial system…

Optimization and Control · Mathematics 2026-02-02 Samir Adly , Vinh Thanh Ho , Huu Nhan Nguyen

This work is concerned with linear inverse problems where a distributed parameter is known a priori to only take on values from a given discrete set. This property can be promoted in Tikhonov regularization with the aid of a suitable convex…

Optimization and Control · Mathematics 2018-04-19 Christian Clason , Thi Bich Tram Do

In this paper, we study the stochastic convergence of regularized solutions for backward heat conduction problems. These problems are recognized as ill-posed due to the exponential decay of eigenvalues associated with the forward problems.…

Numerical Analysis · Mathematics 2023-11-08 Zhongjian Wang , Wenlong Zhang , Zhiwen Zhang

For large scale symmetric discrete ill-posed problems, MINRES and MR-II are often used iterative regularization solvers. We call a regularized solution best possible if it is at least as accurate as the best regularized solution obtained by…

Numerical Analysis · Mathematics 2019-09-24 Yi Huang , Zhongxiao Jia

We develop new solvability methods for divergence form second order, real and complex, elliptic systems above Lipschitz graphs, with $L_2$ boundary data. The coefficients $A$ may depend on all variables, but are assumed to be close to…

Analysis of PDEs · Mathematics 2010-09-16 Pascal Auscher , Andreas Axelsson

Sparsity is a highly desired feature in deep neural networks (DNNs) since it ensures numerical efficiency, improves the interpretability of models (due to the smaller number of relevant features), and robustness. For linear models, it is…

Machine Learning · Computer Science 2024-04-01 Augustina C. Amakor , Konstantin Sonntag , Sebastian Peitz

Mirror descent value iteration (MDVI), an abstraction of Kullback-Leibler (KL) and entropy-regularized reinforcement learning (RL), has served as the basis for recent high-performing practical RL algorithms. However, despite the use of…

The Arnoldi-Tikhonov method is a well-established regularization technique for solving large-scale ill-posed linear inverse problems. This method leverages the Arnoldi decomposition to reduce computational complexity by projecting the…

Numerical Analysis · Mathematics 2025-06-02 Davide Bianchi , Marco Donatelli , Davide Furchì , Lothar Reichel

Regularization in the optimization of deep neural networks is often critical to avoid undesirable over-fitting leading to better generalization of model. One of the most popular regularization algorithms is to impose L-2 penalty on the…

Machine Learning · Computer Science 2019-08-09 Kensuke Nakamura , Byung-Woo Hong

In this work we deal with parametric inverse problems, which consist in recovering a finite number of parameters describing the structure of an unknown object, from indirect measurements. State-of-the-art methods for approximating a…

Numerical Analysis · Mathematics 2021-12-22 Paolo Massa , Sara Garbarino , Federico Benvenuto

The quasi-optimality criterion chooses the regularization parameter in inverse problems without taking into account the noise level. This rule works remarkably well in practice, although Bakushinskii has shown that there are always…

Numerical Analysis · Mathematics 2009-11-13 Frank Bauer , Markus Reiss

Regularization techniques are widely employed in optimization-based approaches for solving ill-posed inverse problems in data analysis and scientific computing. These methods are based on augmenting the objective with a penalty function,…

Optimization and Control · Mathematics 2021-06-08 Yong Sheng Soh , Venkat Chandrasekaran

Many applications in science and engineering require the solution of large linear discrete ill-posed problems that are obtained by the discretization of a Fredholm integral equation of the first kind in several space-dimensions. The matrix…

Numerical Analysis · Mathematics 2017-05-19 Laura Dykes , Guangxin Huang , Silvia Noschese , Lothar Reichel

During the inversion of discrete linear systems noise in data can be amplified and result in meaningless solutions. To combat this effect, characteristics of solutions that are considered desirable are mathematically implemented during…

Numerical Analysis · Mathematics 2023-02-07 Michael J. Byrne , Rosemary A. Renaut

We present a new method for minimizing the sum of a differentiable convex function and an $\ell_1$-norm regularizer. The main features of the new method include: $(i)$ an evolving set of indices corresponding to variables that are predicted…

Optimization and Control · Mathematics 2016-02-24 Tianyi Chen , Frank E. Curtis , Daniel P. Robinson

In this work, we investigate the regularized solutions and their finite element solutions to the inverse source problems governed by partial differential equations, and establish the stochastic convergence and optimal finite element…

Numerical Analysis · Mathematics 2021-10-25 Zhiming Chen , Wenlong Zhang , Jun Zou