English
Related papers

Related papers: On the relation between constraint regularization,…

200 papers

In this work, we propose a high-order regularization method to solve the ill-conditioned problems in robot localization. Numerical solutions to robot localization problems are often unstable when the problems are ill-conditioned. A typical…

Robotics · Computer Science 2025-05-07 Xinghua Liu , Ming Cao

This paper presents a detailed theoretical analysis of the three stochastic approximation proximal gradient algorithms proposed in our companion paper [49] to set regularization parameters by marginal maximum likelihood estimation. We prove…

Statistics Theory · Mathematics 2020-08-14 Valentin De Bortoli , Alain Durmus , Ana F. Vidal , Marcelo Pereyra

We propose a novel 3d shape representation for 3d shape reconstruction from a single image. Rather than predicting a shape directly, we train a network to generate a training set which will be fed into another learning algorithm to define…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Biao Zhang , Peter Wonka

We present a geometric multilevel optimization approach that smoothly incorporates box constraints. Given a box constrained optimization problem, we consider a hierarchy of models with varying discretization levels. Finer models are…

Optimization and Control · Mathematics 2024-04-23 Sebastian Müller , Stefania Petra , Matthias Zisler

We adapt the quasi-monotone method from [2] for composite convex minimization in the stochastic setting. For the proposed numerical scheme we derive the optimal convergence rate in terms of the last iterate, rather than on average as it is…

Optimization and Control · Mathematics 2021-07-09 Vyacheslav Kungurtsev , Vladimir Shikhman

Inverse problems are inherently ill-posed and therefore require regularization techniques to achieve a stable solution. While traditional variational methods have well-established theoretical foundations, recent advances in machine learning…

Numerical Analysis · Mathematics 2023-09-15 Simon Göppel , Jürgen Frikel , Markus Haltmeier

In this paper, we deal with nonlinear ill-posed problems involving monotone operators and consider Lavrentiev's regularization method. This approach, in contrast to Tikhonov's regularization method, does not make use of the adjoint of the…

Numerical Analysis · Mathematics 2016-04-20 Bernd Hofmann , Barbara Kaltenbacher , Elena Resmerita

Connected with the rise of interest in inverse problems is the development and analysis of regularization methods, which are a necessity due to the ill-posedness of inverse problems. Tikhonov-type regularization methods are very popular in…

Numerical Analysis · Mathematics 2021-03-16 Abinash Nayak

This paper introduces an abstract framework for randomized subspace correction methods for convex optimization, which unifies and generalizes a broad class of existing algorithms, including domain decomposition, multigrid, and block…

Optimization and Control · Mathematics 2026-04-28 Boou Jiang , Jongho Park , Jinchao Xu

In this paper we propose a new class of iterative regularization methods for solving ill-posed linear operator equations. The prototype of these iterative regularization methods is in the form of second order evolution equation with a…

Numerical Analysis · Mathematics 2020-06-24 Rongfang Gong , B. Hofmann , Ye Zhang

This paper proposes a unified framework for the investigation of constrained learning theory in reflexive Banach spaces of features via regularized empirical risk minimization. The focus is placed on Tikhonov-like regularization with…

Statistics Theory · Mathematics 2016-10-20 Patrick L. Combettes , Saverio Salzo , Silvia Villa

Convergence rates in spectral regularization methods quantify the approximation error in inverse problems as a function of the noise level or the number of sampling points. Classical strong convergence rate results typically rely on source…

Numerical Analysis · Mathematics 2025-12-05 Sabrina Guastavino , Gabriele Santin , Francesco Marchetti , Federico Benvenuto

We consider the variational reconstruction framework for inverse problems and propose to learn a data-adaptive input-convex neural network (ICNN) as the regularization functional. The ICNN-based convex regularizer is trained adversarially…

In this paper we present a generalized Deep Learning-based approach for solving ill-posed large-scale inverse problems occuring in medical image reconstruction. Recently, Deep Learning methods using iterative neural networks and cascaded…

Image and Video Processing · Electrical Eng. & Systems 2020-08-26 Andreas Kofler , Markus Haltmeier , Tobias Schaeffter , Marc Kachelrieß , Marc Dewey , Christian Wald , Christoph Kolbitsch

In this paper we discuss a deterministic form of ensemble Kalman inversion as a regularization method for linear inverse problems. By interpreting ensemble Kalman inversion as a low-rank approximation of Tikhonov regularization, we are able…

Numerical Analysis · Mathematics 2023-10-31 Fabian Parzer , Otmar Scherzer

We consider a statistical inverse learning problem, where the task is to estimate a function $f$ based on noisy point evaluations of $Af$, where $A$ is a linear operator. The function $Af$ is evaluated at i.i.d. random design points $u_n$,…

Machine Learning · Statistics 2021-11-02 Tatiana A. Bubba , Martin Burger , Tapio Helin , Luca Ratti

We develop a rigorous framework for global non-convex optimization by reformulating the minimization problem as a discounted infinite-horizon optimal control problem. For non-convex, continuous, and possibly non-smooth objective functions…

Optimization and Control · Mathematics 2026-03-31 Yuyang Huang , Dante Kalise , Hicham Kouhkouh

Many works on inverse problems in the imaging sciences consider regularization via one or more penalty functions or constraint sets. When the models/images are not easily described using one or a few penalty functions/constraints, additive…

Image and Video Processing · Electrical Eng. & Systems 2019-03-12 Bas Peters , Felix J. Herrmann

We present a computational method for empirically characterizing the training loss level-sets of deep neural networks. Our method numerically constructs a path in parameter space that is constrained to a set with a fixed near-zero training…

Machine Learning · Computer Science 2021-04-27 Naveed Tahir , Garrett E. Katz

We study optimal design problems involving variational inequalities with unilateral conditions in the domain and pointwise boundary observation. We use regularizing and penalization tehniques in the setting of the Hamiltonian approach to…

Optimization and Control · Mathematics 2025-12-30 Cornel Marius Murea , Dan Tiba