English
Related papers

Related papers: Function and derivative approximation by shallow n…

200 papers

The goal of this paper is to present a novel approach for total variation regularization and Sobolev minimization, which are prominent tools for variational imaging. Thereby we use derivative free characterizations of the total variation…

Optimization and Control · Mathematics 2009-11-09 Carsten Pontow , Otmar Scherzer

We study Tikhonov regularization for possibly nonlinear inverse problems with weighted $\ell^1$-penalization. The forward operator, mapping from a sequence space to an arbitrary Banach space, typically an $L^2$-space, is assumed to satisfy…

Numerical Analysis · Mathematics 2021-10-19 Philip Miller , Thorsten Hohage

In this paper, we propose to use the general $L^2$-based Sobolev norms, i.e., $H^s$ norms where $s\in \mathbb{R}$, to measure the data discrepancy due to noise in image processing tasks that are formulated as optimization problems. As…

Numerical Analysis · Mathematics 2022-03-01 Bowen Zhu , Jingwei Hu , Yifei Lou , Yunan Yang

We propose aNETT (augmented NETwork Tikhonov) regularization as a novel data-driven reconstruction framework for solving inverse problems. An encoder-decoder type network defines a regularizer consisting of a penalty term that enforces…

Numerical Analysis · Mathematics 2021-02-09 Daniel Obmann , Linh Nguyen , Johannes Schwab , Markus Haltmeier

Recent years have witnessed a hot wave of deep neural networks in various domains; however, it is not yet well understood theoretically. A theoretical characterization of deep neural networks should point out their approximation ability and…

Machine Learning · Computer Science 2022-10-28 Gao Zhang , Jin-Hui Wu , Shao-Qun Zhang

Conditional stability estimates require additional regularization for obtaining stable approximate solutions if the validity area of such estimates is not completely known. In this context, we consider ill-posed nonlinear inverse problems…

Numerical Analysis · Mathematics 2020-01-29 Frank Werner , Bernd Hofmann

Tikhonov regularization involves minimizing the combination of a data discrepancy term and a regularizing term, and is the standard approach for solving inverse problems. The use of non-convex regularizers, such as those defined by trained…

Optimization and Control · Mathematics 2023-02-20 Daniel Obmann , Markus Haltmeier

We propose regularization schemes for deformable registration and efficient algorithms for their numerical approximation. We treat image registration as a variational optimal control problem. The deformation map is parametrized by its…

Optimization and Control · Mathematics 2016-09-09 Andreas Mang , George Biros

This paper addresses the optimization problem of minimizing non-convex continuous functions, which is relevant in the context of high-dimensional machine learning applications characterized by over-parametrization. We analyze a randomized…

Machine Learning · Computer Science 2025-02-28 Jim Zhao , Aurelien Lucchi , Nikita Doikov

The Inverse Problem for the estimation of a point-wise approximation error occurring at the discretization and solving of the system of partial differential equations is addressed. The set of the differences between the numerical solutions…

Numerical Analysis · Mathematics 2021-01-05 Aleksey Alekseev , Alexander Bondarev

Equivariance is a powerful inductive bias in neural networks, improving generalisation and physical consistency. Recently, however, non-equivariant models have regained attention, due to their better runtime performance and imperfect…

Machine Learning · Computer Science 2026-05-27 Torben Berndt , Jan Stühmer

Tikhonov regularization for projected solutions of large-scale ill-posed problems is considered. The Golub-Kahan iterative bidiagonalization is used to project the problem onto a subspace and regularization then applied to find a subspace…

Numerical Analysis · Mathematics 2022-08-16 Rosemary A. Renaut , Saeed Vatankhah , Vahid E. Ardestani

In this article, we study approximation properties of the variation spaces corresponding to shallow neural networks with a variety of activation functions. We introduce two main tools for estimating the metric entropy, approximation rates,…

Machine Learning · Statistics 2024-02-26 Jonathan W. Siegel , Jinchao Xu

We propose a sparse reconstruction framework for solving inverse problems. Opposed to existing sparse regularization techniques that are based on frame representations, we train an encoder-decoder network by including an $\ell^1$-penalty.…

Numerical Analysis · Mathematics 2019-08-07 Daniel Obmann , Johannes Schwab , Markus Haltmeier

We study the application of Tikhonov regularization to ill-posed nonlinear operator equations. The objective of this work is to prove low order convergence rates for the discrepancy principle under low order source conditions of logarithmic…

Numerical Analysis · Mathematics 2023-05-02 Chantal Klinkhammer , Robert Plato

Deep learning based reconstruction methods deliver outstanding results for solving inverse problems and are therefore becoming increasingly important. A recently invented class of learning-based reconstruction methods is the so-called NETT…

Numerical Analysis · Mathematics 2021-11-16 Stephan Antholzer , Markus Haltmeier

We study the choice of the regularisation parameter for linear ill-posed problems in the presence of noise that is possibly unbounded but only finite in a weaker norm, and when the noise-level is unknown. For this task, we analyse several…

Numerical Analysis · Mathematics 2021-04-14 Stefan Kindermann , Kemal Raik

We consider the strongly convergent modified versions of the Krasnosel'ski\u{\i}-Mann, the forward-backward and the Douglas-Rachford algorithms with Tikhonov regularization terms, introduced by Radu Bo\c{t}, Ern\"{o} Csetnek and Dennis…

Functional Analysis · Mathematics 2021-01-05 Bruno Dinis , Pedro Pinto

In a real Hilbert space $\mathcal{H}$. Given any function $f$ convex differentiable whose solution set $\argmin_{\mathcal{H}}\,f$ is nonempty, by considering the Proximal Algorithm $x_{k+1}=\text{prox}_{\b_k f}(d x_k)$, where $0<d<1$ and…

Optimization and Control · Mathematics 2023-09-26 A. C. Bagy , Z. Chbani , H. Riahi

In this paper, we analyze the number of neurons and training parameters that a neural networks needs to approximate multivariate functions of bounded second mixed derivatives -- Korobov functions. We prove upper bounds on these quantities…

Machine Learning · Computer Science 2021-01-12 Moise Blanchard , M. Amine Bennouna