English
Related papers

Related papers: On the connection between supervised learning and …

200 papers

We consider solving a probably infinite dimensional operator equation, where the operator is not modeled by physical laws but is specified indirectly via training pairs of the input-output relation of the operator. Neural operators have…

Numerical Analysis · Mathematics 2026-05-06 Otmar Scherzer , Thi Lan Nhi Vu , Jikai Yan

Recovering a function or high-dimensional parameter vector from indirect measurements is a central task in various scientific areas. Several methods for solving such inverse problems are well developed and well understood. Recently, novel…

Numerical Analysis · Mathematics 2019-12-10 Housen Li , Johannes Schwab , Stephan Antholzer , Markus Haltmeier

We study statistical inverse learning in the context of nonlinear inverse problems under random design. Specifically, we address a class of nonlinear problems by employing gradient descent (GD) and stochastic gradient descent (SGD) with…

Machine Learning · Statistics 2024-12-24 Abhishake , Nicole Mücke , Tapio Helin

Learning in the reproducing kernel Hilbert space (RKHS) such as the support vector machine has been recognized as a promising technique. It continues to be highly effective and competitive in numerous prediction tasks, particularly in…

Machine Learning · Computer Science 2025-01-15 Gakuto Obi , Ayato Saito , Yuto Sasaki , Tsuyoshi Kato

This work studies discrete-time discounted Markov decision processes with continuous state and action spaces and addresses the inverse problem of inferring a cost function from observed optimal behavior. We first consider the case in which…

Optimization and Control · Mathematics 2024-05-27 Angeliki Kamoutsi , Peter Schmitt-Förster , Tobias Sutter , Volkan Cevher , John Lygeros

We consider a statistical inverse learning problem, where the task is to estimate a function $f$ based on noisy point evaluations of $Af$, where $A$ is a linear operator. The function $Af$ is evaluated at i.i.d. random design points $u_n$,…

Machine Learning · Statistics 2021-11-02 Tatiana A. Bubba , Martin Burger , Tapio Helin , Luca Ratti

Nonlocal operators with integral kernels have become a popular tool for designing solution maps between function spaces, due to their efficiency in representing long-range dependence and the attractive feature of being resolution-invariant.…

Machine Learning · Statistics 2022-05-24 Fei Lu , Qingci An , Yue Yu

In this chapter we provide a theoretically founded investigation of state-of-the-art learning approaches for inverse problems from the point of view of spectral reconstruction operators. We give an extended definition of regularization…

Numerical Analysis · Mathematics 2024-06-05 Martin Burger , Samira Kabri

We propose a new point of view for regularizing deep neural networks by using the norm of a reproducing kernel Hilbert space (RKHS). Even though this norm cannot be computed, it admits upper and lower approximations leading to various…

Machine Learning · Statistics 2019-05-15 Alberto Bietti , Grégoire Mialon , Dexiong Chen , Julien Mairal

Conditional stability estimates require additional regularization for obtaining stable approximate solutions if the validity area of such estimates is not completely known. In this context, we consider ill-posed nonlinear inverse problems…

Numerical Analysis · Mathematics 2020-01-29 Frank Werner , Bernd Hofmann

In this paper we consider the computation of approximate solutions for inverse problems in Hilbert spaces. In order to capture the special feature of solutions, non-smooth convex functions are introduced as penalty terms. By exploiting the…

Numerical Analysis · Mathematics 2015-06-18 Qinian Jin , Xiliang Lu

Algebraic convergences rates of (iterated) Tikhonov regularization for linear inverse problems in Hilbert spaces are characterized by the membership of the exact solution to intermediate spaces produced by the K-method of real…

Numerical Analysis · Mathematics 2015-09-30 Roman Andreev

We investigate a Tikhonov regularization scheme specifically tailored for shallow neural networks within the context of solving a classic inverse problem: approximating an unknown function and its derivatives within a unit cubic domain…

Numerical Analysis · Mathematics 2024-12-17 Yuanyuan Li , Shuai Lu

In this paper, we investigate iterative methods that are based on sampling of the data for computing Tikhonov-regularized solutions. We focus on very large inverse problems where access to the entire data set is not possible all at once…

Numerical Analysis · Mathematics 2018-12-18 J. Tanner Slagel , Julianne Chung , Matthias Chung , David Kozak , Luis Tenorio

In supervised learning using kernel methods, we often encounter a large-scale finite-sum minimization over a reproducing kernel Hilbert space (RKHS). Large-scale finite-sum problems can be solved using efficient variants of Newton method,…

Machine Learning · Computer Science 2022-06-07 Ting-Jui Chang , Shahin Shahrampour

Regularization techniques for the numerical solution of inverse scattering problems in two space dimensions are discussed. Assuming that the boundary of a scatterer is its most prominent feature, we exploit as model the class of…

Functional Analysis · Mathematics 2016-05-05 Gitta Kutyniok , Volker Mehrmann , Philipp Petersen

We propose a method for the approximation of high- or even infinite-dimensional feature vectors, which play an important role in supervised learning. The goal is to reduce the size of the training data, resulting in lower storage…

Machine Learning · Statistics 2021-04-06 Patrick Gelß , Stefan Klus , Ingmar Schuster , Christof Schütte

In this article we dwell into the class of so called ill posed Linear Inverse Problems (LIP) in machine learning, which has become almost a classic in recent times. The fundamental task in an LIP is to recover the entire signal / data from…

Machine Learning · Computer Science 2020-01-10 Mohammed Rayyan Sheriff , Debasish Chatterjee

This paper studies convergence rates for some value function approximations that arise in a collection of reproducing kernel Hilbert spaces (RKHS) $H(\Omega)$. By casting an optimal control problem in a specific class of native spaces,…

Systems and Control · Electrical Eng. & Systems 2023-11-20 Ali Bouland , Shengyuan Niu , Sai Tej Paruchuri , Andrew Kurdila , John Burns , Eugenio Schuster

This paper studies the learning of linear operators between infinite-dimensional Hilbert spaces. The training data comprises pairs of random input vectors in a Hilbert space and their noisy images under an unknown self-adjoint linear…

Statistics Theory · Mathematics 2023-05-12 Maarten V. de Hoop , Nikola B. Kovachki , Nicholas H. Nelsen , Andrew M. Stuart