English
Related papers

Related papers: On the connection between supervised learning and …

200 papers

Inverse problems arise anywhere we have indirect measurement. As, in general they are ill-posed, to obtain satisfactory solutions for them needs prior knowledge. Classically, different regularization methods and Bayesian inference based…

Machine Learning · Statistics 2023-08-31 Ali Mohammad-Djafari , Ning Chu , Li Wang , Liang Yu

This study compares various superlearner and deep learning architectures (machine-learning-based and neural-network-based) for classification problems across several simulated and industrial datasets to assess performance and computational…

Machine Learning · Statistics 2017-08-23 Colleen M. Farrelly

Many problems in machine learning can be formulated as optimizing a convex functional over a vector space of measures. This paper studies the convergence of the mirror descent algorithm in this infinite-dimensional setting. Defining Bregman…

Optimization and Control · Mathematics 2022-10-12 Pierre-Cyril Aubin-Frankowski , Anna Korba , Flavien Léger

We present an extension of the linear sampling method for solving the sound-soft inverse acoustic scattering problem with randomly distributed point sources. The theoretical justification of our sampling method is based on the…

Numerical Analysis · Mathematics 2023-03-21 Josselin Garnier , Houssem Haddar , Hadrien Montanelli

We present a novel deep learning approach to approximate the solution of large, sparse, symmetric, positive-definite linear systems of equations. These systems arise from many problems in applied science, e.g., in numerical methods for…

Machine Learning · Computer Science 2022-10-04 Ayano Kaneda , Osman Akar , Jingyu Chen , Victoria Kala , David Hyde , Joseph Teran

Approximation of high dimensional functions is in the focus of machine learning and data-based scientific computing. In many applications, empirical risk minimisation techniques over nonlinear model classes are employed. Neural networks,…

Numerical Analysis · Mathematics 2024-02-05 Mathias Oster , Luca Saluzzi , Tizian Wenzel

In this paper we introduce the class of infinite infimal convolution functionals and apply these functionals to the regularization of ill-posed inverse problems. The proposed regularization involves an infimal convolution of a continuously…

Optimization and Control · Mathematics 2024-12-17 Kristian Bredies , Marcello Carioni , Martin Holler , Yury Korolev , Carola-Bibiane Schönlieb

We develop novel learning rates for conditional mean embeddings by applying the theory of interpolation for reproducing kernel Hilbert spaces (RKHS). We derive explicit, adaptive convergence rates for the sample estimator under the…

Machine Learning · Statistics 2026-04-09 Prem Talwai , Ali Shameli , David Simchi-Levi

The Inverse Problem for the estimation of a point-wise approximation error occurring at the discretization and solving of the system of partial differential equations is addressed. The set of the differences between the numerical solutions…

Numerical Analysis · Mathematics 2021-01-05 Aleksey Alekseev , Alexander Bondarev

We investigate Tikhonov regularization methods for nonlinear ill-posed problems in Banach spaces, where the penalty term is described by Bregman distances. We prove convergence and stability results. Moreover, using appropriate source…

Numerical Analysis · Mathematics 2020-12-22 I. R. Bleyer , A. Leitao

Inverse optimal control, also known as inverse reinforcement learning, is the problem of recovering an unknown reward function in a Markov decision process from expert demonstrations of the optimal policy. We introduce a probabilistic…

Machine Learning · Computer Science 2012-06-22 Sergey Levine , Vladlen Koltun

To solve convex optimization problems with a noisy gradient input, we analyze the global behavior of subgradient-like flows under stochastic errors. The objective function is composite, being equal to the sum of two convex functions, one…

Optimization and Control · Mathematics 2025-06-05 Rodrigo Maulen-Soto , Jalal Fadili , Hedy Attouch

In this article we investigate the connection between regularization theory for inverse problems and dynamic programming theory. This is done by developing two new regularization methods, based on dynamic programming techniques. The aim of…

Numerical Analysis · Mathematics 2021-01-26 S. Kindermann , A. Leitao

In a general context of positive definite kernels $k$, we develop tools and algorithms for sampling in reproducing kernel Hilbert space $\mathscr{H}$ (RKHS). With reference to these RKHSs, our results allow inference from samples; more…

Functional Analysis · Mathematics 2016-01-28 Palle Jorgensen , Feng Tian

We investigate the convergence theory of several known as well as new heuristic parameter choice rules for convex Tikhonov regularisation. The success of such methods is dependent on whether certain restrictions on the noise are satisfied.…

Numerical Analysis · Mathematics 2021-04-14 Stefan Kindermann , Kemal Raik

This book deals with functions allowing to express the dissimilarity (discrepancy) between two data fields or ''divergence functions'' with the aim of applications to linear inverse problems. Most of the divergences found in the litterature…

Optimization and Control · Mathematics 2020-03-04 Henri Lantéri

In this work, we consider the problem of learning nonlinear operators that correspond to discrete-time nonlinear dynamical systems with inputs. Given an initial state and a finite input trajectory, such operators yield a finite output…

Optimization and Control · Mathematics 2024-12-25 Mircea Lazar

We deal with the solution of a generic linear inverse problem in the Hilbert space setting. The exact right hand side is unknown and only accessible through discretised measurements corrupted by white noise with unknown arbitrary…

Numerical Analysis · Mathematics 2023-02-14 Bastian Harrach , Tim Jahn , Roland Potthast

This paper deals with an inertial proximal algorithm that contains a Tikhonov regularization term, in connection to the minimization problem of a convex lower semicontinuous function $f$. We show that for appropriate Tikhonov regularization…

Optimization and Control · Mathematics 2024-01-09 Szilárd Csaba László

This paper proposes a unified framework for the investigation of constrained learning theory in reflexive Banach spaces of features via regularized empirical risk minimization. The focus is placed on Tikhonov-like regularization with…

Statistics Theory · Mathematics 2016-10-20 Patrick L. Combettes , Saverio Salzo , Silvia Villa