English
Related papers

Related papers: Revisiting general source condition in learning ov…

200 papers

In recent years, a series of convergence rates conditions for regularization methods has been developed. Mainly, the motivations for developing novel conditions came from the desire to carry over convergence rates results from the Hilbert…

Functional Analysis · Mathematics 2014-09-29 Roman Andreev , Peter Elbau , Maarten V. de Hoop , Lingyun Qiu , Otmar Scherzer

We consider the learning algorithms under general source condition with the polynomial decay of the eigenvalues of the integral operator in vector-valued function setting. We discuss the upper convergence rates of Tikhonov regularizer under…

Machine Learning · Statistics 2017-03-29 Abhishake Rastogi , Sivananthan Sampath

In this article, we study the convergence behavior of the regularization-based algorithm for solving the polynomial regression model when both input data and responses are from infinite-dimensional Hilbert spaces. We derive convergence…

Statistics Theory · Mathematics 2025-12-02 Naveen Gupta , Sivananthan Sampath

Functional linear regression is one of the fundamental and well-studied methods in functional data analysis. In this work, we investigate the functional linear regression model within the context of reproducing kernel Hilbert space by…

Statistics Theory · Mathematics 2024-12-12 Naveen Gupta , S. Sivananthan , Bharath K. Sriperumbudur

We generalize the notion of average Lipschitz smoothness proposed by Ashlagi et al. (COLT 2021) by extending it to H\"older smoothness. This measure of the "effective smoothness" of a function is sensitive to the underlying distribution and…

Machine Learning · Computer Science 2023-10-31 Steve Hanneke , Aryeh Kontorovich , Guy Kornowski

In binary classification and regression problems, it is well understood that Lipschitz continuity and smoothness of the loss function play key roles in governing generalization error bounds for empirical risk minimization algorithms. In…

Machine Learning · Computer Science 2016-09-14 Ambuj Tewari , Sougata Chaudhuri

In this paper, we prove optimal convergence rates results for regularisation methods for solving linear ill-posed operator equations in Hilbert spaces. The result generalises existing convergence rates results on optimality to general…

Functional Analysis · Mathematics 2015-11-11 Vinicius Albani , Peter Elbau , Maarten V. de Hoop , Otmar Scherzer

We study the linear ill-posed inverse problem with noisy data in the statistical learning setting. Approximate reconstructions from random noisy data are sought with general regularization schemes in Hilbert scale. We discuss the rates of…

Statistics Theory · Mathematics 2024-04-09 Abhishake Rastogi , Peter Mathé

We initiate a program of average smoothness analysis for efficiently learning real-valued functions on metric spaces. Rather than using the Lipschitz constant as the regularizer, we define a local slope at each point and gauge the function…

Statistics Theory · Mathematics 2020-11-10 Yair Ashlagi , Lee-Ad Gottlieb , Aryeh Kontorovich

This paper addresses Tikhonov like regularization methods with convex penalty functionals for solving nonlinear ill-posed operator equations formulated in Banach or, more general, topological spaces. We present an approach for proving…

Numerical Analysis · Mathematics 2009-06-19 Jens Geissler , Bernd Hofmann

We study the regularity of the score function in score-based generative models and show that it naturally adapts to the smoothness of the data distribution. Under minimal assumptions, we establish Lipschitz estimates that directly support…

Statistics Theory · Mathematics 2025-06-25 Arthur Stéphanovitch

This paper studies a Nystr\"om type subsampling approach to large kernel learning methods in the misspecified case, where the target function is not assumed to belong to the reproducing kernel Hilbert space generated by the underlying…

Machine Learning · Statistics 2018-06-05 Shuai Lu , Peter Mathé , Sergiy Pereverzyev

For the Tikhonov regularization of ill-posed nonlinear operator equations, convergence is studied in a Hilbert scale setting. We include the case of oversmoothing penalty terms, which means that the exact solution does not belong to the…

Numerical Analysis · Mathematics 2020-02-03 Bernd Hofmann , Robert Plato

We develop a minimax theory for operator learning, where the goal is to estimate an unknown operator between separable Hilbert spaces from finitely many noisy input-output samples. For uniformly bounded Lipschitz operators, we prove…

Statistics Theory · Mathematics 2026-03-06 Ben Adcock , Gregor Maier , Rahul Parhi

Variational source conditions proved useful for deriving convergence rates for Tikhonov's regularization method and also for other methods. Up to now such conditions have been verified only for few examples or for situations which can be…

Numerical Analysis · Mathematics 2017-09-19 Jens Flemming

In this paper, we deal with nonlinear ill-posed problems involving monotone operators and consider Lavrentiev's regularization method. This approach, in contrast to Tikhonov's regularization method, does not make use of the adjoint of the…

Numerical Analysis · Mathematics 2016-04-20 Bernd Hofmann , Barbara Kaltenbacher , Elena Resmerita

The (global) Lipschitz smoothness condition is crucial in establishing the convergence theory for most optimization methods. Unfortunately, most machine learning and signal processing problems are not Lipschitz smooth. This motivates us to…

Optimization and Control · Mathematics 2019-04-23 Qiuwei Li , Zhihui Zhu , Gongguo Tang , Michael B. Wakin

We study the problem of regression with interval targets, where only upper and lower bounds on target values are available in the form of intervals. This problem arises when the exact target label is expensive or impossible to obtain, due…

Machine Learning · Computer Science 2025-10-27 Rattana Pukdee , Ziqi Ke , Chirag Gupta

In this paper we consider convex Tikhonov regularisation for the solution of linear operator equations on Hilbert spaces. We show that standard fractional source conditions can be employed in order to derive convergence rates in terms of…

Optimization and Control · Mathematics 2020-02-24 Markus Grasmair

In this paper, we establish a comprehensive characterization of the generalized Lipschitz classes through the study of the rate of convergence of a family of semi-discrete sampling operators, of Durrmeyer type, in $L^p$-setting. To achieve…

Functional Analysis · Mathematics 2025-11-14 Danilo Costarelli , Michele Piconi , Gianluca Vinti
‹ Prev 1 2 3 10 Next ›