English
Related papers

Related papers: Revisiting general source condition in learning ov…

200 papers

To solve convex optimization problems with a noisy gradient input, we analyze the global behavior of subgradient-like flows under stochastic errors. The objective function is composite, being equal to the sum of two convex functions, one…

Optimization and Control · Mathematics 2025-06-05 Rodrigo Maulen-Soto , Jalal Fadili , Hedy Attouch

We study estimation and prediction in linear models where the response and the regressor variable both take values in some Hilbert space. Our main objective is to obtain consistency of a principal components based estimator for the…

Statistics Theory · Mathematics 2014-04-17 Siegfried Hörmann , Łukasz Kidziński

This paper is concerned with inverse source problems for the acoustic wave equation in the full space R^3, where the source term is compactly supported in both time and spatial variables. The main goal is to investigate increasing stability…

Analysis of PDEs · Mathematics 2024-03-14 Chun Liu , Suliang Si , Guanghui Hu , Bo Zhang

We study the problem of estimating the average of a Lipschitz continuous function $f$ defined over a metric space, by querying $f$ at only a single point. More specifically, we explore the role of randomness in drawing this sample. Our goal…

Data Structures and Algorithms · Computer Science 2011-01-21 Abhimanyu Das , David Kempe

Decentralized optimization has become a fundamental tool for large-scale learning systems; however, most existing methods rely on the classical Lipschitz smoothness assumption, which is often violated in problems with rapidly varying…

Optimization and Control · Mathematics 2026-01-08 Yanan Bo , Yongqiang Wang

We give an improved theoretical analysis of score-based generative modeling. Under a score estimate with small $L^2$ error (averaged across timesteps), we provide efficient convergence guarantees for any data distribution with second-order…

Machine Learning · Computer Science 2023-02-03 Hongrui Chen , Holden Lee , Jianfeng Lu

A general deterministic analysis to state the necessary conditions with a coefficient determination for the variational source condition to hold is provided. Of particular interest in terms of the choice of the regularization parameter, it…

Numerical Analysis · Mathematics 2016-07-19 Erdem Altuntac

Learning an appropriate (dis)similarity function from the available data is a central problem in machine learning, since the success of many machine learning algorithms critically depends on the choice of a similarity function to compare…

Machine Learning · Computer Science 2013-08-30 Zheng-Chu Guo , Yiming Ying

We introduce an alternative to the notion of `fast rate' in Learning Theory, which coincides with the optimal error rate when the given class happens to be convex and regular in some sense. While it is well known that such a rate cannot…

Statistics Theory · Mathematics 2015-02-26 Shahar Mendelson

We describe a general strategy for the verification of variational source condition by formulating two sufficient criteria describing the smoothness of the solution and the degree of ill-posedness of the forward operator in terms of a…

Numerical Analysis · Mathematics 2017-03-28 Thorsten Hohage , Frederic Weidling

To minimize or upper-bound the value of a function "robustly", we might instead minimize or upper-bound the "epsilon-robust regularization", defined as the map from a point to the maximum value of the function within an epsilon-radius. This…

Optimization and Control · Mathematics 2010-06-10 Adrian S. Lewis , C. H. Jeffrey Pang

It is becoming increasingly important to understand the vulnerability of machine learning models to adversarial attacks. One of the fundamental problems in adversarial machine learning is to quantify how much training data is needed in the…

Machine Learning · Computer Science 2023-08-24 Pascale Gourdeau

The convergence rates results in $\ell^1$-regularization when the sparsity assumption is narrowly missed, presented by Burger et al. (2013 Inverse Problems 29 025013), are based on a crucial condition which requires that all basis elements…

Numerical Analysis · Mathematics 2015-08-05 Stephan W. Anzengruber , Bernd Hofmann , Ronny Ramlau

We study the optimal rates of convergence for estimating a prior distribution over a VC class from a sequence of independent data sets respectively labeled by independent target functions sampled from the prior. We specifically derive upper…

Machine Learning · Computer Science 2015-05-21 Liu Yang , Steve Hanneke , Jaime Carbonell

In this paper we build the relationship between smoothness of the functions and convergence rate along curves for a class of generalized Schr\"{o}dinger operators with polynomial growth. We show that the convergence rate depends only on the…

Classical Analysis and ODEs · Mathematics 2021-08-31 Wenjuan Li , Huiju Wang

We provide full theoretical guarantees for the convergence behaviour of diffusion-based generative models under the assumption of strongly log-concave data distributions while our approximating class of functions used for score estimation…

Machine Learning · Computer Science 2025-02-18 Stefano Bruno , Ying Zhang , Dong-Young Lim , Ömer Deniz Akyildiz , Sotirios Sabanis

We study a natural extension of classical empirical risk minimization, where the hypothesis space is a random subspace of a given space. In particular, we consider possibly data dependent subspaces spanned by a random subset of the data,…

Machine Learning · Statistics 2022-12-09 Andrea Della Vecchia , Ernesto De Vito , Lorenzo Rosasco

We study the problem of smooth imitation learning for online sequence prediction, where the goal is to train a policy that can smoothly imitate demonstrated behavior in a dynamic and continuous environment in response to online, sequential…

Machine Learning · Computer Science 2016-06-06 Hoang M. Le , Andrew Kang , Yisong Yue , Peter Carr

We consider the problem of learning a linear operator $\theta$ between two Hilbert spaces from empirical observations, which we interpret as least squares regression in infinite dimensions. We show that this goal can be reformulated as an…

Statistics Theory · Mathematics 2024-07-11 Mattes Mollenhauer , Nicole Mücke , T. J. Sullivan

We address the problem of general supervised learning when data can only be accessed through an (indefinite) similarity function between data points. Existing work on learning with indefinite kernels has concentrated solely on…

Machine Learning · Computer Science 2012-10-23 Purushottam Kar , Prateek Jain