English
Related papers

Related papers: Bounds for the sampling discretization error and t…

200 papers

Our main focus is on the generalization bound, which serves as an upper limit for the generalization error. Our analysis delves into regression and classification tasks separately to ensure a thorough examination. We assume the target…

Machine Learning · Statistics 2024-07-30 Wen-Liang Hwang

Traditional measures of smoothness often fail to provide accurate $L_p$-error estimates for approximation by sampling or interpolation operators, especially for functions with low smoothness. To address this issue, we introduce a modified…

Numerical Analysis · Mathematics 2025-07-02 Yurii Kolomoitsev

This paper derives new bounds on the difference of the entropies of two discrete random variables in terms of the local and total variation distances between their probability mass functions. The derivation of the bounds relies on maximal…

Information Theory · Computer Science 2016-11-17 Igal Sason

We obtain a tight distribution-specific characterization of the sample complexity of large-margin classification with L2 regularization: We introduce the margin-adapted dimension, which is a simple function of the second order statistics of…

Machine Learning · Statistics 2013-09-19 Sivan Sabato , Nathan Srebro , Naftali Tishby

Building upon the recent work of Teso and Plociniczak (2025) regarding L1 discretization errors for the Caputo derivative in H\"{o}lder spaces, this study extends the analysis to higher-order discretization errors within the same functional…

Numerical Analysis · Mathematics 2025-04-11 Xiangyi Peng , Lisen Ding , Dongling Wang

Uniform deviation bounds limit the difference between a model's expected loss and its loss on an empirical sample uniformly for all models in a learning problem. As such, they are a critical component to empirical risk minimization. In this…

Machine Learning · Statistics 2017-02-28 Olivier Bachem , Mario Lucic , S. Hamed Hassani , Andreas Krause

We study the stochastic $p$-Laplace system in a bounded domain. We propose two new space-time discretizations based on the approximation of time-averaged values. We establish linear convergence in space and $1/2$ convergence in time.…

Numerical Analysis · Mathematics 2023-05-19 Lars Diening , Martina Hofmanová , Jörn Wichmann

Classification margins are commonly used to estimate the generalization ability of machine learning models. We present an empirical study of these margins in artificial neural networks. A global estimate of margin size is usually used in…

Machine Learning · Computer Science 2023-02-15 Marthinus W. Theunissen , Coenraad Mouton , Marelie H. Davel

Upper bounds for the $L_p$-discrepancies of point distributions in compact metric measure spaces for $0<p\le\infty$ have been established in the paper [6] by Brandolini, Chen, Colzani, Gigante and Travaglini. In the present paper we show…

Metric Geometry · Mathematics 2018-05-01 M. M. Skriganov

This paper is concerned with the problem of sampling and interpolation involving derivatives in shift-invariant spaces and the error analysis of the derivative sampling expansions for fundamentally large classes of functions. A new type of…

Functional Analysis · Mathematics 2024-02-15 Kumari Priyanka , A. Antony Selvan

We study a Q learning algorithm for continuous time stochastic control problems. The proposed algorithm uses the sampled state process by discretizing the state and control action spaces under piece-wise constant control processes. We show…

Optimization and Control · Mathematics 2023-03-10 Erhan Bayraktar , Ali Devran Kara

Confidence measures for the generalization error are crucial when small training samples are used to construct classifiers. A common approach is to estimate the generalization error by resampling and then assume the resampled estimator…

Machine Learning · Computer Science 2012-06-18 Eric B. Laber , Susan A. Murphy

We establish uniform error bounds of the L1 discretization of the Caputo fractional derivative of the function from the weighted Sobolev space with weight belonging to the Mucknenhoupt class. We present how our framework works for several…

Numerical Analysis · Mathematics 2026-04-27 Łukasz Płociniczak , Hubert Woszczek

This note establishes a theoretical framework for finding (potentially overparameterized) approximations of a function on a compact set with a-priori bounds for the generalization error. The approximation method considered is to choose,…

Systems and Control · Electrical Eng. & Systems 2026-03-23 Arthur C. B. de Oliveira , Ruigang Wang , Ian R. Manchester , Eduardo D. Sontag

The paper is devoted to discretization of integral norms of functions from a given finite dimensional subspace. We use recent general results on sampling discretization to derive a new Marcinkiewicz type discretization theorem for the…

Numerical Analysis · Mathematics 2020-05-14 Vladimir Temlyakov

In this paper we study the sampling recovery problem for certain relevant multivariate function classes which are not compactly embedded into $L_\infty$. Recent tools relating the sampling numbers to the Kolmogorov widths in the uniform…

Numerical Analysis · Mathematics 2022-10-05 Glenn Byrenheid , Serhii A. Stasyuk , Tino Ullrich

Density ratio estimation (DRE) is a core technique in machine learning used to capture relationships between two probability distributions. $f$-divergence loss functions, which are derived from variational representations of $f$-divergence,…

Machine Learning · Computer Science 2025-03-18 Yoshiaki Kitazawa

The total generalized variation extends the total variation by incorporating higher-order smoothness. Thus, it can also suffer from similar discretization issues related to isotropy. Inspired by the success of novel discretization schemes…

Numerical Analysis · Mathematics 2023-03-17 Lea Bogensperger , Antonin Chambolle , Alexander Effland , Thomas Pock

We establish upper and lower bounds for the metric entropy and bracketing entropy of the class of $d$-dimensional bounded monotonic functions under $L^p$ norms. It is interesting to see that both the metric entropy and bracketing entropy…

Statistics Theory · Mathematics 2007-06-13 Fuchang Gao , Jon A. Wellner

Prediction via deterministic continuous-time models will always be subject to model error, for example due to unexplainable phenomena, uncertainties in any data driving the model, or discretisation/resolution issues. In this paper, we build…

Dynamical Systems · Mathematics 2025-06-30 Liam Blake , John Maclean , Sanjeeva Balasuriya
‹ Prev 1 3 4 5 6 7 10 Next ›