English
Related papers

Related papers: Generalization Error Estimates of Machine Learning…

200 papers

Estimating causal effects of continuous treatments is a common problem in practice, for example, in studying average dose-response functions. Classical analyses typically assume that all confounders are fully observed, whereas in real-world…

Statistics Theory · Mathematics 2026-04-14 Shuyuan Chen , Peng Zhang , Yifan Cui

In this article, we present the mathematical analysis of the convergence of the linearized Crank-Nicolson Galerkin method for a nonlinear Schrodinger problem related to a domain with a moving boundary. The convergence analysis of the…

Numerical Analysis · Mathematics 2025-05-01 Daniel G. Alfaro Vigo , Daniele C. R. Gomes , Bruno A. do Carmo , Mauro A. Rincon

We study nonparametric distance-based (isotropic) local polynomial methods for estimating the boundary average treatment effect curve, a causal functional that captures treatment effect heterogeneity in boundary discontinuity designs. We…

Econometrics · Economics 2026-05-26 Matias D. Cattaneo , Rocio Titiunik , Ruiqi Rae Yu

Many machine learning applications deal with high dimensional data. To make computations feasible and learning more efficient, it is often desirable to reduce the dimensionality of the input variables by finding linear combinations of the…

Machine Learning · Computer Science 2025-01-30 Wenjing Yang , Yuhong Yang

In this paper, we improve slightly Erd\'elyi's version of the stationary phase method by replacing the employed smooth cut-off function by a characteristic function, leading to more precise remainder estimates. We exploit this refinement to…

Analysis of PDEs · Mathematics 2014-12-19 F. Ali Mehmeti , F. Dewez

A new symbolic algorithmic implementation of the general scheme of the exponentially convergent functional-discrete (FD-) method is developed and justified for the Sturm-Liouville problem on a finite interval for the Schr\"odinger equation…

Numerical Analysis · Mathematics 2018-06-26 Volodymyr Makarov , Nataliia Romaniuk

A problem of bounding the generalization error of a classifier f in H, where H is a "base" class of functions (classifiers), is considered. This problem frequently occurs in computer learning, where efficient algorithms of combining simple…

Probability · Mathematics 2007-06-13 Vladimir Koltchinskii , Dmitry Panchenko , Fernando Lozano

We develop a general framework for estimating function-valued parameters under equality or inequality constraints in infinite-dimensional statistical models. Such constrained learning problems are common across many areas of statistics and…

Machine Learning · Statistics 2025-07-22 Razieh Nabi , Nima S. Hejazi , Mark J. van der Laan , David Benkeser

We propose a novel framework for exploring weak and $L_2$ generalization errors of algorithms through the lens of differential calculus on the space of probability measures. Specifically, we consider the KL-regularized empirical risk…

Machine Learning · Statistics 2023-06-21 Gholamali Aminian , Samuel N. Cohen , Łukasz Szpruch

We consider the problem of calculating learning curves (i.e., average generalization performance) of Gaussian processes used for regression. On the basis of a simple expression for the generalization error, in terms of the eigenvalue…

Disordered Systems and Neural Networks · Physics 2007-05-23 Peter Sollich , Anason Halees

Regularization techniques for the numerical solution of inverse scattering problems in two space dimensions are discussed. Assuming that the boundary of a scatterer is its most prominent feature, we exploit as model the class of…

Functional Analysis · Mathematics 2016-05-05 Gitta Kutyniok , Volker Mehrmann , Philipp Petersen

A concrete formulation of the Lehmann-Maehly-Goerisch method for semi-definite self-adjoint operators with compact resolvent is considered. Precise rates of convergence are determined in terms of how well the trial spaces capture the…

Spectral Theory · Mathematics 2014-08-12 L. Boulton , A. Hobiny

Learning the principal eigenfunctions of an integral operator defined by a kernel and a data distribution is at the core of many machine learning problems. Traditional nonparametric solutions based on the Nystr{\"o}m formula suffer from…

Machine Learning · Computer Science 2022-10-25 Zhijie Deng , Jiaxin Shi , Jun Zhu

Projection-free optimization via different variants of the Frank-Wolfe (FW) method has become one of the cornerstones in large scale optimization for machine learning and computational statistics. Numerous applications within these fields…

Optimization and Control · Mathematics 2021-08-03 Pavel Dvurechensky , Kamil Safin , Shimrit Shtern , Mathias Staudigl

Quantum computers are known for their potential to achieve up-to-exponential speedup compared to classical computers for certain problems. To exploit the advantages of quantum computers, we propose quantum algorithms for linear stochastic…

Quantum Physics · Physics 2025-06-26 Shi Jin , Nana Liu , Wei Wei

Generalized Schr\"odinger Bridges (GSBs) are a fundamental mathematical framework used to analyze the most likely particle evolution based on the principle of least action including kinetic and potential energy. In parallel to their…

Machine Learning · Statistics 2024-12-31 Guan-Horng Liu , Tianrong Chen , Evangelos A. Theodorou

We propose an explicit, oracle-free quantum framework for numerically simulating general linear partial differential equations (PDEs), extending previous work to incorporate (a) Robin boundary conditions - which include Neumann and…

Quantum Physics · Physics 2026-05-27 Nikita Guseynov , Xiajie Huang , Nana Liu

We establish guaranteed and practically computable a posteriori error bounds for source problems and eigenvalue problems involving linear Schr{\"o}dinger operators with atom-centered potentials discretized with linear combinations of atomic…

Numerical Analysis · Mathematics 2025-09-03 Geneviève Dusson , Mi-Song Dupuy , Ioanna-Maria Lygatsika

The generalized eigenvalue (GE) problems are of particular importance in various areas of science engineering and machine learning. We present a variational quantum algorithm for finding the desired generalized eigenvalue of the GE problem,…

Quantum Physics · Physics 2022-03-08 Jin-Min Liang , Shu-Qian Shen , Ming Li , Shao-Ming Fei

An information-theoretic upper bound on the generalization error of supervised learning algorithms is derived. The bound is constructed in terms of the mutual information between each individual training sample and the output of the…

Machine Learning · Computer Science 2020-08-06 Yuheng Bu , Shaofeng Zou , Venugopal V. Veeravalli