English
Related papers

Related papers: Generalization Error Estimates of Machine Learning…

200 papers

In this paper, we develop a general approach for probabilistic estimation and optimization. An explicit formula and a computational approach are established for controlling the reliability of probabilistic estimation based on a mixed…

Statistics Theory · Mathematics 2012-12-06 Xinjia Chen

Cut-generating linear programs (CGLPs) play a key role as a separation oracle to produce valid inequalities for the feasible region of mixed-integer programs. When incorporated inside branch-and-bound, the cutting planes obtained from CGLPs…

Optimization and Control · Mathematics 2023-11-01 Atefeh Rajabalizadeh , Danial Davarnia

The aim of this work is to provide an upper bound on the eigenvalues counting function $N(\mathbb{R}^n,-\Delta+V,e)$ of a Sch\"odinger operator $-\Delta +V$ on $\mathbb{R}^n$ corresponding to a potential $V\in…

Mathematical Physics · Physics 2019-10-18 Fabio E. G. Cipriani

We consider the Schr\"odinger equation on a half space in any dimension with a class of nonhomogeneous boundary conditions including Dirichlet, Neuman and the so-called transparent boundary conditions. Building upon recent local in time…

Analysis of PDEs · Mathematics 2017-02-23 Corentin Audiard

We consider an initial/boundary value problem for one-dimensional fractional-order parabolic equations with a space fractional derivative of Riemann-Liouville type and order $\alpha\in (1,2)$. We study a spatial semidiscrete scheme with the…

Numerical Analysis · Mathematics 2013-10-02 Bangti Jin , Raytcho Lazarov , Joseph Pasciak , Zhi Zhou

The Maximum Mean Discrepancy (MMD) has found numerous applications in statistics and machine learning, most recently as a penalty in the Wasserstein Auto-Encoder (WAE). In this paper we compute closed-form expressions for estimating the…

Machine Learning · Statistics 2020-06-03 Raif M. Rustamov

We study expected generalization bounds for the Hierarchical Federated Learning (HFL) setup using Wasserstein distance. We introduce a generalized framework in which data is sampled hierarchically, and we model it with a multi-layered tree…

Machine Learning · Computer Science 2026-05-06 Dario Filatrella , Ragnar Thobaben , Mikael Skoglund

We propose and mathematically analyze a new Shifted Boundary Method for the treatment of Dirichlet and Neumann boundary conditions, with provable optimal accuracy in the $L^2$- and $H^1$-norms of the error. The proposed method is built on…

Numerical Analysis · Mathematics 2025-08-14 J. Haydel Collins , Kangan Li , Alexei Lozinski , Guglielmo Scovazzi

Many problems in statistical learning, imaging, and computer vision involve the optimization of a non-convex objective function with singularities at the boundary of the feasible set. For such challenging instances, we develop a new…

Optimization and Control · Mathematics 2019-11-07 Pavel Dvurechensky , Mathias Staudigl , César A. Uribe

Understanding the generalization of deep neural networks is one of the most important tasks in deep learning. Although much progress has been made, theoretical error bounds still often behave disparately from empirical observations. In this…

Machine Learning · Computer Science 2021-11-09 Ching-Yao Chuang , Youssef Mroueh , Kristjan Greenewald , Antonio Torralba , Stefanie Jegelka

To facilitate the numerical analysis of particle methods, we derive truncation error estimates for the approximate operators in a generalized particle method. Here, a generalized particle method is defined as a meshfree numerical method…

Numerical Analysis · Mathematics 2019-07-09 Yusuke Imoto

We analyze the Schr\"odingerization method for quantum simulation of a general class of non-unitary dynamics with inhomogeneous source terms. The Schr\"odingerization technique, introduced in [31], transforms any linear ordinary and partial…

Numerical Analysis · Mathematics 2025-04-15 Shi Jin , Nana Liu , Chuwen Ma

How to train deep neural networks (DNNs) to generalize well is a central concern in deep learning, especially for severely overparameterized networks nowadays. In this paper, we propose an effective method to improve the model…

Machine Learning · Computer Science 2022-06-28 Yang Zhao , Hao Zhang , Xiuyuan Hu

We propose a hybrid reinforcement and self-supervised learning framework for accelerating generalized Benders decomposition (GBD). In this framework, a graph based reinforcement learning agent operates on a bipartite representation of the…

Systems and Control · Electrical Eng. & Systems 2026-04-27 Bernard T. Agyeman , Zhe Li , Ilias Mitrai , Prodromos Daoutidis

Deep Ritz methods (DRM) have been proven numerically to be efficient in solving partial differential equations. In this paper, we present a convergence rate in $H^{1}$ norm for deep Ritz methods for Laplace equations with Dirichlet boundary…

Numerical Analysis · Mathematics 2021-11-04 Chenguang Duan , Yuling Jiao , Yanming Lai , Xiliang Lu , Qimeng Quan , Jerry Zhijian Yang

In this paper, the method of gaps, a technique for deriving closed-form expressions in terms of information measures for the generalization error of supervised machine learning algorithms is introduced. The method relies on the notion of…

Machine Learning · Computer Science 2026-01-01 Samir M. Perlaza , Xinying Zou

Accurate numerical solutions for the Schr\"odinger equation are of utmost importance in quantum chemistry. However, the computational cost of current high-accuracy methods scales poorly with the number of interacting particles. Combining…

Computational Physics · Physics 2021-12-21 Michael Scherbela , Rafael Reisenhofer , Leon Gerard , Philipp Marquetand , Philipp Grohs

We study the spectral problems associated with the finite-difference operators $H_N = 2 \cosh(p) + V_N(x)$, where $V_N(x)$ is an arbitrary polynomial potential of degree $N$. These systems can be regarded as a solvable deformation of the…

High Energy Physics - Theory · Physics 2025-11-14 Matijn François , Alba Grassi , Tommaso Pedroni

This paper presents regularity results and associated high-order numerical methods for one-dimensional Fractional-Laplacian boundary-value problems. On the basis of a factorization of solutions as a product of a certain edge-singular weight…

Numerical Analysis · Mathematics 2017-05-09 Gabriel Acosta , Juan Pablo Borthagaray , Oscar Bruno , Martín Maas

This paper is concerned with a novel regularisation technique for solving linear ill-posed operator equations in Hilbert spaces from data that is corrupted by white noise. We combine convex penalty functionals with extreme-value statistics…

Statistics Theory · Mathematics 2012-04-03 Klaus Frick , Philipp Marnitz , Axel Munk