English
Related papers

Related papers: The Behavior of Error Bounds via Moreau Envelopes

200 papers

We prove a new generalization bound that shows for any class of linear predictors in Gaussian space, the Rademacher complexity of the class and the training error under any continuous loss $\ell$ can control the test error under all Moreau…

Machine Learning · Statistics 2022-10-24 Lijia Zhou , Frederic Koehler , Pragya Sur , Danica J. Sutherland , Nathan Srebro

In this paper, some new upper bounds for Kullback-Leibler divergence(KL-divergence) based on $L^1, L^2$ and $L^\infty$ norms of density functions are discussed. Our findings unveil that the convergence in KL-divergence sense sandwiches…

Probability · Mathematics 2024-10-31 Liuquan Yao , Songhao Liu

New bounds on classification error rates for the error-correcting output code (ECOC) approach in machine learning are presented. These bounds have exponential decay complexity with respect to codeword length and theoretically validate the…

Machine Learning · Computer Science 2021-09-21 Hieu D. Nguyen , Mohammed Sarosh Khan , Nicholas Kaegi , Shen-Shyang Ho , Jonathan Moore , Logan Borys , Lucas Lavalva

We obtain a uniform $L^{\infty}(\Omega)$ a priori bound, for any positive weak solutions to elliptic problem with a nonlinearity $f$ slightly subcritical, slightly superlinear, and regularly varying. To achieve our result, we first obtain a…

Analysis of PDEs · Mathematics 2025-06-10 Mabel Cuesta , Rosa Pardo

The purpose of this paper is to characterize all embeddings for versions of Besov and Triebel-Lizorkin spaces where the underlying Lebesgue space metric is replaced by a Lorentz space metric. We include two appendices, one on the relation…

Functional Analysis · Mathematics 2019-06-11 Andreas Seeger , Walter Trebels

In this paper we study local error bound moduli for a locally Lipschitz and regular function via its outer limiting subdifferential set. We show that the distance of 0 from the outer limiting subdifferential of the support function of the…

Optimization and Control · Mathematics 2016-08-12 Minghua Li , Kaiwen Meng , Xiaoqi Yang

Upper Confidence Bound (UCB) is arguably the most commonly used method for linear multi-arm bandit problems. While conceptually and computationally simple, this method highly relies on the confidence bounds, failing to strike the optimal…

Machine Learning · Computer Science 2020-06-05 Kaige Yang , Laura Toni

In statistical classification/multiple hypothesis testing and machine learning, a model distribution estimated from the training data is usually applied to replace the unknown true distribution in the Bayes decision rule, which introduces a…

Information Theory · Computer Science 2024-09-24 Zijian Yang , Vahe Eminyan , Ralf Schlüter , Hermann Ney

Error bounds, which refer to inequalities that bound the distance of vectors in a test set to a given set by a residual function, have proven to be extremely useful in analyzing the convergence rates of a host of iterative methods for…

Optimization and Control · Mathematics 2015-12-14 Zirui Zhou , Anthony Man-Cho So

The existing upper and lower bounds between entropy and error are mostly derived through an inequality means without linking to joint distributions. In fact, from either theoretical or application viewpoint, there exists a need to achieve a…

Information Theory · Computer Science 2013-03-06 Bao-Gang Hu , Hong-Jie Xing

Three kinds of effective error bounds of the quadrature formulas with multiple nodes that are generalizations of the well known Micchelli-Rivlin quadrature formula, when the integrand is a function analytic in the regions bounded by…

Numerical Analysis · Mathematics 2018-02-09 Aleksandar V. Pejcev , Miodrag M. Spalevic

We interpret likelihood-based test functions from a geometric perspective where the Kullback-Leibler (KL) divergence is adopted to quantify the distance from a distribution to another. Such a test function can be seen as a sub-Gaussian…

Information Theory · Computer Science 2021-01-05 Yan Wang

In this paper we consider the problem of uniformity testing with limited memory. We observe a sequence of independent identically distributed random variables drawn from a distribution $p$ over $[n]$, which is either uniform or is…

Information Theory · Computer Science 2022-06-22 Tomer Berg , Or Ordentlich , Ofer Shayevitz

We prove new incidence bounds between a plane point set, which is a Cartesian product, and a set of translates $H$ of the hyperbola $xy=\lambda\neq 0$, over a field of asymptotically large positive characteristic $p$. They improve recent…

Combinatorics · Mathematics 2021-04-22 Misha Rudnev , James Wheeler

Transfer learning, or domain adaptation, is concerned with machine learning problems in which training and testing data come from possibly different probability distributions. In this work, we give an information-theoretic analysis of the…

Information Theory · Computer Science 2024-08-09 Xuetong Wu , Jonathan H. Manton , Uwe Aickelin , Jingge Zhu

In Part II we show that there exist quantum codes whose probability of undetected error falls exponentially with the length of the code and derive bounds on this exponent.The lower (existence) bound for stabilizer codes is proved by a…

Quantum Physics · Physics 2007-05-23 A. Ashikhmin , A. Barg , E. Knill , S. Litsyn

Mixed level orthogonal arrays are basic structures in experimental design. We develop three algorithms that compute Rao and Gilbert-Varshamov type bounds for mixed level orthogonal arrays. The computational complexity of the terms involved…

Statistics Theory · Mathematics 2009-05-03 Ferruh Ozbudak , Ali Devin Sezer

This paper gives some results related to the research problem about infinite-dimensional affine variational inequalities raised by N.D. Yen and X. Yang [Affine variational inequalities on normed spaces, J. Optim. Theory Appl., 178 (2018),…

Optimization and Control · Mathematics 2023-04-20 Hoang Ngoc Tuan , Yongdo Lim , Nguyen Dong Yen

Error bounds play a central role in the study of conic optimization problems, including the analysis of convergence rates for numerous algorithms. Curiously, those error bounds are often H\"olderian with exponent 1/2. In this paper, we try…

Optimization and Control · Mathematics 2025-10-01 Xiaozhou Wang , Bruno F. Lourenço , Ting Kei Pong

Sobolev-type embeddings on metric measure spaces encode a subtle interaction between the analytic regularity of functions and the geometry of the underlying domain space. In this paper we develop an embedding theory for variable…

Functional Analysis · Mathematics 2026-03-20 Ryan Alvarado , Michał Dymek , Przemysław Górka , Nijjwal Karak