English
Related papers

Related papers: Sharp concentration of uniform generalization erro…

200 papers

A number of ill-posed inverse problems in signal processing, like blind deconvolution, matrix factorization, dictionary learning and blind source separation share the common characteristic of being bilinear inverse problems (BIPs), i.e. the…

Information Theory · Computer Science 2014-11-11 Sunav Choudhary , Urbashi Mitra

Calculation of the log-normalizer is a major computational obstacle in applications of log-linear models with large output spaces. The problem of fast normalizer computation has therefore attracted significant attention in the theoretical…

Machine Learning · Statistics 2015-06-19 Jacob Andreas , Maxim Rabinovich , Dan Klein , Michael I. Jordan

The thesis concentrates on two problems in discrete geometry, whose solutions are obtained by analytic, probabilistic and combinatoric tools. The first chapter deals with the strong polarization problem. This states that for any sequence…

Metric Geometry · Mathematics 2019-07-12 Gergely Ambrus

The law of large numbers for the empirical density for the pairs of uniformly distributed integers with a given greatest common divisor is a classic result in number theory. In this paper, we study the large deviations of the empirical…

Probability · Mathematics 2016-10-07 Behzad Mehrdad , Lingjiong Zhu

We derive an (almost) guaranteed upper bound on the error of deep neural networks under distribution shift using unlabeled test data. Prior methods either give bounds that are vacuous in practice or give estimates that are accurate on…

Machine Learning · Statistics 2023-06-02 Elan Rosenfeld , Saurabh Garg

In a complete metric space that is equipped with a doubling measure and supports a Poincar\'e inequality, we study strict subsets, i.e. sets whose variational capacity with respect to a larger reference set is finite, in the case $p=1$.…

Metric Geometry · Mathematics 2019-03-12 Panu Lahti

This note is devoted to the proof of convex Sobolev (or generalized Poincar\'{e}) inequalities which interpolate between spectral gap (or Poincar\'{e}) inequalities and logarithmic Sobolev inequalities. We extend to the whole family of…

Analysis of PDEs · Mathematics 2007-05-23 Jean Dolbeault , Jean-Philippe Bartier

Let $T$ be a general sampling statistic that can be written as a linear statistic plus an error term. Uniform and non-uniform Berry--Esseen type bounds for $T$ are obtained. The bounds are the best possible for many known statistics.…

Statistics Theory · Mathematics 2009-09-29 Louis H. Y. Chen , Qi-Man Shao

Recent works have investigated the sample complexity necessary for fair machine learning. The most advanced of such sample complexity bounds are developed by analyzing multicalibration uniform convergence for a given predictor class. We…

Machine Learning · Computer Science 2022-02-10 Harrison Rosenberg , Robi Bhattacharjee , Kassem Fawaz , Somesh Jha

The Generalized Central Limit Theorem is a remarkable generalization of the Central Limit Theorem, showing that the sum of a large number of independent, identically-distributed (i.i.d) random variables with infinite variance may converge…

Statistical Mechanics · Physics 2020-02-19 Ariel Amir

We obtain critical embeddings and the concentration-compactness principle for the anisotropic variable exponent Sobolev spaces. As an application of these results,we confirm the existence of and find infinitely many nontrivial solutions for…

Analysis of PDEs · Mathematics 2024-03-27 N. Chems Eddine , M. A. Ragusa , D. D. Repovš

We show how to use the Malliavin calculus to obtain density estimates of the law of general centered random variables. In particular, under a non-degeneracy condition, we prove and use a new formula for the density of a random variable…

Probability · Mathematics 2008-08-18 Ivan Nourdin , Frederi G. Viens

Generalized linear models (GLMs) are popular for data-analysis in almost all quantitative sciences, but the choice of likelihood family and link function is often difficult. This motivates the search for likelihoods and links that minimize…

Methodology · Statistics 2024-03-19 Maximilian Scholz , Paul-Christian Bürkner

This paper is concerned with approximations and related discretization error estimates for the normal derivatives of solutions of linear elliptic partial differential equations. In order to illustrate the ideas, we consider the Poisson…

Numerical Analysis · Mathematics 2018-04-17 J. Pfefferer , M. Winkler

Non-Gaussian outcomes are often modeled using members of the so-called exponential family. Notorious members are the Bernoulli model for binary data, leading to logistic regression, and the Poisson model for count data, leading to Poisson…

Classification of high dimensional data finds wide-ranging applications. In many of these applications equipping the resulting classification with a measure of uncertainty may be as important as the classification itself. In this paper we…

Machine Learning · Computer Science 2018-02-12 Andrea L. Bertozzi , Xiyang Luo , Andrew M. Stuart , Konstantinos C. Zygalakis

We prove a lower bound on the sharp Poincar\'e-Sobolev embedding constants for general open sets, in terms of their inradius. We consider the following two situations: planar sets with given topology; open sets in any dimension, under the…

Analysis of PDEs · Mathematics 2024-01-17 Francesco Bozzola , Lorenzo Brasco

In online classification, a learner is presented with a sequence of examples and aims to predict their labels in an online fashion so as to minimize the total number of mistakes. In the self-directed variant, the learner knows in advance…

Machine Learning · Computer Science 2023-08-08 Ilias Diakonikolas , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis

We extend several Cheeger-type isoperimetric bounds for convex sets in Euclidean space, due to Bobkov and Kannan-Lov\'asz-Simonovits, to Riemannian manifolds having non-negative Ricci curvature. In order to extend Bobkov's bound, we require…

Functional Analysis · Mathematics 2011-05-06 Emanuel Milman

The minimum-norm interpolator (MNI) framework has recently attracted considerable attention as a tool for understanding generalization in overparameterized models, such as neural networks. In this work, we study the MNI under a $2$-uniform…

Functional Analysis · Mathematics 2026-04-01 Gil Kur , Pierre Bizeul