English
Related papers

Related papers: Local Rademacher Complexity Bounds based on Coveri…

200 papers

For a finite function class we describe the large sample limit of the sequential Rademacher complexity in terms of the viscosity solution of a $G$-heat equation. In the language of Peng's sublinear expectation theory, the same quantity…

Machine Learning · Computer Science 2016-05-13 Dmitry B. Rokhlin

In the framework of the probabilistic method in combinatorics, we revisit the entropy compression method clarifying the setting in which it can be applied and providing a theorem yielding a general constructive criterion. We finally…

Combinatorics · Mathematics 2019-12-12 Rogério G. Alves , Aldo Procacci , Remy Sanchis

We extend the traditional worst-case, minimax analysis of stochastic convex optimization by introducing a localized form of minimax complexity for individual functions. Our main result gives function-specific lower and upper bounds on the…

Machine Learning · Statistics 2016-05-27 Yuancheng Zhu , Sabyasachi Chatterjee , John Duchi , John Lafferty

We address a specific but recurring problem related to sampled linear systems. In particular, we provide a numerical method for the rigorous verification of constraint satisfaction for linear continuous-time systems between sampling…

Optimization and Control · Mathematics 2016-03-30 Moritz Schulze Darup

Information theory plays a central role in establishing fundamental limits on what any learning or estimation algorithm can -- and cannot -- achieve, regardless of computational power. In this chapter, we provide an introduction to these…

Information Theory · Computer Science 2026-05-11 Abbas El Gamal , Maxim Raginsky

Writing the boundary integral equation for an exterior problem of elasticity is subordinate so far to hypotheses on the asymptotical behaviour at infinity of solutions. The sufficient conditions met in the literature are too restrictive and…

Classical Physics · Physics 2009-11-13 Alain Corfdir , Guy Bonnet

We study boundary regional controllability problems for a class of semilinear fractional systems. Sufficient conditions for regional boundary controllability are proved by assuming that the associated linear system is approximately…

Optimization and Control · Mathematics 2024-02-06 Asmae Tajani , Fatima-Zahrae El Alaoui , Delfim F. M. Torres

The primary objective of learning methods is generalization. Classic uniform generalization bounds, which rely on VC-dimension or Rademacher complexity, fail to explain the significant attribute that over-parameterized models in deep…

Machine Learning · Computer Science 2025-03-07 Lijia Yu , Yibo Miao , Yifan Zhu , Xiao-Shan Gao , Lijun Zhang

We review various characterizations of uniform convexity and smoothness on norm balls in finite-dimensional spaces and connect results stemming from the geometry of Banach spaces with \textit{scaling inequalities} used in analysing the…

Optimization and Control · Mathematics 2021-02-19 Thomas Kerdreux , Alexandre d'Aspremont , Sebastian Pokutta

We prove a new generalization bound that shows for any class of linear predictors in Gaussian space, the Rademacher complexity of the class and the training error under any continuous loss $\ell$ can control the test error under all Moreau…

Machine Learning · Statistics 2022-10-24 Lijia Zhou , Frederic Koehler , Pragya Sur , Danica J. Sutherland , Nathan Srebro

We illustrate how computer-aided methods can be used to investigate the fundamental limits of the caching systems, which are significantly different from the conventional analytical approach usually seen in the information theory…

Information Theory · Computer Science 2018-08-28 Chao Tian

Inspired by regularization techniques in statistics and machine learning, we study complementary composite minimization in the stochastic setting. This problem corresponds to the minimization of the sum of a (weakly) smooth function endowed…

Machine Learning · Computer Science 2024-01-24 Alexandre d'Aspremont , Cristóbal Guzmán , Clément Lezane

We study entropy-bounded computational geometry, that is, geometric algorithms whose running times depend on a given measure of the input entropy. Specifically, we introduce a measure that we call range-partition entropy, which unifies and…

Computational Geometry · Computer Science 2025-08-29 David Eppstein , Michael T. Goodrich , Abraham M. Illickan , Claire A. To

We develop a theory of complexity for numerical computations that takes into account the condition of the input data and allows for roundoff in the computations. We follow the lines of the theory developed by Blum, Shub, and Smale for…

Computational Complexity · Computer Science 2014-06-09 Felipe Cucker

In this work, constructions of ordered covering arrays are discussed and applied to obtain new upper bounds on covering codes in Rosenbloom-Tsfasman spaces (RT spaces), improving or extending some previous results.

Discrete Mathematics · Computer Science 2022-08-03 André Guerino Castoldi , Emerson Luiz do Monte Carmelo , Lucia Moura , Daniel Panario , Brett Stevens

We start presenting an $L^{\infty}$-gradient bound for solutions to non-homogeneous $p$-Laplacean type systems and equations, via suitable non-linear potentials of the right hand side. Such a bound implies a Lorentz space characterization…

Analysis of PDEs · Mathematics 2015-05-14 Frank Duzaar , Giuseppe Mingione

Recently there has been a surge of interest in understanding implicit regularization properties of iterative gradient-based optimization algorithms. In this paper, we study the statistical guarantees on the excess risk achieved by…

Machine Learning · Statistics 2020-08-28 Tomas Vaškevičius , Varun Kanade , Patrick Rebeschini

Established approaches to obtain generalization bounds in data-driven optimization and machine learning mostly build on solutions from empirical risk minimization (ERM), which depend crucially on the functional complexity of the hypothesis…

Optimization and Control · Mathematics 2022-10-14 Yibo Zeng , Henry Lam

In many interesting situations the size of epsilon-nets depends only on $\epsilon$ together with different complexity measures. The aim of this paper is to give a systematic treatment of such complexity measures arising in Discrete and…

Computational Geometry · Computer Science 2021-01-05 Andrey Kupavskii , Nikita Zhivotovskiy

Quantitative bounds for random embeddings of $\mathbb{R}^{k}$ into Lorentz sequence spaces are given, with improved dependence on $\varepsilon$.

Functional Analysis · Mathematics 2021-04-27 Daniel J. Fresen