English
Related papers

Related papers: Concentration in unbounded metric spaces and algor…

200 papers

We consider the problem of designing uniformly stable first-order optimization algorithms for empirical risk minimization. Uniform stability is often used to obtain generalization error bounds for optimization algorithms, and we are…

Machine Learning · Computer Science 2022-07-19 Amit Attia , Tomer Koren

This paper is devoted to developing and applications of a generalized differential theory of variational analysis that allows us to work in incomplete normed spaces, without employing conventional variational techniques based on…

Optimization and Control · Mathematics 2020-11-17 Ashkan Mohammadi , Boris Mordukhovich

We provide a new construction for a set of boxes approximating axis-parallel boxes of fixed volume in $[0, 1]^d$. This improves upper bounds for the minimal dispersion of a point set in the unit cube and its inverse in both the periodic and…

Metric Geometry · Mathematics 2022-01-24 Alexander E. Litvak , Galyna V. Livshyts

By Gromov's compactness theorem for metric spaces, every uniformly compact sequence of metric spaces admits an isometric embedding into a common compact metric space in which a subsequence converges with respect to the Hausdorff distance.…

Differential Geometry · Mathematics 2008-10-29 Stefan Wenger

This paper consists of two halves. In the first half of the paper, we consider real-valued functions $f$ whose domain is the vertex set of a graph $G$ and that are Lipschitz with respect to the graph distance. By placing a uniform…

Combinatorics · Mathematics 2017-05-30 Matthew Yancey

Existing convergence of distributed optimization methods in non-Euclidean geometries typically rely on kernel assumptions: (i) global Lipschitz smoothness and (ii) bi-convexity of the associated Bregman divergence function. Unfortunately,…

Optimization and Control · Mathematics 2026-03-16 Junwen Qiu , Ziyang Zeng , Leilei Mei , Junyu Zhang

Understanding the dimension dependency of computational complexity in high-dimensional sampling problem is a fundamental problem, both from a practical and theoretical perspective. Compared with samplers with unbiased stationary…

Machine Learning · Computer Science 2024-03-12 Xunpeng Huang , Hanze Dong , Difan Zou , Tong Zhang

We study uniform consistency in nonparametric mixture models as well as closely related mixture of regression (also known as mixed regression) models, where the regression functions are allowed to be nonparametric and the error…

Statistics Theory · Mathematics 2022-12-29 Bryon Aragam , Ruiyi Yang

We consider square-integrable functionals of Poisson point processes for which the variance upper bound provided by the classical Poincar\'{e} inequality is suboptimal, a phenomenon known as superconcentration. In this paper, we establish a…

Probability · Mathematics 2026-03-26 Chinmoy Bhattacharjee , Rowan O'Clarey

We propose an approach to construction of robust non-Euclidean iterative algorithms for convex composite stochastic optimization based on truncation of stochastic gradients. For such algorithms, we establish sub-Gaussian confidence bounds…

Statistics Theory · Mathematics 2019-07-08 Anatoli Juditsky , Alexander Nazin , Arkadi Nemirovsky , Alexandre Tsybakov

In this work, we prove uniform continuity bounds for entropic quantities related to the sandwiched R\'enyi divergences such as the sandwiched R\'enyi conditional entropy. We follow three different approaches: The first one is the "almost…

Quantum Physics · Physics 2025-05-08 Andreas Bluhm , Ángela Capel , Paul Gondolf , Tim Möbus

This paper provides a convergence analysis for generalized Hamiltonian Monte Carlo samplers, a family of Markov Chain Monte Carlo methods based on leapfrog integration of Hamiltonian dynamics and kinetic Langevin diffusion, that encompasses…

Probability · Mathematics 2024-05-14 Evan Camrud , Alain Durmus , Pierre Monmarché , Gabriel Stoltz

For an ergodic Brownian diffusion with invariant measure $\nu$, we consider a sequence of empirical distributions ($\nu$n) n$\ge$1 associated with an approximation scheme with decreasing time step ($\gamma$n) n$\ge$1 along an adapted…

Probability · Mathematics 2018-10-09 I Honoré

In this note, we obtain a Gaussian concentration inequality for a class of non-Lipschitz functions. In the one-dimensional case, our results supplement those established by Paouris and Valettas in [8].

Probability · Mathematics 2022-07-11 Nguyen Tien Dung

In many applications such as web-based search, document summarization, facility location and other applications, the results are preferable to be both representative and diversified subsets of documents. The goal of this study is to select…

Machine Learning · Computer Science 2015-11-10 Sepehr Abbasi Zadeh , Mehrdad Ghadiri

This paper investigates the simultaneous identification of a spatially dependent potential and the initial condition in a subdiffusion model based on two terminal observations. The existence, uniqueness, and conditional stability of the…

Numerical Analysis · Mathematics 2025-10-28 Xu Wu , Jiang Yang , Zhi Zhou

In this paper, we consider the well known problem of estimating a density function under qualitative assumptions. More precisely, we estimate monotone non increasing densities in a Bayesian setting and derive concentration rate for the…

Statistics Theory · Mathematics 2015-02-20 Jean-Bernard Salomond

This paper is mainly concerned with the existence of extremals for the Adams inequality. We first establish an upper bound for the classical Adams functional along of all concentrated sequences in $W^{m,\frac{n}{m}}_{\mathcal{N}}(\Omega)$,…

Analysis of PDEs · Mathematics 2022-07-26 José Francisco Alves de Oliveira , Abiel Costa Macedo

Estimation of parameters that obey specific constraints is crucial in statistics and machine learning; for example, when parameters are required to satisfy boundedness, monotonicity, or linear inequalities. Traditional approaches impose…

Methodology · Statistics 2026-04-03 Lachlan Astfalck , Deborshee Sen , Sayan Patra , Edward Cripps , David Dunson

We give a concentration inequality based on the premise that random variables take values within a particular region. The concentration inequality guarantees that, for any sequence of correlated random variables, the difference between the…

Probability · Mathematics 2020-02-21 Go Kato