English
Related papers

Related papers: Concentration Bounds for Discrete Distribution Est…

200 papers

In this paper, we consider the following $k$-dispersion problem. Given a set $S$ of $n$ points placed in the plane in a convex position, and an integer $k$ ($0<k<n$), the objective is to compute a subset $S'\subset S$ such that $|S'|=k$ and…

Computational Geometry · Computer Science 2022-05-05 Vishwanath R. Singireddy , Manjanna Basappa

We revisit the method of mixture technique, also known as the Laplace method, to study the concentration phenomenon in generic exponential families. Combining the properties of Bregman divergence associated with log-partition function of…

Machine Learning · Computer Science 2023-07-14 Sayak Ray Chowdhury , Patrick Saux , Odalric-Ambrym Maillard , Aditya Gopalan

In this work, we study the problem of answering $k$ queries with $(\epsilon, \delta)$-differential privacy, where each query has sensitivity one. We give an algorithm for this task that achieves an expected $\ell_\infty$ error bound of…

Data Structures and Algorithms · Computer Science 2020-12-17 Badih Ghazi , Ravi Kumar , Pasin Manurangsi

We provide optimal lower bounds for two well-known parameter estimation (also known as statistical estimation) tasks in high dimensions with approximate differential privacy. First, we prove that for any $\alpha \le O(1)$, estimating the…

Statistics Theory · Mathematics 2024-01-05 Shyam Narayanan

We obtain restriction estimates of $\epsilon$-removal type for the set of $k$-th powers of integers, and for discrete $d$-dimensional surfaces of the form \[ \{ (n_1,\dots,n_d,n_1^k + \dotsb + n_d^k) \,:\, |n_1|,\dots,|n_d| \leq N \}, \]…

Number Theory · Mathematics 2016-10-14 Kevin Henriot , Kevin Hughes

Kernel techniques are among the most popular and flexible approaches in data science allowing to represent probability measures without loss of information under mild conditions. The resulting mapping called mean embedding gives rise to a…

Machine Learning · Statistics 2024-11-27 Linda Chamakh , Zoltan Szabo

This paper is concerned with the Dirichlet eigenvalue problem for Laplace operator in a bounded domain with periodic perforation in the case of small volume. We obtain the optimal quantitative error estimates independent of the spectral…

Analysis of PDEs · Mathematics 2024-08-27 Zhongwei Shen , Jinping Zhuge

We analyze monotone difference schemes for strongly degenerate convection-diffusion equations in one spatial dimension. These nonlinear equations are well-posed within a class of (discontinuous) entropy solutions. We prove that the L1…

Analysis of PDEs · Mathematics 2013-04-16 Kenneth H. Karlsen , Nils Henrik Risebro , Erlend B. Storrøsten

We analyze the problem of discrete distribution estimation under $\ell_1$ loss. We provide non-asymptotic upper and lower bounds on the maximum risk of the empirical distribution (the maximum likelihood estimator), and the minimax risk in…

Information Theory · Computer Science 2015-12-31 Yanjun Han , Jiantao Jiao , Tsachy Weissman

In this paper, by means of a standard model problem, we devise an approach to computing approximate dual bounds for use in global optimization of coefficient identification in partial differential equations (PDEs) by, e.g., (spatial)…

Numerical Analysis · Mathematics 2026-03-20 Barbara Kaltenbacher , Paul Manns

For any origin-symmetric convex body $K$ in $\mathbb{R}^n$ in isotropic position, we obtain the bound: \[ M^*(K) \leq C \sqrt{n} \log(n)^2 L_K ~, \] where $M^*(K)$ denotes (half) the mean-width of $K$, $L_K$ is the isotropic constant of…

Functional Analysis · Mathematics 2014-05-09 Emanuel Milman

The problem of sampling according to the probability distribution minimizing a given free energy, using interacting particles unadjusted kinetic Langevin Monte Carlo, is addressed. In this setting, three sources of error arise, related to…

Probability · Mathematics 2024-12-05 Pierre Monmarché , Katharina Schuh

We prove an exponential decay concentration inequality to bound the tail probability of the difference between the log-likelihood of discrete random variables on a finite alphabet and the negative entropy. The concentration bound we derive…

Probability · Mathematics 2021-06-23 Yunpeng Zhao

In this paper we obtain an approximation for the multivariate Laplace's integral with a large parameter and estimate error term for two cases, when the maximum of the exponent is in the interior of the domain and on the boundary. We are…

Probability · Mathematics 2021-04-09 Tomasz M. Łapiński

Let $K\subset\mathbb{C}$ be non-polar, compact and polynomially convex. We study the limits of equilibrium measures on preimages of compact sets, under $K$-regular sequences of polynomials, that center on $K$ and under the sequences of…

Dynamical Systems · Mathematics 2025-12-12 Christian Henriksen , Carsten Lunde Petersen , Eva Uhre

Estimating divergences in a consistent way is of great importance in many machine learning tasks. Although this is a fundamental problem in nonparametric statistics, to the best of our knowledge there has been no finite sample exponential…

Information Theory · Computer Science 2016-03-30 Shashank Singh , Barnabás Póczos

In this paper, we revisit approximation properties of piecewise polynomial spaces, which contain more than ${\cal P}_{r-1}$ but not ${\cal P}_r$. We develop more accurate upper and lower error bounds that are sharper than those used in…

Numerical Analysis · Mathematics 2015-02-17 Hehu Xie , Zhimin Zhang

Though mostly used as a clustering algorithm, k-means are originally designed as a quantization algorithm. Namely, it aims at providing a compression of a probability distribution with k points. Building upon [21, 33], we try to investigate…

Statistics Theory · Mathematics 2018-01-31 Clément Levrard

This paper considers a distributionally robust chance constraint model with a general ambiguity set. We show that a sample based approximation of this model converges under suitable sufficient conditions. We also show that upper and lower…

Optimization and Control · Mathematics 2025-01-17 Jiaqi Lei , Sanjay Mehrotra

We study the problem of distributed mean estimation and optimization under communication constraints. We propose a correlated quantization protocol whose leading term in the error guarantee depends on the mean deviation of data points…

Machine Learning · Computer Science 2022-07-12 Ananda Theertha Suresh , Ziteng Sun , Jae Hun Ro , Felix Yu