English
Related papers

Related papers: Optimal rates of entropy estimation over Lipschitz…

200 papers

Motivated by establishing Neumann Talenti type comparison results, we concern the minimization of the following shape functional under volume constraint: \begin{align*} T(\Omega):=\inf\left\{\frac12 \int_{\Omega} |\nabla u|^2\,dx…

Analysis of PDEs · Mathematics 2023-11-08 Qinfeng Li , Weihong Xie , Hang Yang

We show several variants of concentration inequalities on the sphere stated as subgaussian estimates with optimal constants. For a Lipschitz function, we give one-sided and two-sided bounds for deviation from the median as well as from the…

Probability · Mathematics 2026-04-02 Guillaume Aubrun , Justin Jenkinson , Stanislaw J. Szarek

We study differentially private (DP) stochastic optimization (SO) with loss functions whose worst-case Lipschitz parameter over all data may be extremely large or infinite. To date, the vast majority of work on DP SO assumes that the loss…

Machine Learning · Computer Science 2024-10-01 Andrew Lowy , Meisam Razaviyayn

We address the problem of density estimation with $\mathbb{L}_s$-loss by selection of kernel estimators. We develop a selection procedure and derive corresponding $\mathbb{L}_s$-risk oracle inequalities. It is shown that the proposed…

Statistics Theory · Mathematics 2012-11-26 Alexander Goldenshluger , Oleg Lepski

We study the robust interpolation problem of arbitrary data distributions supported on a bounded space and propose a two-fold law of robustness. Robust interpolation refers to the problem of interpolating $n$ noisy training data points in…

Machine Learning · Computer Science 2023-06-02 Yihan Wu , Heng Huang , Hongyang Zhang

We extend the notion of estimation entropy of autonomous dynamical systems proposed by Liberzon and Mitra [1] to nonlinear dynamical systems with uncertain inputs with bounded variation. We call this new notion the {$\epsilon$}-estimation…

Systems and Control · Electrical Eng. & Systems 2023-11-14 Hussein Sibai , Sayan Mitra

This paper is focused on the statistical analysis of probability measures $\nu_{1},\ldots,\nu_{n}$ on $\mathbb{R}$ that can be viewed as independent realizations of an underlying stochastic process. We consider the situation of practical…

Statistics Theory · Mathematics 2017-03-30 Jérémie Bigot , Raúl Gouet , Thierry Klein , Alfredo López

We study the embedding $\text{id}: \ell_p^b(\ell_q^d) \to \ell_r^b(\ell_u^d)$ and prove matching bounds for the entropy numbers $e_k(\text{id})$ provided that $0<p<r\leq \infty$ and $0<q\leq u\leq \infty$. Based on this finding, we…

Functional Analysis · Mathematics 2020-03-02 Sebastian Mayer , Tino Ullrich

Entropic optimal transport offers a computationally tractable approximation to the classical problem. In this note, we study the approximation rate of the entropic optimal transport map (in approaching the Brenier map) when the…

Probability · Mathematics 2024-11-22 Ritwik Sadhu , Ziv Goldfeld , Kengo Kato

We consider a stochastic version of the proximal point algorithm for optimization problems posed on a Hilbert space. A typical application of this is supervised learning. While the method is not new, it has not been extensively analyzed in…

Optimization and Control · Mathematics 2021-09-28 Monika Eisenmann , Tony Stillfjord , Måns Williamson

This paper is devoted to the estimation of the common marginal density function of weakly dependent processes. The accuracy of estimation is measured using pointwise risks. We propose a datadriven procedure using kernel rules. The bandwidth…

Statistics Theory · Mathematics 2016-04-04 Karine Bertin , Nicolas Klutchnikoff

We generalize the notion of average Lipschitz smoothness proposed by Ashlagi et al. (COLT 2021) by extending it to H\"older smoothness. This measure of the "effective smoothness" of a function is sensitive to the underlying distribution and…

Machine Learning · Computer Science 2023-10-31 Steve Hanneke , Aryeh Kontorovich , Guy Kornowski

Optimal estimation of a coin's bias using noisy data is surprisingly different from the same problem with noiseless data. We study this problem using entropy risk to quantify estimators' accuracy. We generalize the "add Beta" estimators…

Statistics Theory · Mathematics 2015-03-19 Christopher Ferrie , Robin Blume-Kohout

Consider the problem of nonparametric estimation of an unknown $\beta$-H\"older smooth density $p_{XY}$ at a given point, where $X$ and $Y$ are both $d$ dimensional. An infinite sequence of i.i.d.\ samples $(X_i,Y_i)$ are generated…

Information Theory · Computer Science 2023-08-29 Jingbo Liu

We obtain an optimal deviation from the mean upper bound \begin{equation} D(x)\=\sup_{f\in \F}\mu\{f-\E_{\mu} f\geq x\},\qquad\ \text{for}\ x\in\R\label{abstr} \end{equation} where $\F$ is the class of the integrable, Lipschitz functions on…

Probability · Mathematics 2013-12-09 Dainius Dzindzalieta

We present a minimax optimal solution to the problem of estimating a compact, convex set from finitely many noisy measurements of its support function. The solution is based on appropriate regularizations of the least squares estimator.…

Statistics Theory · Mathematics 2012-05-31 Adityanand Guntuboyina

We give estimates from below for the error of approximation of a compact subset from a Banach space by the outputs of feed-forward neural networks with width W, depth l and Lipschitz activation functions. We show that, modulo logarithmic…

Machine Learning · Statistics 2023-10-12 Guergana Petrova , Przemyslaw Wojtaszczyk

Stochastic convex optimization is one of the most well-studied models for learning in modern machine learning. Nevertheless, a central fundamental question in this setup remained unresolved: "How many data points must be observed so that…

Machine Learning · Computer Science 2023-11-10 Daniel Carmon , Roi Livni , Amir Yehudayoff

The subject of this paper is the estimation of a probability measure on ${\mathbb R}^d$ from data observed with an additive noise, under the Wasserstein metric of order $p$ (with $p\geq 1$). We assume that the distribution of the errors is…

Statistics Theory · Mathematics 2013-07-22 Jérôme Dedecker , Bertrand Michel

We estimate convex polytopes and general convex sets in $\mathbb R^d,d\geq 2$ in the regression framework. We measure the risk of our estimators using a $L^1$-type loss function and prove upper bounds on these risks. We show that, in the…

Statistics Theory · Mathematics 2012-11-16 Victor-Emmanuel Brunel