中文
相关论文

相关论文: Optimal rates of entropy estimation over Lipschitz…

200 篇论文

Motivated by establishing Neumann Talenti type comparison results, we concern the minimization of the following shape functional under volume constraint: \begin{align*} T(\Omega):=\inf\left\{\frac12 \int_{\Omega} |\nabla u|^2\,dx…

偏微分方程分析 · 数学 2023-11-08 Qinfeng Li , Weihong Xie , Hang Yang

We show several variants of concentration inequalities on the sphere stated as subgaussian estimates with optimal constants. For a Lipschitz function, we give one-sided and two-sided bounds for deviation from the median as well as from the…

概率论 · 数学 2026-04-02 Guillaume Aubrun , Justin Jenkinson , Stanislaw J. Szarek

We study differentially private (DP) stochastic optimization (SO) with loss functions whose worst-case Lipschitz parameter over all data may be extremely large or infinite. To date, the vast majority of work on DP SO assumes that the loss…

机器学习 · 计算机科学 2024-10-01 Andrew Lowy , Meisam Razaviyayn

We address the problem of density estimation with $\mathbb{L}_s$-loss by selection of kernel estimators. We develop a selection procedure and derive corresponding $\mathbb{L}_s$-risk oracle inequalities. It is shown that the proposed…

统计理论 · 数学 2012-11-26 Alexander Goldenshluger , Oleg Lepski

We study the robust interpolation problem of arbitrary data distributions supported on a bounded space and propose a two-fold law of robustness. Robust interpolation refers to the problem of interpolating $n$ noisy training data points in…

机器学习 · 计算机科学 2023-06-02 Yihan Wu , Heng Huang , Hongyang Zhang

We extend the notion of estimation entropy of autonomous dynamical systems proposed by Liberzon and Mitra [1] to nonlinear dynamical systems with uncertain inputs with bounded variation. We call this new notion the {$\epsilon$}-estimation…

系统与控制 · 电气工程与系统科学 2023-11-14 Hussein Sibai , Sayan Mitra

This paper is focused on the statistical analysis of probability measures $\nu_{1},\ldots,\nu_{n}$ on $\mathbb{R}$ that can be viewed as independent realizations of an underlying stochastic process. We consider the situation of practical…

统计理论 · 数学 2017-03-30 Jérémie Bigot , Raúl Gouet , Thierry Klein , Alfredo López

We study the embedding $\text{id}: \ell_p^b(\ell_q^d) \to \ell_r^b(\ell_u^d)$ and prove matching bounds for the entropy numbers $e_k(\text{id})$ provided that $0<p<r\leq \infty$ and $0<q\leq u\leq \infty$. Based on this finding, we…

泛函分析 · 数学 2020-03-02 Sebastian Mayer , Tino Ullrich

Entropic optimal transport offers a computationally tractable approximation to the classical problem. In this note, we study the approximation rate of the entropic optimal transport map (in approaching the Brenier map) when the…

概率论 · 数学 2024-11-22 Ritwik Sadhu , Ziv Goldfeld , Kengo Kato

We consider a stochastic version of the proximal point algorithm for optimization problems posed on a Hilbert space. A typical application of this is supervised learning. While the method is not new, it has not been extensively analyzed in…

最优化与控制 · 数学 2021-09-28 Monika Eisenmann , Tony Stillfjord , Måns Williamson

This paper is devoted to the estimation of the common marginal density function of weakly dependent processes. The accuracy of estimation is measured using pointwise risks. We propose a datadriven procedure using kernel rules. The bandwidth…

统计理论 · 数学 2016-04-04 Karine Bertin , Nicolas Klutchnikoff

We generalize the notion of average Lipschitz smoothness proposed by Ashlagi et al. (COLT 2021) by extending it to H\"older smoothness. This measure of the "effective smoothness" of a function is sensitive to the underlying distribution and…

机器学习 · 计算机科学 2023-10-31 Steve Hanneke , Aryeh Kontorovich , Guy Kornowski

Optimal estimation of a coin's bias using noisy data is surprisingly different from the same problem with noiseless data. We study this problem using entropy risk to quantify estimators' accuracy. We generalize the "add Beta" estimators…

统计理论 · 数学 2015-03-19 Christopher Ferrie , Robin Blume-Kohout

Consider the problem of nonparametric estimation of an unknown $\beta$-H\"older smooth density $p_{XY}$ at a given point, where $X$ and $Y$ are both $d$ dimensional. An infinite sequence of i.i.d.\ samples $(X_i,Y_i)$ are generated…

信息论 · 计算机科学 2023-08-29 Jingbo Liu

We obtain an optimal deviation from the mean upper bound \begin{equation} D(x)\=\sup_{f\in \F}\mu\{f-\E_{\mu} f\geq x\},\qquad\ \text{for}\ x\in\R\label{abstr} \end{equation} where $\F$ is the class of the integrable, Lipschitz functions on…

概率论 · 数学 2013-12-09 Dainius Dzindzalieta

We present a minimax optimal solution to the problem of estimating a compact, convex set from finitely many noisy measurements of its support function. The solution is based on appropriate regularizations of the least squares estimator.…

统计理论 · 数学 2012-05-31 Adityanand Guntuboyina

We give estimates from below for the error of approximation of a compact subset from a Banach space by the outputs of feed-forward neural networks with width W, depth l and Lipschitz activation functions. We show that, modulo logarithmic…

机器学习 · 统计学 2023-10-12 Guergana Petrova , Przemyslaw Wojtaszczyk

Stochastic convex optimization is one of the most well-studied models for learning in modern machine learning. Nevertheless, a central fundamental question in this setup remained unresolved: "How many data points must be observed so that…

机器学习 · 计算机科学 2023-11-10 Daniel Carmon , Roi Livni , Amir Yehudayoff

The subject of this paper is the estimation of a probability measure on ${\mathbb R}^d$ from data observed with an additive noise, under the Wasserstein metric of order $p$ (with $p\geq 1$). We assume that the distribution of the errors is…

统计理论 · 数学 2013-07-22 Jérôme Dedecker , Bertrand Michel

We estimate convex polytopes and general convex sets in $\mathbb R^d,d\geq 2$ in the regression framework. We measure the risk of our estimators using a $L^1$-type loss function and prove upper bounds on these risks. We show that, in the…

统计理论 · 数学 2012-11-16 Victor-Emmanuel Brunel