English
Related papers

Related papers: Minimax Optimal Additive Functional Estimation wit…

200 papers

Estimating linear, mean-square continuous functionals is a pivotal challenge in statistics. In high-dimensional contexts, this estimation is often performed under the assumption of exact model sparsity, meaning that only a small number of…

Statistics Theory · Mathematics 2025-08-04 Jelena Bradic , Victor Chernozhukov , Whitney K. Newey , Yinchu Zhu

Asymptotic theory for approximate martingale estimating functions is generalised to diffusions with finite-activity jumps, when the sampling frequency and terminal sampling time go to infinity. Rate optimality and efficiency are of…

Methodology · Statistics 2018-09-05 Nina Munkholt Jakobsen , Michael Sørensen

In this paper, in a multivariate setting we derive near optimal rates of convergence in the minimax sense for estimating partial derivatives of the mean function for functional data observed under a fixed synchronous design over H\"older…

Statistics Theory · Mathematics 2025-08-25 Max Berger , Hajo Holzmann

The problem of estimating the Kullback-Leibler divergence $D(P\|Q)$ between two unknown distributions $P$ and $Q$ is studied, under the assumption that the alphabet size $k$ of the distributions can scale to infinity. The estimation is…

Information Theory · Computer Science 2018-02-22 Yuheng Bu , Shaofeng Zou , Yingbin Liang , Venugopal V. Veeravalli

We develop a technique for establishing lower bounds on the sample complexity of Least Squares (or, Empirical Risk Minimization) for large classes of functions. As an application, we settle an open problem regarding optimality of Least…

Statistics Theory · Mathematics 2020-06-09 Gil Kur , Alexander Rakhlin , Adityanand Guntuboyina

The problem of optimal linear estimation of linear functionals depending on the unknown values of a periodically correlated stochastic process from observations of the process with additive noise is considered. Formulas for calculating the…

Statistics Theory · Mathematics 2025-10-29 Iryna Dubovets'ka , Mykhailo Moklyachuk

Distribution-on-distribution regression considers the problem of formulating and estimating a regression relationship where both covariate and response are probability distributions. The optimal transport distributional regression model…

Statistics Theory · Mathematics 2022-06-06 Laya Ghodrati , Victor M. Panaretos

We consider the advection-diffusion equation \[ \phi_t + Au \cdot \nabla \phi = \Delta \phi, \qquad \phi(0,x)=\phi_0(x) \] on $\bbR^2$, with $u$ a periodic incompressible flow and $A\gg 1$ its amplitude. We provide a sharp characterization…

Analysis of PDEs · Mathematics 2007-05-23 Andrej Zlatos

We study the fundamental task of estimating the median of an underlying distribution from a finite number of samples, under pure differential privacy constraints. We focus on distributions satisfying the minimal assumption that they have a…

Statistics Theory · Mathematics 2020-11-13 Christos Tzamos , Emmanouil-Vasileios Vlatakis-Gkaragkounis , Ilias Zadik

Consider a random sample $(X_{1},\ldots,X_{n})$ from an unknown discrete distribution $P=\sum_{j\geq1}p_{j}\delta_{s_{j}}$ on a countable alphabet $\mathbb{S}$, and let $(Y_{n,j})_{j\geq1}$ be the empirical frequencies of distinct symbols…

Statistics Theory · Mathematics 2024-07-12 Stefano Favaro , Zacharie Naulet

We study nonasymptotic minimax estimation of the linear functional $L(\theta)=\eta^\top \theta$ for a high-dimensional $s$-sparse mean vector with an arbitrary loading vector $\eta$. For symmetric noise with exponentially decaying tails, we…

Statistics Theory · Mathematics 2026-04-29 Jie Xie , Dongming Huang

We consider the problem of optimal estimation of the value of a vector parameter $\thetavector=(\theta_0,\ldots,\theta_n)^{\top}$ of the drift term in a fractional Brownian motion represented by the finite sum…

Statistics Theory · Mathematics 2017-07-25 A. V. Artemov , E. V. Burnaev

We develop minimax optimal risk bounds for the general learning task consisting in predicting as well as the best function in a reference set G up to the smallest possible additive term, called the convergence rate. When the reference set…

Statistics Theory · Mathematics 2008-03-04 Jean-Yves Audibert

Principal component analysis (PCA) is one of the most commonly used statistical procedures with a wide range of applications. This paper considers both minimax and adaptive estimation of the principal subspace in the high dimensional…

Statistics Theory · Mathematics 2014-01-08 T. Tony Cai , Zongming Ma , Yihong Wu

This paper develops a continuous-time primal-dual accelerated method with an increasing damping coefficient for a class of convex optimization problems with affine equality constraints. This paper analyzes critical values for parameters in…

Optimization and Control · Mathematics 2022-02-16 Xianlin Zeng , Jinlong Lei , Jie Chen

The problem of the mean-square optimal linear estimation of the functional $A\xi=\ \int\limits_{R^s}a(t)\xi(-t)dt,$ which depends on the unknown values of stochastic stationary process $\xi(t)$ from observations of the process…

Statistics Theory · Mathematics 2024-02-13 Mikhail Moklyachuk , Maria Sidei

The problem of the mean-square optimal linear estimation of the functional $A\xi=\ \int\limits_{R^s}a(t)\xi(-t)dt,$ which depends on the unknown values of stochastic stationary process $\xi(t)$ from observations of the process…

Statistics Theory · Mathematics 2025-10-21 Mykhailo Moklyachuk , Maria Sidei

In this paper, we propose a novel accelerated forward-backward splitting algorithm for minimizing convex composite functions, written as the sum of a smooth function and a (possibly) nonsmooth function. When the objective function is…

Optimization and Control · Mathematics 2025-09-19 Kansei Ushiyama

Consider the communication-constrained estimation of discrete distributions under $\ell^p$ losses, where each distributed terminal holds multiple independent samples and uses limited number of bits to describe the samples. We obtain the…

Machine Learning · Computer Science 2024-11-11 Deheng Yuan , Tao Guo , Zhongyi Huang

We present a new fractional Taylor formula for singular functions whose Caputo fractional derivatives are of bounded variation. It bridges and ``interpolates" the usual Taylor formulas with two consecutive integer orders. This enables us to…

Numerical Analysis · Mathematics 2021-11-02 Wenjie Liu , Li-Lian Wang , Boying Wu