English
Related papers

Related papers: Minimax Optimal Estimators for Additive Scalar Fun…

200 papers

We present a new fractional Taylor formula for singular functions whose Caputo fractional derivatives are of bounded variation. It bridges and ``interpolates" the usual Taylor formulas with two consecutive integer orders. This enables us to…

Numerical Analysis · Mathematics 2021-11-02 Wenjie Liu , Li-Lian Wang , Boying Wu

We consider the estimation of the value of a linear functional of the slope parameter in functional linear regression, where scalar responses are modeled in dependence of random functions. The theory in this paper covers in particular…

Statistics Theory · Mathematics 2011-12-19 J. Johannes , R. Schenk

We consider the problem of estimating the tail index $\alpha$ of a distribution satisfying a $(\alpha, \beta)$ second-order Pareto-type condition, where \beta is the second-order coefficient. When $\beta$ is available, it was previously…

Statistics Theory · Mathematics 2014-07-07 Alexandra Carpentier , Arlene K. H. Kim

Consider a random sample $(X_{1},\ldots,X_{n})$ from an unknown discrete distribution $P=\sum_{j\geq1}p_{j}\delta_{s_{j}}$ on a countable alphabet $\mathbb{S}$, and let $(Y_{n,j})_{j\geq1}$ be the empirical frequencies of distinct symbols…

Statistics Theory · Mathematics 2024-07-12 Stefano Favaro , Zacharie Naulet

The extremal index $\theta$, a measure of the degree of local dependence in the extremes of a stationary process, plays an important role in extreme value analyses. We estimate $\theta$ semiparametrically, using the relationship between the…

Methodology · Statistics 2016-06-02 Paul J. Northrop

The problem of optimal estimation of linear functional ${{A}_{N}}\xi =\sum\limits_{k=0}^{N}{a(k)\xi (k)}\,$ depending on the unknown values of a stochastic sequence $\xi (m)$ with stationary $n$-th increments from observations of the…

Statistics Theory · Mathematics 2025-10-28 Maksym Luz , Mykhailo Moklyachuk

We prove that under some regularity and strong identifiability conditions, around a mixing distribution with $m_0$ components, the optimal local minimax rate of estimation of a mixture with $m$ components is $n^{-1/(4(m-m_0) + 2)}$. This…

Statistics Theory · Mathematics 2015-04-15 Philippe Heinrich , Jonas Kahn

Given $n$ i.i.d. observations, we study the problem of estimating the spectrum of weighted Laplace operators of the form $\Delta_f=\Delta + \alpha \nabla \log f\cdot \nabla$, where $f$ is a positive probability density on a known compact…

Statistics Theory · Mathematics 2025-12-01 Yann Chaubet , Vincent Divol

The problem of estimating the Kullback-Leibler divergence $D(P\|Q)$ between two unknown distributions $P$ and $Q$ is studied, under the assumption that the alphabet size $k$ of the distributions can scale to infinity. The estimation is…

Information Theory · Computer Science 2018-02-22 Yuheng Bu , Shaofeng Zou , Yingbin Liang , Venugopal V. Veeravalli

In this paper, a posteriori error estimates of functional type for a stationary diffusion problem with nonsymmetric coefficients are derived. The estimate is guaranteed and does not depend on any particular numerical method. An algorithm…

Numerical Analysis · Mathematics 2014-11-24 Olli Mali

We consider the problem of estimating functionals of discrete distributions, and focus on tight nonasymptotic analysis of the worst case squared error risk of widely used estimators. We apply concentration inequalities to analyze the random…

Information Theory · Computer Science 2017-08-11 Jiantao Jiao , Kartik Venkat , Yanjun Han , Tsachy Weissman

We develop and analyze $M$-estimation methods for divergence functionals and the likelihood ratios of two probability distributions. Our method is based on a non-asymptotic variational characterization of $f$-divergences, which allows the…

Statistics Theory · Mathematics 2016-11-18 XuanLong Nguyen , Martin J. Wainwright , Michael I. Jordan

Consider a sequence of real data points $X_1,\ldots, X_n$ with underlying means $\theta^*_1,\dots,\theta^*_n$. This paper starts from studying the setting that $\theta^*_i$ is both piecewise constant and monotone as a function of the index…

Statistics Theory · Mathematics 2019-08-05 Chao Gao , Fang Han , Cun-Hui Zhang

The problem of estimating the mean of random functions based on discretely sampled data arises naturally in functional data analysis. In this paper, we study optimal estimation of the mean function under both common and independent designs.…

Statistics Theory · Mathematics 2012-02-24 T. Tony Cai , Ming Yuan

In the current paper, the estimation of the probability density function and the cumulative distribution function of the Topp-Leone distribution is considered. We derive the following estimators: maximum likelihood estimator, uniformly…

Methodology · Statistics 2017-01-17 Lazhar Benkhelifa

We study the adaptive minimax estimation of non-linear integral functionals of a density and extend the results obtained for linear and quadratic functionals to general functionals. The typical rate optimal non-adaptive minimax estimators…

Statistics Theory · Mathematics 2016-01-12 Rajarshi Mukherjee , Eric Tchetgen Tchetgen , James Robins

We consider the fundamental problem of estimating a discrete distribution on a domain of size $K$ with high probability in Kullback-Leibler divergence. We provide upper and lower bounds on the minimax estimation rate, which show that the…

Machine Learning · Statistics 2026-02-23 Dirk van der Hoeven , Julia Olkhovskaia , Tim van Erven

Statistical inference for discrete time observations of an affine stochastic delay differential equation is considered. The main focus is on maximum pseudo-likelihood estimators, which are easy to calculate in practice. A more general class…

Statistics Theory · Mathematics 2013-03-21 Uwe Küchler , Michael Sørensen

This paper presents how to perform minimax optimal classification, regression, and density estimation based on fixed-$k$ nearest neighbor (NN) searches. We consider a distributed learning scenario, in which a massive dataset is split into…

Statistics Theory · Mathematics 2024-09-11 J. Jon Ryu , Young-Han Kim

Approximation properties of the expansions $\sum_{k\in{\mathbb z}^d}c_k\phi(M^jx+k)$, where $M$ is a matrix dilation, $c_k$ is either the sampled value of a signal $f$ at $M^{-j}k$ or the integral average of $f$ near $M^{-j}k$ (falsified…

Functional Analysis · Mathematics 2014-07-02 A. Krivoshein , M. Skopina