English
Related papers

Related papers: Minimax Optimal Estimators for Additive Scalar Fun…

200 papers

This paper addresses an estimation problem of an additive functional of $\phi$, which is defined as $\theta(P;\phi)=\sum_{i=1}^k\phi(p_i)$, given $n$ i.i.d. random samples drawn from a discrete distribution $P=(p_1,...,p_k)$ with alphabet…

Information Theory · Computer Science 2018-01-17 Kazuto Fukuchi , Jun Sakuma

This paper addresses a problem of estimating an additive functional given $n$ i.i.d. samples drawn from a discrete distribution $P=(p_1,...,p_k)$ with alphabet size $k$. The additive functional is defined as…

Information Theory · Computer Science 2018-12-04 Kazuto Fukuchi , Jun Sakuma

We propose a general methodology for the construction and analysis of minimax estimators for a wide class of functionals of finite dimensional parameters, and elaborate on the case of discrete distributions, where the alphabet size $S$ is…

Information Theory · Computer Science 2015-03-11 Jiantao Jiao , Kartik Venkat , Yanjun Han , Tsachy Weissman

In this paper, we observe a sparse mean vector through Gaussian noise and we aim at estimating some additive functional of the mean in the minimax sense. More precisely, we generalize the results of (Collier et al., 2017, 2019) to a very…

Statistics Theory · Mathematics 2019-08-30 Olivier Collier , Laëtitia Comminges

We consider the problem of estimating the value l({\phi}) of a linear functional, where the structural function {\phi} models a nonparametric relationship in presence of instrumental variables. We propose a plug-in estimator which is based…

Statistics Theory · Mathematics 2011-09-06 Christoph Breunig , Jan Johannes

We study the minimax estimation of $\alpha$-divergences between discrete distributions for integer $\alpha\ge 1$, which include the Kullback--Leibler divergence and the $\chi^2$-divergences as special examples. Dropping the usual…

Information Theory · Computer Science 2021-03-04 Yanjun Han , Jiantao Jiao , Tsachy Weissman

We establish minimax optimal rates of convergence for nonparametric estimation in functional ANOVA models when data from first-order partial derivatives are available. Our results reveal that partial derivatives can improve convergence…

Statistics Theory · Mathematics 2017-09-12 Xiaowu Dai , Peter Chien

We study the problem of estimating the joint probability mass function (pmf) over two random variables. In particular, the estimation is based on the observation of $m$ samples containing both variables and $n$ samples missing one fixed…

Statistics Theory · Mathematics 2024-05-16 Hasan Sabri Melihcan Erol , Lizhong Zheng

In this paper, we derive minimax rates for estimating both parametric and nonparametric components in partially linear additive models with high dimensional sparse vectors and smooth functional components. The minimax lower bound for…

Statistics Theory · Mathematics 2018-01-16 Zhuqing Yu , Michael Levine , Guang Cheng

The present paper considers a problem of estimating a linear functional $\Phi=\int_{-\infty}^\infty \varphi(x) f(x)dx$ of an unknown deconvolution density $f$ on the basis of i.i.d. observations $Y_i = \theta_i + \xi_i$ where $\xi_i$ has a…

Statistics Theory · Mathematics 2015-05-19 Marianna Pensky

We study the rates of estimation of finite mixing distributions, that is, the parameters of the mixture. We prove that under some regularity and strong identifiability conditions, around a given mixing distribution with $m_0$ components,…

Statistics Theory · Mathematics 2015-07-16 Philippe Heinrich , Jonas Kahn

It is well known that estimating the expectation of any given bounded random variable with values in $[-B, B]$ has a sample complexity of $\mathrm{O}(B^2/\epsilon^2)$ that is independent of the underlying probability measure. We show that…

Optimization and Control · Mathematics 2026-04-29 Yan Li

This paper presents a tractable algorithm for estimating an unknown Lipschitz function from noisy observations and establishes an upper bound on its convergence rate. The approach extends max-affine methods from convex shape-restricted…

Machine Learning · Statistics 2025-11-20 Gábor Balázs

We propose and analyze an a posteriori error estimator for a PDE-constrained optimization problem involving a nondifferentiable cost functional, fractional diffusion, and control-constraints. We realize fractional diffusion as the…

Numerical Analysis · Mathematics 2019-06-04 Enrique Otarola

Estimators derived from a divergence criterion such as $\varphi-$divergences are generally more robust than the maximum likelihood ones. We are interested in particular in the so-called MD$\varphi$DE, an estimator built using a dual…

Computation · Statistics 2016-06-14 Diaa Al Mohamad , Michel Broniatowski

The main purpose of this paper is to introduce and study the behavior of minimum {\phi}-divergence estimators as an alternative to the maximum likelihood estimator in latent class models for binary items. As it will become clear below,…

Methodology · Statistics 2014-06-03 Ángel Felipe , Pedro Miranda , Leandro Pardo

In this paper, we consider a functional linear regression model, where both the covariate and the response variable are functional random variables. We address the problem of optimal nonparametric estimation of the conditional expectation…

Statistics Theory · Mathematics 2022-03-02 Gaëlle Chagny , Anouar Meynaoui , Angelina Roche

Motivated by applications in genomics, this paper studies the problem of optimal estimation of a quadratic functional of two normal mean vectors, $Q(\mu, \theta) = \frac{1}{n}\sum_{i=1}^n\mu_i^2\theta_i^2$, with a particular focus on the…

Statistics Theory · Mathematics 2015-05-08 T. Tony Cai , Xin Lu Tan

We study the problem of aggregation of estimators when the estimators are not independent of the data used for aggregation and no sample splitting is allowed. If the estimators are deterministic vectors, it is well known that the minimax…

Statistics Theory · Mathematics 2018-03-01 Pierre C. Bellec

In min-min optimization or max-min optimization, one has to compute the gradient of a function defined as a minimum. In most cases, the minimum has no closed-form, and an approximation is obtained via an iterative algorithm. There are two…

Machine Learning · Statistics 2020-02-11 Pierre Ablin , Gabriel Peyré , Thomas Moreau
‹ Prev 1 2 3 10 Next ›