English
Related papers

Related papers: Minimax Optimal Additive Functional Estimation wit…

200 papers

Consider the problem of estimating the Shannon entropy of a distribution over $k$ elements from $n$ independent samples. We show that the minimax mean-square error is within universal multiplicative constant factors of $$\Big(\frac{k }{n…

Information Theory · Computer Science 2016-02-19 Yihong Wu , Pengkun Yang

We consider estimation of a step function $f$ from noisy observations of a deconvolution $\phi*f$, where $\phi$ is some bounded $L_1$-function. We use a penalized least squares estimator to reconstruct the signal $f$ from the observations,…

Statistics Theory · Mathematics 2008-12-18 Leif Boysen , Axel Munk

Sparse additive models are an attractive choice in circumstances calling for modelling flexibility in the face of high dimensionality. We study the signal detection problem and establish the minimax separation rate for the detection of a…

Statistics Theory · Mathematics 2024-10-03 Subhodh Kotekal , Chao Gao

The problem of optimal estimation of functionals $A\xi =\sum\nolimits_{k=0}^{\infty }{}a(k)\xi (k)$ and ${{A}_{N}}\xi =\sum\nolimits_{k=0}^{N}{}a(k)\xi (k)$ which depend on the unknown values of stochastic sequence $\xi (k)$ with stationary…

Statistics Theory · Mathematics 2025-10-21 Maksym Luz , Mykhailo Moklyachuk

We study the problem of aggregation of estimators when the estimators are not independent of the data used for aggregation and no sample splitting is allowed. If the estimators are deterministic vectors, it is well known that the minimax…

Statistics Theory · Mathematics 2018-03-01 Pierre C. Bellec

The Dirichlet distribution, also known as multivariate beta, is the most used to analyse frequencies or proportions data. Maximum likelihood is widespread for estimation of Dirichlet's parameters. However, for small sample sizes, the…

Methodology · Statistics 2021-03-04 Vincenzo Gioia , Euloge Clovis Kenne Pagui

Given $n$ i.i.d. observations, we study the problem of estimating the spectrum of weighted Laplace operators of the form $\Delta_f=\Delta + \alpha \nabla \log f\cdot \nabla$, where $f$ is a positive probability density on a known compact…

Statistics Theory · Mathematics 2025-12-01 Yann Chaubet , Vincent Divol

Given a large number of covariates $Z$, we consider the estimation of a high-dimensional parameter $\theta$ in an individualized linear threshold $\theta^T Z$ for a continuous variable $X$, which minimizes the disagreement between…

Statistics Theory · Mathematics 2019-05-28 Huijie Feng , Yang Ning , Jiwei Zhao

This paper studies an asymptotic framework for conducting inference on parameters of the form $\phi(\theta_0)$, where $\phi$ is a known directionally differentiable function and $\theta_0$ is estimated by $\hat \theta_n$. In these settings,…

Statistics Theory · Mathematics 2016-01-14 Zheng Fang , Andres Santos

A new analytical approximation function is proposed to accurately fit the solution of a fractional differential equation of order one-half, whose nonhomogeneous term is defined by a modified Bessel function of the first kind. The exact…

General Mathematics · Mathematics 2025-12-03 Byron Droguett , Pablo Martin , Eduardo Rojas , Jorge Olivares

In this paper, we study communication efficient distributed algorithms for distributionally robust federated learning via periodic averaging with adaptive sampling. In contrast to standard empirical risk minimization, due to the minimax…

Machine Learning · Computer Science 2021-02-26 Yuyang Deng , Mohammad Mahdi Kamani , Mehrdad Mahdavi

For nonparametric regression with one-sided errors and a boundary curve model for Poisson point processes we consider the problem of efficient estimation for linear functionals. The minimax optimal rate is obtained by an unbiased estimation…

Statistics Theory · Mathematics 2015-09-25 Markus Reiß , Leonie Selk

This paper presents an accelerated proximal gradient method for multiobjective optimization, in which each objective function is the sum of a continuously differentiable, convex function and a closed, proper, convex function. Extending…

Optimization and Control · Mathematics 2023-06-08 Hiroki Tanabe , Ellen H. Fukuda , Nobuo Yamashita

We consider two nonparametric procedures for estimating a concave distribution function based on data corrupted with additive noise generated by a bounded decreasing density on $(0,\infty)$. For the maximum likelihood (ML) estimator and…

Statistics Theory · Mathematics 2009-04-02 Geurt Jongbloed , Frank H. van der Meulen

The functional generalized additive model (FGAM) provides a more flexible nonlinear functional regression model than the well-studied functional linear regression model. This paper restricts attention to the FGAM with identity link and…

Statistics Theory · Mathematics 2013-01-22 Xiao Wang , David Ruppert

Covariate shift occurs when the distribution of input features differs between the training and testing phases. In covariate shift, estimating an unknown function's moment is a classical problem that remains under-explored, despite its…

Machine Learning · Statistics 2025-07-01 Zhen Zhang , Xin Liu , Shaoli Wang , Jiaye Teng

In this paper, we study the optimal convergence rate for distributed convex optimization problems in networks. We model the communication restrictions imposed by the network as a set of affine constraints and provide optimal complexity…

Optimization and Control · Mathematics 2018-11-16 César A. Uribe , Soomin Lee , Alexander Gasnikov , Angelia Nedić

We analyze a stochastic approximation algorithm for decision-dependent problems, wherein the data distribution used by the algorithm evolves along the iterate sequence. The primary examples of such problems appear in performative prediction…

Optimization and Control · Mathematics 2024-05-15 Joshua Cutler , Mateo Díaz , Dmitriy Drusvyatskiy

We analyze the problem of discrete distribution estimation under $\ell_1$ loss. We provide non-asymptotic upper and lower bounds on the maximum risk of the empirical distribution (the maximum likelihood estimator), and the minimax risk in…

Information Theory · Computer Science 2015-12-31 Yanjun Han , Jiantao Jiao , Tsachy Weissman

Accurate rational approximations of the Fermi-Dirac distribution are a useful component in many numerical algorithms for electronic structure calculations. The best known approximations use $O( \log (\beta \Delta) \log (\epsilon^{-1}))$…

Computational Physics · Physics 2016-11-11 Jonathan E. Moussa
‹ Prev 1 3 4 5 6 7 10 Next ›