中文
相关论文

相关论文: Minimax Optimal Estimators for Additive Scalar Fun…

200 篇论文

This work studies the computational aspects of multivariate convex regression in dimensions $d \ge 5$. Our results include the \emph{first} estimators that are minimax optimal (up to logarithmic factors) with polynomial runtime in the…

统计理论 · 数学 2025-12-30 Gil Kur , Eli Putterman

We study the fundamental problem of estimating an unknown discrete distribution $p$ over $d$ symbols, given $n$ i.i.d. samples from the distribution. We are interested in minimizing the KL divergence between the true distribution and the…

机器学习 · 统计学 2025-05-30 Jiayuan Ye , Vitaly Feldman , Kunal Talwar

Consider nonparametric function estimation under $L^p$-loss. The minimax rate for estimation of the regression function over a H\"older ball with smoothness index $\beta$ is $n^{-\beta/(2\beta+1)}$ if $1\leq p<\infty$ and $(n/\log…

统计理论 · 数学 2015-02-10 Johannes Schmidt-Hieber

Given a large number of covariates $Z$, we consider the estimation of a high-dimensional parameter $\theta$ in an individualized linear threshold $\theta^T Z$ for a continuous variable $X$, which minimizes the disagreement between…

统计理论 · 数学 2019-05-28 Huijie Feng , Yang Ning , Jiwei Zhao

The Dirichlet distribution, also known as multivariate beta, is the most used to analyse frequencies or proportions data. Maximum likelihood is widespread for estimation of Dirichlet's parameters. However, for small sample sizes, the…

统计方法学 · 统计学 2021-03-04 Vincenzo Gioia , Euloge Clovis Kenne Pagui

The subject of this paper is the problem of nonparametric estimation of a continuous distribution function from observations with measurement errors. We study minimax complexity of this problem when unknown distribution has a density…

统计理论 · 数学 2012-02-27 I. Dattner , A. Goldenshluger , A. Juditsky

Motivated by portfolio allocation and linear discriminant analysis, we consider estimating a functional $\mathbf{\mu}^T \mathbf{\Sigma}^{-1} \mathbf{\mu}$ involving both the mean vector $\mathbf{\mu}$ and covariance matrix…

统计理论 · 数学 2021-02-12 Jianqing Fan , Haolei Weng , Yifeng Zhou

Inferring a diffusion equation from discretely-observed measurements is a statistical challenge of significant importance in a variety of fields, from single-molecule tracking in biophysical systems to modeling financial instruments.…

机器学习 · 统计学 2023-12-12 Yinuo Ren , Yiping Lu , Lexing Ying , Grant M. Rotskoff

Distribution regression seeks to estimate the conditional distribution of a multivariate response given a continuous covariate. This approach offers a more complete characterization of dependence than traditional regression methods.…

统计理论 · 数学 2025-06-10 Rong Tang , Yun Yang

Many applications, including natural language processing, sensor networks, collaborative filtering, and federated learning, call for estimating discrete distributions from data collected in batches, some of which may be untrustworthy,…

机器学习 · 计算机科学 2020-02-26 Ayush Jain , Alon Orlitsky

Consider the problem of estimating the Shannon entropy of a distribution over $k$ elements from $n$ independent samples. We show that the minimax mean-square error is within universal multiplicative constant factors of $$\Big(\frac{k }{n…

信息论 · 计算机科学 2016-02-19 Yihong Wu , Pengkun Yang

We propose and analyze a reliable and efficient a posteriori error estimator for the pointwise tracking optimal control problem of the Stokes equations. This linear-quadratic optimal control problem entails the minimization of a cost…

数值分析 · 数学 2018-10-08 Alejandro Allendes , Francisco Fuica , Enrique Otárola , Daniel Quero

We derive globally reliable a posteriori error estimators for a PDE-constrained optimization problem involving linear models in fluid dynamics as state equation; control constraints are also considered. The corresponding local error…

数值分析 · 数学 2017-08-03 Alejandro Allendes , Enrique Otarola , Richard Rankin

Let $\{P_{\theta}:\theta \in {\mathbb R}^d\}$ be a log-concave location family with $P_{\theta}(dx)=e^{-V(x-\theta)}dx,$ where $V:{\mathbb R}^d\mapsto {\mathbb R}$ is a known convex function and let $X_1,\dots, X_n$ be i.i.d. r.v. sampled…

统计理论 · 数学 2021-08-03 Vladimir Koltchinskii , Martin Wahl

The non-smooth finite-sum minimization is a fundamental problem in machine learning. This paper develops a distributed stochastic proximal-gradient algorithm with random reshuffling to solve the finite-sum minimization over time-varying…

最优化与控制 · 数学 2022-10-11 Xia Jiang , Xianlin Zeng , Jian Sun , Jie Chen , Lihua Xie

Using some simple combinatorial arguments, we establish some new estimates for the prime counting function and its allied functions. In particular we show that \begin{align}\pi(x)=\Theta(x)+O\bigg(\frac{1}{\log x}\bigg), \nonumber…

数论 · 数学 2021-08-24 Theophilus Agama

This paper establishes a strict mathematical relationship between an arbitrary continuous function on a compact set and its global minima, like the well-known first order optimality condition for convex and differentiable functions. By…

最优化与控制 · 数学 2019-05-27 Xiaopeng Luo

We present a new finite-sample analysis of M-estimators of locations in $\mathbb{R}^d$ using the tool of the influence function. In particular, we show that the deviations of an M-estimator can be controlled thanks to its influence function…

统计理论 · 数学 2022-08-23 Timothée Mathieu

We consider estimation in a sparse additive regression model with the design points on a regular lattice. We establish the minimax convergence rates over Sobolev classes and propose a Fourier-based rate-optimal estimator which is adaptive…

统计理论 · 数学 2014-04-02 Felix Abramovich , Tal Lahav

We consider the problem of estimating the value of a linear functional in nonparametric instrumental regression, where in the presence of an instrument W a response Y is modeled in dependence of an endogenous explanatory variable Z. The…

统计理论 · 数学 2009-02-13 Christoph Breunig , Jan Johannes