English
Related papers

Related papers: Adaptive and minimax optimal estimation of the tai…

200 papers

A common bottleneck in evaluating extremal performance measures is that, due to their very nature, tail data are often very limited. The conventional approach selects the best probability distribution from tail data using parametric…

Computation · Statistics 2018-01-03 Henry Lam , Clementine Mottet

We provide optimal lower bounds for two well-known parameter estimation (also known as statistical estimation) tasks in high dimensions with approximate differential privacy. First, we prove that for any $\alpha \le O(1)$, estimating the…

Statistics Theory · Mathematics 2024-01-05 Shyam Narayanan

We use the fitted Pareto law to construct an accompanying approximation of the excess distribution function. A selection rule of the location of the excess distribution function is proposed based on a stagewise lack-of-fit testing…

Statistics Theory · Mathematics 2008-08-08 Ion Grama , Vladimir Spokoiny

We discuss the problem of adaptive discrete-time signal denoising in the situation where the signal to be recovered admits a "linear oracle" -- an unknown linear estimate that takes the form of convolution of observations with a…

Statistics Theory · Mathematics 2021-02-15 Zaid Harchaoui , Anatoli Juditsky , Arkadi Nemirovski , Dmitrii Ostrovskii

We consider stationary hidden Markov models with finite state space and nonparametric modeling of the emission distributions. It has remained unknown until very recently that such models are identifiable. In this paper, we propose a new…

Statistics Theory · Mathematics 2015-12-29 Yohann De Castro , Élisabeth Gassiat , Claire Lacour

We propose a rate optimal estimator for the linear regression model on network data with interacted (unobservable) individual effects. The estimator achieves a faster rate of convergence $N$ compared to the standard estimators' $\sqrt{N}$…

Econometrics · Economics 2023-04-26 Yassine Sbai Sassi

We study in this paper the problem of least absolute deviation (LAD) regression for high-dimensional heavy-tailed time series which have finite $\alpha$-th moment with $\alpha \in (1,2]$. To handle the heavy-tailed dependent data, we…

Statistics Theory · Mathematics 2024-11-11 Yu Wang , Guodong Li , Zhijie Xiao , Lihu Xu , Wenyang Zhang

We study the least squares regression function estimator over the class of real-valued functions on $[0,1]^d$ that are increasing in each coordinate. For uniformly bounded signals and with a fixed, cubic lattice design, we establish that…

Statistics Theory · Mathematics 2017-09-01 Qiyang Han , Tengyao Wang , Sabyasachi Chatterjee , Richard J. Samworth

A new estimator is proposed for estimating the tail exponent of a heavy-tailed distribution. This estimator, referred to as the layered Hill estimator, is a generalization of the traditional Hill estimator, building upon a layered structure…

Statistics Theory · Mathematics 2026-04-20 Taegyu Kang , Takashi Owada

We consider a regression framework where the design points are deterministic and the errors possibly non-i.i.d. and heavy-tailed (with a moment of order $p$ in $[1,2]$). Given a class of candidate regression functions, we propose a…

Statistics Theory · Mathematics 2025-06-03 Yannick Baraud , Guillaume Maillard

In this paper, we consider estimators for an additive functional of $\phi$, which is defined as $\theta(P;\phi)=\sum_{i=1}^k\phi(p_i)$, from $n$ i.i.d. random samples drawn from a discrete distribution $P=(p_1,...,p_k)$ with alphabet size…

Information Theory · Computer Science 2017-12-08 Kazuto Fukuchi , Jun Sakuma

Likelihood-based procedures are a common way to estimate tail dependence parameters. They are not applicable, however, in non-differentiable models such as those arising from recent max-linear structural equation models. Moreover, they can…

Methodology · Statistics 2016-01-20 John H. J. Einmahl , Anna Kiriliouk , Johan Segers

We study the asymptotic behavior of the marginal expected shortfall when the two random variables are asymptotic independent but positive associated, which is modeled by the so-called tail dependent coefficient. We construct an estimator of…

Statistics Theory · Mathematics 2017-09-14 Juan-Juan Cai , Eni Musta

In this paper, we study the problem of mean estimation under 1-bit communication constraints. We propose a novel adaptive mean estimator based solely on randomized threshold queries, where each 1-bit outcome indicates whether a given sample…

Machine Learning · Statistics 2026-05-25 Ivan Lau , Jonathan Scarlett

In recent years several attempts have been made to extend tail modelling towards the modal part of the data. Frigessi et al. (2002) introduced dynamic mixtures of two components with a weight function {\pi} = {\pi}(x) smoothly connecting…

Methodology · Statistics 2018-10-03 Jan Beirlant , Gaonyalelwe Maribe , Philippe Naveau , Andrehette Verster

In samples from a heavy-tailed distribution a second-order approximation is often use to approximate the tail function. Based on the parameters of the approximation, an optimal sample fraction can be estimated which is then used to estimate…

Statistics Theory · Mathematics 2016-12-15 J. Martin van Zyl

We consider the problem of estimating an unknown $n_1 \times n_2$ matrix $\mathbf{\theta^*}$ from noisy observations under the constraint that $\mathbf{\theta}^*$ is nondecreasing in both rows and columns. We consider the least squares…

Statistics Theory · Mathematics 2015-11-03 Sabyasachi Chatterjee , Adityanand Guntuboyina , Bodhisattva Sen

We provide a statistical analysis of regularization-based continual learning on a sequence of linear regression tasks, with emphasis on how different regularization terms affect the model performance. We first derive the convergence rate…

Machine Learning · Computer Science 2024-06-11 Xuyang Zhao , Huiyuan Wang , Weiran Huang , Wei Lin

This paper introduces an iterative algorithm for training nonparametric additive models that enjoys favorable memory storage and computational requirements. The algorithm can be viewed as the functional counterpart of stochastic gradient…

Machine Learning · Statistics 2026-01-01 Xin Chen , Jason M. Klusowski

We consider the problem of estimating the partition function $Z(\beta)=\sum_x \exp(\beta(H(x))$ of a Gibbs distribution with the Hamiltonian $H:\Omega\rightarrow\{0\}\cup[1,n]$. As shown in [Harris & Kolmogorov 2024], the log-ratio $q=\ln…

Probability · Mathematics 2026-04-06 David G. Harris , Vladimir Kolmogorov