English
Related papers

Related papers: Delta method in large deviations and moderate devi…

200 papers

A fundamental problem in statistics is estimating the shape matrix of an Elliptical distribution. This generalizes the familiar problem of Gaussian covariance estimation, for which the sample covariance achieves optimal estimation error.…

Statistics Theory · Mathematics 2025-10-16 Lap Chi Lau , Akshay Ramachandran

Bootstrap smoothed (bagged) estimators have been proposed as an improvement on estimators found after preliminary data-based model selection. Efron, 2014, derived a widely applicable formula for a delta method approximation to the standard…

Methodology · Statistics 2019-07-11 Paul Kabaila , Christeen Wijethunga

We study the problem of testing discrete distributions with a focus on the high probability regime. Specifically, given samples from one or more discrete distributions, a property $\mathcal{P}$, and parameters $0< \epsilon, \delta <1$, we…

Data Structures and Algorithms · Computer Science 2020-09-15 Ilias Diakonikolas , Themis Gouleakis , Daniel M. Kane , John Peebles , Eric Price

Modern statistical inference tasks often require iterative optimization methods to compute the solution. Convergence analysis from an optimization viewpoint only informs us how well the solution is approximated numerically but overlooks the…

Machine Learning · Statistics 2020-07-27 Tengyuan Liang , Weijie Su

Motivated by applications to prediction and forecasting, we suggest methods for approximating the conditional distribution function of a random variable Y given a dependent random d-vector X. The idea is to estimate not the distribution of…

Statistics Theory · Mathematics 2007-06-13 Peter Hall , Qiwei Yao

The proliferation of science and technology has led to the prevalence of voluminous data sets that are distributed across multiple machines. It is an established fact that conventional statistical methodologies may be unfeasible in the…

Statistics Theory · Mathematics 2023-10-24 Lu Yan , Jiang Hu

Constructing a differentially private (DP) estimator requires deriving the maximum influence of an observation, which can be difficult in the absence of exogenous bounds on the input data or the estimator, especially in high dimensional…

Machine Learning · Statistics 2022-07-27 Ryan Cumings-Menon

We survey some of the recent advances in mean estimation and regression function estimation. In particular, we describe sub-Gaussian mean estimators for possibly heavy-tailed data both in the univariate and multivariate settings. We focus…

Statistics Theory · Mathematics 2019-06-12 Gabor Lugosi , Shahar Mendelson

Heavy-tailed distributions are widely used in robust mixture modelling due to possessing thick tails. As a computationally tractable subclass of the stable distributions, sub-Gaussian $\alpha$-stable distribution received much interest in…

Machine Learning · Statistics 2017-01-25 Mahdi Teimouri , Saeid Rezakhah , Adel Mohammdpour

Kaplan-Meier estimators are essential tools in survival analysis, capturing the survival behavior of a cohort. Their accuracy improves with large, diverse datasets, encouraging data holders to collaborate for more precise estimations.…

Cryptography and Security · Computer Science 2024-07-30 Shadi Rahimian , Raouf Kerkouche , Ina Kurth , Mario Fritz

Distillation enables compact Vision-Language Models (VLMs) to obtain strong reasoning capabilities, yet the prompts driving this process are typically chosen via simple heuristics or aggregated from off-the-shelf datasets. We reveal a…

Machine Learning · Computer Science 2026-05-20 Jaehun Jung , Hyunwoo Kim , Brandon Cui , Ximing Lu , David Acuna , Prithviraj Ammanabrolu , Yejin Choi

We deduce in this paper the sufficient conditions for weak convergence of centered and normed deviation of the u-statistics with values in the space of the real valued continuous function defined on some compact metric space. We obtain also…

Statistics Theory · Mathematics 2016-08-12 E. Ostrovsky , L. Sirota

The aim of this paper is to present a new estimation procedure that can be applied in many statistical frameworks including density and regression and which leads to both robust and optimal (or nearly optimal) estimators. In density…

Statistics Theory · Mathematics 2017-01-23 Yannick Baraud , Lucien Birgé , Mathieu Sart

To analyse a very large data set containing lengthy variables, we adopt a sequential estimation idea and propose a parallel divide-and-conquer method. We conduct several conventional sequential estimation procedures separately, and properly…

Methodology · Statistics 2018-12-27 Zhanfeng Wang , Yuan-chin Ivan Chang

We consider method-of-quantiles estimators of unknown parameters, namely the analogue of method-of-moments estimators obtained by matching empirical and theoretical quantiles at some probability level lambda in (0,1). The aim is to present…

Statistics Theory · Mathematics 2018-11-20 Valeria Bignozzi , Claudio Macci , Lea Petrella

We apply Lindeberg's method, invented to prove a central limit theorem, to analyze the moderate deviations around such a central limit theorem. In particular, we will show moderate deviation principles for martingales as well as for random…

Probability · Mathematics 2018-10-03 Peter Eichelsbacher , Matthias Löwe

Meta-analysis can be formulated as combining $p$-values across studies into a joint $p$-value function, from which point estimates and confidence intervals can be derived. We extend the meta-analytic estimation framework based on combined…

Methodology · Statistics 2025-10-21 David Kronthaler , Leonhard Held

This article discusses modelling of the tail of a multivariate distribution function by means of a large deviation principle (LDP), and its application to the estimation of the probability of a multivariate extreme event from a sample of n…

Statistics Theory · Mathematics 2017-02-23 Cees de Valk

The era of big data is coming, and evidence-based medicine is attracting increasing attention to improve decision making in medical practice via integrating evidence from well designed and conducted clinical research. Meta-analysis is a…

Methodology · Statistics 2016-10-05 Dehui Luo , Xiang Wan , Jiming Liu , Tiejun Tong

We introduce principal differences analysis (PDA) for analyzing differences between high-dimensional distributions. The method operates by finding the projection that maximizes the Wasserstein divergence between the resulting univariate…

Machine Learning · Statistics 2017-05-03 Jonas Mueller , Tommi Jaakkola