English
Related papers

Related papers: Minimum Hellinger Distance Estimators for Complex …

200 papers

We give new data-dependent locality sensitive hashing schemes (LSH) for the Earth Mover's Distance ($\mathsf{EMD}$), and as a result, improve the best approximation for nearest neighbor search under $\mathsf{EMD}$ by a quadratic factor.…

Data Structures and Algorithms · Computer Science 2024-03-11 Rajesh Jayaram , Erik Waingarten , Tian Zhang

M-estimators offer simple robust alternatives to the maximum likelihood estimator. Much of the robustness literature, however, has focused on the problems of location, location-scale and regression estimation rather than on estimation of…

Methodology · Statistics 2017-06-20 Arun Kumar Kuchibhotla , Somabha Mukherjee , Ayanendranath Basu

We propose a new framework of variance-reduced Hamiltonian Monte Carlo (HMC) methods for sampling from an $L$-smooth and $m$-strongly log-concave distribution, based on a unified formulation of biased and unbiased variance reduction…

Machine Learning · Computer Science 2021-02-10 Zhengmian Hu , Feihu Huang , Heng Huang

Sparse polynomial approximation has become indispensable for approximating smooth, high- or infinite-dimensional functions from limited samples. This is a key task in computational science and engineering, e.g., surrogate modelling in…

Numerical Analysis · Mathematics 2023-11-08 Ben Adcock , Simone Brugiapaglia , Nick Dexter , Sebastian Moraga

We develop a divergence-minimization (DM) framework for robust and efficient inference in latent-mixture models. By optimizing a residual-adjusted divergence, the DM approach recovers EM as a special case and yields robust alternatives…

Statistics Theory · Mathematics 2025-11-25 Lei Li , Anand N. Vidyashankar

This paper develops a new family of estimators, the minimum density power divergence estimators (MDPDEs), for the parameters of the one-shot device model as well as a new family of test statistics, Z-type test statistics based on MDPDEs,…

Methodology · Statistics 2017-04-27 N. Balakrishnan , E. Castilla , N. Martin , L. Pardo

While likelihood-based inference and its variants provide a statistically efficient and widely applicable approach to parametric inference, their application to models involving intractable likelihoods poses challenges. In this work, we…

Methodology · Statistics 2019-06-17 Francois-Xavier Briol , Alessandro Barp , Andrew B. Duncan , Mark Girolami

The ongoing discrepancy in the Hubble constant ($H_0$) estimates obtained through local distance ladder methods and early universe observations poses a significant challenge to the $\Lambda$CDM model, suggesting potential new physics. Type…

The aim of this paper is to present a new estimation procedure that can be applied in many statistical frameworks including density and regression and which leads to both robust and optimal (or nearly optimal) estimators. In density…

Statistics Theory · Mathematics 2017-01-23 Yannick Baraud , Lucien Birgé , Mathieu Sart

The semi-parametric Cox proportional hazards regression model has been widely used for many years in several applied sciences. However, a fully parametric proportional hazards model, if appropriately assumed, can often lead to more…

Methodology · Statistics 2020-09-29 Amarnath Nandy , Abhik Ghosh , Ayanendranath Basu , Leandro Pardo

Efficient Bayesian model selection relies on the model evidence or marginal likelihood, whose computation often requires evaluating an intractable integral. The harmonic mean estimator (HME) has long been a standard method of approximating…

Computation · Statistics 2025-12-23 Dana Naderi , Christian P Robert , Kaniav Kamary , Darren Wraith

Robust design is one of the main tools employed by engineers for the facilitation of the design of high-quality processes. However, most real-world processes invariably contend with external uncontrollable factors, often denoted as outliers…

Methodology · Statistics 2023-09-12 Xuehong Gao , Zhijin Chen , Bosung Kim , Chanseok Park

Towards understanding the fundamental limits of estimation from data of varied quality, we study the problem of estimating a mean parameter from heteroskedastic Gaussian observations where the variances are unknown and may vary arbitrarily…

Statistics Theory · Mathematics 2026-03-17 Yanjun Han , Abhishek Shetty , Jacob Shkrob

This paper explores Maximum Likelihood in parametric models in the context of Sanov type Large Deviation Probabilities. MLE in parametric models under weighted sampling is shown to be associated with the minimization of a specific…

Methodology · Statistics 2012-07-30 Michel Broniatowski , Zhansheng Cao

We present theoretical properties of the log-concave maximum likelihood estimator of a density based on an independent and identically distributed sample in $\mathbb{R}^d$. Our study covers both the case where the true underlying density is…

Statistics Theory · Mathematics 2009-09-01 Madeleine Cule , Richard Samworth

In this study, we present a sophisticated hybrid machine-learning framework that significantly improves the accuracy of predicting hydrogen storage capacities in metal hydrides. This is a critical challenge due to the scarcity of…

Materials Science · Physics 2024-08-29 Satadeep Bhattacharjee , Pritam Das , Swetarekha Ram , Seung-Cheol Lee

Estimators derived from a divergence criterion such as $\varphi-$divergences are generally more robust than the maximum likelihood ones. We are interested in particular in the so-called MD$\varphi$DE, an estimator built using a dual…

Computation · Statistics 2016-06-14 Diaa Al Mohamad , Michel Broniatowski

In this paper we prove the optimality of an aggregation procedure. We prove lower bounds for aggregation of model selection type of $M$ density estimators for the Kullback-Leiber divergence (KL), the Hellinger's distance and the…

Statistics Theory · Mathematics 2016-08-16 Guillaume Lecué

Many works in statistics aim at designing a universal estimation procedure, that is, an estimator that would converge to the best approximation of the (unknown) data generating distribution in a model, without any assumption on this…

Statistics Theory · Mathematics 2025-02-14 Badr-Eddine Chérief-Abdellatif , Pierre Alquier

Adaptive experimental designs have gained popularity in clinical trials and online experiments. Unlike traditional, fixed experimental designs, adaptive designs can dynamically adjust treatment randomization probabilities and other design…

Methodology · Statistics 2025-08-19 Wenxin Zhang , Mark van der Laan