English
Related papers

Related papers: The Minimum S-Divergence Estimator under Continuou…

200 papers

Indirect inference estimators (i.e., simulation-based minimum distance estimators) in a parametric model that are based on auxiliary non-parametric maximum likelihood density estimators are shown to be asymptotically normal. If the…

Statistics Theory · Mathematics 2012-01-24 Florian Gach , Benedikt M. Pötscher

The aim of this paper is to present a new estimation procedure that can be applied in many statistical frameworks including density and regression and which leads to both robust and optimal (or nearly optimal) estimators. In density…

Statistics Theory · Mathematics 2017-01-23 Yannick Baraud , Lucien Birgé , Mathieu Sart

When maximum likelihood estimation is infeasible, one often turns to score matching, contrastive divergence, or minimum probability flow to obtain tractable parameter estimates. We provide a unifying perspective of these techniques as…

Statistics Theory · Mathematics 2022-10-07 Alessandro Barp , Francois-Xavier Briol , Andrew B. Duncan , Mark Girolami , Lester Mackey

We propose a general approach to construct weighted likelihood estimating equations with the aim of obtaining robust parameter estimates. We modify the standard likelihood equations by incorporating a weight that reflects the statistical…

Statistics Theory · Mathematics 2025-07-24 Claudio Agostinelli , Ayanendranath Basu , Giulia Bertagnolli , Arun Kumar Kuchibhotla

We present a robust test for composite null hypothesis based on the general $S$-divergence family. This requires a non-trivial extension of the results of Ghosh et al.~(2015). We derive the asymptotic and theoretical robustness properties…

Statistics Theory · Mathematics 2016-07-04 Abhik Ghosh , Ayanendranath Basu

We consider an extension of $\epsilon$-entropy to a KL-divergence based complexity measure for randomized density estimation methods. Based on this extension, we develop a general information-theoretical inequality that measures the…

Statistics Theory · Mathematics 2007-06-13 Tong Zhang

This paper develops robust inference methods for predictive regressions that address key challenges posed by endogenously persistent or heavy-tailed regressors, as well as persistent volatility in errors. Building on the Cauchy estimation…

Econometrics · Economics 2026-04-21 Rustam Ibragimov , Jihyun Kim , Anton Skrobotov

Empirical Bayes small area estimation based on the well-known Fay-Herriot model may produce unreliable estimates when outlying areas exist. Existing robust methods against outliers or model misspecification are generally inefficient when…

Methodology · Statistics 2022-06-28 Daisuke Kurisu , Takuya Ishihara , Shonosuke Sugasawa

Discrete diffusion models have recently gained significant prominence in applications involving natural language and graph data. A key factor influencing their effectiveness is the efficiency of discretized samplers. Among these,…

Machine Learning · Computer Science 2025-11-03 Yuchen Liang , Yingbin Liang , Lifeng Lai , Ness Shroff

This paper introduces a robust estimation framework based solely on the copula function. We begin by introducing a family of divergence measures tailored for copulas, including the \(\alpha\)-, \(\beta\)-, and \(\gamma\)-copula divergences,…

Methodology · Statistics 2025-09-18 Shinto Eguchi , Shogo Kato

The association between a continuous and an ordinal variable is commonly modeled through the polyserial correlation model. However, this model, which is based on a partially-latent normality assumption, may be misspecified in practice, due…

Methodology · Statistics 2026-02-11 Max Welz

This paper proposes minimum distance inference for a structural parameter of interest, which is robust to the lack of identification of other structural nuisance parameters. Some choices of the weighting matrix lead to asymptotic…

Econometrics · Economics 2023-10-10 Joan Alegre , Juan Carlos Escanciano

This paper studies density estimation and regression analysis with contaminated data observed on the unit hypersphere S^d. Our methodology and theory are based on harmonic analysis on general S^d. We establish novel nonparametric density…

Statistics Theory · Mathematics 2023-01-10 Jeong Min Jeon , Ingrid Van Keilegom

We give a comprehensive theoretical characterization of a nonparametric estimator for the $L_2^2$ divergence between two continuous distributions. We first bound the rate of convergence of our estimator, showing that it is…

Machine Learning · Statistics 2014-10-31 Akshay Krishnamurthy , Kirthevasan Kandasamy , Barnabas Poczos , Larry Wasserman

Cox proportional hazard regression model is a popular tool to analyze the relationship between a censored lifetime variable with other relevant factors. The semi-parametric Cox model is widely used to study different types of data arising…

Methodology · Statistics 2018-10-09 Abhik Ghosh , Ayanendranath Basu

National statistical institutes in many countries are now mandated to produce reliable statistics for important variables such as population, income, unemployment, health outcomes, etc. for small areas, defined by geography and/or…

Methodology · Statistics 2018-10-29 Adrijo Chakraborty , Gauri Sankar Datta , Abhyuday Mandal

The stochastic gradient descent (SGD) algorithm has been widely used in statistical estimation for large-scale data due to its computational and memory efficiency. While most existing works focus on the convergence of the objective function…

Machine Learning · Statistics 2023-11-02 Xi Chen , Jason D. Lee , Xin T. Tong , Yichen Zhang

It is well known that the minimax rates of convergence of nonparametric density and regression function estimation of a random variable measured with error is much slower than the rate in the error free case. Surprisingly, we show that if…

Statistics Theory · Mathematics 2019-08-21 Fei Jiang , Yanyuan Ma , Raymond J. Carroll

The density band model proposed by Kassam for robust hypothesis testing is revisited in this paper. First, a novel criterion for the general characterization of least favorable distributions is proposed, which unifies existing results. This…

Information Theory · Computer Science 2018-03-05 Michael Fauß , Abdelhak M. Zoubir

Analysis of random censored life-time data along with some related stochastic covariables is of great importance in many applied sciences like medical research, population studies and planning etc. The parametric estimation technique…

Statistics Theory · Mathematics 2019-05-09 Abhik Ghosh , Ayanendranath Basu