English
Related papers

Related papers: Exponential Consistency of M-estimators in General…

200 papers

It has been repeatedly stated that maximum likelihood (ML) estimates of exponents of power-law distributions can only be reliably obtained for exponents smaller than minus one. The main argument that power laws are otherwise not…

Data Analysis, Statistics and Probability · Physics 2017-04-12 Rudolf Hanel , Bernat Corominas-Murtra , Bo Liu , Stefan Thurner

A fundamental problem in statistics is estimating the shape matrix of an Elliptical distribution. This generalizes the familiar problem of Gaussian covariance estimation, for which the sample covariance achieves optimal estimation error.…

Statistics Theory · Mathematics 2025-10-16 Lap Chi Lau , Akshay Ramachandran

Regularized M-estimators are used in diverse areas of science and engineering to fit high-dimensional models with some low-dimensional structure. Usually the low-dimensional structure is encoded by the presence of the (unknown) parameters…

Statistics Theory · Mathematics 2014-10-14 Jason D. Lee , Yuekai Sun , Jonathan E. Taylor

The analysis of extremal dependence in high dimensions has recently attracted considerable interest. Existing methodology primarily focuses on modeling and estimation of extremal dependence structures, often supported by concentration…

Statistics Theory · Mathematics 2026-04-02 Axel Bücher , Yeonjoon Choi , Katharina Effertz , Stanislav Volgushev

A large dimensional characterization of robust M-estimators of covariance (or scatter) is provided under the assumption that the dataset comprises independent (essentially Gaussian) legitimate samples as well as arbitrary deterministic…

Statistics Theory · Mathematics 2015-10-28 David Morales-Jimenez , Romain Couillet , Matthew R. McKay

In this article, we present the maximum weighted likelihood estimator (MWLE) for robust estimations of heavy-tail finite mixture models (FMM). This is motivated by the complex distributional phenomena of insurance claim severity data, where…

Methodology · Statistics 2021-08-04 Tsz Chai Fung

We give answer to an open problem regarding consistency of the maximum likelihood estimators (MLEs) in generalized linear mixed models (GLMMs) involving crossed random effects. The solution to the open problem introduces an interesting,…

Statistics Theory · Mathematics 2013-03-13 Jiming Jiang

This paper considers maximum likelihood (ML) estimation in a large class of models with hidden Markov regimes. We investigate consistency of the ML estimator and local asymptotic normality for the models under general conditions which allow…

Statistics Theory · Mathematics 2021-12-07 Demian Pouzo , Zacharias Psaradakis , Martin Sola

We mainly study the M-estimation method for the high-dimensional linear regression model, and discuss the properties of M-estimator when the penalty term is the local linear approximation. In fact, M-estimation method is a framework, which…

Probability · Mathematics 2018-10-31 Kai Wang , Yanling Zhu

Generalized linear models (GLMs) form one of the most popular classes of models in statistics. The gamma variant is used, for instance, in actuarial science for the modelling of claim amounts in insurance. A flaw of GLMs is that they are…

Methodology · Statistics 2024-02-12 Philippe Gagnon , Yuxi Wang

We consider the estimation of the mixing distribution of a normal distribution where both the shift and scale are unobserved random variables. We argue that in general, the model is not identifiable. We give an elegant non-constructive…

Statistics Theory · Mathematics 2024-08-20 Ya'acov Ritov

Multivariate normal mixtures provide a flexible model for high-dimensional data. They are widely used in statistical genetics, statistical finance, and other disciplines. Due to the unboundedness of the likelihood function, classical…

Statistics Theory · Mathematics 2008-05-27 Jiahua Chen , Xianming Tan

The consistency of the maximum likelihood estimator for mixtures of elliptically-symmetric distributions for estimating its population version is shown, where the underlying distribution $P$ is nonparametric and does not necessarily belong…

Statistics Theory · Mathematics 2024-10-14 Pietro Coretto , Christian Hennig

We benchmark the robustness of maximum likelihood based uncertainty estimation methods to outliers in training data for regression tasks. Outliers or noisy labels in training data results in degraded performances as well as incorrect…

Machine Learning · Computer Science 2022-02-09 Deebul S. Nair , Nico Hochgeschwender , Miguel A. Olivares-Mendez

The maximum likelihood principle is widely used in statistics, and the associated estimators often display good properties. indeed maximum likelihood estimators are guaranteed to be asymptotically efficient under mild conditions. However in…

Statistics Theory · Mathematics 2016-12-01 Christophe Culan , Claude Adnet

Multivariate extreme value statistical analysis is concerned with observations on several variables which are thought to possess some degree of tail-dependence. In areas such as the modeling of financial and insurance risks, or as the…

Applications · Statistics 2014-12-31 Alexis Bienvenüe , Christian Y. Robert

A recent article on generalised linear mixed model asymptotics, Jiang et al. (2022), derived the rates of convergence for the asymptotic variances of maximum likelihood estimators. If $m$ denotes the number of groups and $n$ is the average…

Statistics Theory · Mathematics 2023-04-03 Luca Maestrini , Aishwarya Bhaskaran , Matt P. Wand

In this work, we revisit outlier hypothesis testing and propose exponentially consistent, low-complexity fixed-length tests that achieve a better tradeoff between detection performance and computational complexity than existing…

Signal Processing · Electrical Eng. & Systems 2026-01-28 Lina Zhu , Lin Zhou

The inflated beta regression model is widely used for modeling continuous proportions with values at the boundaries. Maximum likelihood estimation for these models is well-known for its sensitivity to outliers, which can severely distort…

Methodology · Statistics 2026-05-15 Francisco Felipe Queiroz , Silvia Lopes de Paula Ferrari

A new type of redescending M-estimators is constructed, based on data augmentation with an unspecified outlier model. Necessary and sufficient conditions for the convergence of the resulting estimators to the Hubertype skipped mean are…

Methodology · Statistics 2010-06-21 Rudolf Frühwirth , Wolfgang Waltenberger