English
Related papers

Related papers: Asymptotics of Monte Carlo maximum likelihood esti…

200 papers

We present general principles for the design and analysis of unbiased Monte Carlo estimators in a wide range of settings. Our estimators posses finite work-normalized variance under mild regularity conditions. We apply our estimators to…

Statistics Theory · Mathematics 2019-04-23 Jose H. Blanchet , Peter W. Glynn , Yanan Pei

In this paper, we propose an estimator of the generalized maximum mean discrepancy between several distributions, constructed by modifying a naive estimator. Asymptotic normality is obtained for this estimator both under equality of these…

Statistics Theory · Mathematics 2020-03-13 Armando Sosthene Kali Balogoun , Guy Martial Nkiet , Carlos Ogouyandjou

A variety of estimators for the parameters of the Generalized Pareto distribution, the approximating distribution for excesses over a high threshold, have been proposed, always assuming the underlying data to be independent. We recently…

Applications · Statistics 2016-05-26 Lukas Martig , Jürg Hüsler

We have shown in previous work that statistical inference for cooperative sequential adsorption model can be based on maximum likelihood estimation. In this paper we continue this research and establish asymptotic normality of the maximum…

Statistics Theory · Mathematics 2010-05-14 Mathew D. Penrose , Vadim Shcherbakov

We describe Monte Carlo methods for estimating lower envelopes of expectations of real random variables. We prove that the estimation bias is negative and that its absolute value shrinks with increasing sample size. We discuss fairly…

Probability · Mathematics 2019-09-02 Arne Decadt , Gert de Cooman , Jasper De Bock

Variational methods for parameter estimation are an active research area, potentially offering computationally tractable heuristics with theoretical performance bounds. We build on recent work that applies such methods to network data, and…

Statistics Theory · Mathematics 2013-10-30 Peter Bickel , David Choi , Xiangyu Chang , Hai Zhang

The maximum likelihood estimator (MLE) is pivotal in statistical inference, yet its application is often hindered by the absence of closed-form solutions for many models. This poses challenges in real-time computation scenarios,…

Methodology · Statistics 2025-04-16 Pedro L. Ramos , Eduardo Ramos , Francisco A. Rodrigues , Francisco Louzada

A statistical model is said to be un-normalised when its likelihood function involves an intractable normalising constant. Two popular methods for parameter inference for these models are MC-MLE (Monte Carlo maximum likelihood estimation),…

Statistics Theory · Mathematics 2018-02-01 Lionel Riou-Durand , Nicolas Chopin

In this paper, insight is given in the techniques used to compute asymptotic expansions. In a broad fashion the technique is described. Most of the results apply to the paper "An expansion for the maximum likelihood estimator and its…

Methodology · Statistics 2007-10-05 Shanti Venetiaan

This short note reviews the basic theory for quantifying both the asymptotic and preasymptotic convergence of Markov chain Monte Carlo estimators.

Probability · Mathematics 2021-10-15 Michael Betancourt

Models with multiple change points are used in many fields; however, the theoretical properties of maximum likelihood estimators of such models have received relatively little attention. The goal of this paper is to establish the asymptotic…

Statistics Theory · Mathematics 2011-02-28 Heping He , Thomas A. Severini

We study maximum-likelihood-type estimation for diffusion processes when the coefficients are nonrandom and observation occurs in nonsynchronous manner. The problem of nonsynchronous observations is important when we consider the analysis…

Statistics Theory · Mathematics 2022-07-04 Teppei Ogihara

Strong consistency and asymptotic normality of the Quasi-Maximum Likelihood Estimator (QMLE) are given for a general class of multidimensional causal processes. For particular cases already studied in the literature (for instance univariate…

Statistics Theory · Mathematics 2009-01-09 Jean-Marc Bardet , Olivier Wintenberger

The maximum likelihood principle is widely used in statistics, and the associated estimators often display good properties. indeed maximum likelihood estimators are guaranteed to be asymptotically efficient under mild conditions. However in…

Statistics Theory · Mathematics 2016-12-01 Christophe Culan , Claude Adnet

Approximate Bayesian computation (ABC) is a popular technique for approximating likelihoods and is often used in parameter estimation when the likelihood functions are analytically intractable. Although the use of ABC is widespread in many…

Statistics Theory · Mathematics 2011-03-29 Thomas A. Dean , Sumeetpal S. Singh , Ajay Jasra , Gareth W. Peters

We consider covariance parameter estimation for Gaussian processes with functional inputs. From an increasing-domain asymptotics perspective, we prove the asymptotic consistency and normality of the maximum likelihood estimator. We extend…

Statistics Theory · Mathematics 2024-05-16 Lucas Reding , Andrés F. López-Lopera , François Bachoc

There are many models, often called unnormalized models, whose normalizing constants are not calculated in closed form. Maximum likelihood estimation is not directly applicable to unnormalized models. Score matching, contrastive divergence…

Machine Learning · Statistics 2018-08-27 Masatoshi Uehara , Takeru Matsuda , Fumiyasu Komaki

We study asymptotic behavior of one-step weighted $M$-estimators based on samples from arrays of not necessarily identically distributed random variables and representing explicit approximations to the corresponding consistent weighted…

Statistics Theory · Mathematics 2015-07-07 Yu. Yu. Linke

The main approach to inference for multivariate extremes consists in approximating the joint upper tail of the observations by a parametric family arising in the limit for extreme events. The latter may be expressed in terms of…

Methodology · Statistics 2015-06-17 Raphaël Huser , Anthony C. Davison , Marc G. Genton

We prove the strong consistency and the asymptotic normality of the maximum likelihood estimator of the parameters of a general conditionally heteroscedastic model with $\alpha$-stable innovations. Then, we relax the assumptions and only…

Statistics Theory · Mathematics 2013-01-01 Guillaume Lepage