English
Related papers

Related papers: Asymptotics of Monte Carlo maximum likelihood esti…

200 papers

Consider a central problem in randomized approximation schemes that use a Monte Carlo approach. Given a sequence of independent, identically distributed random variables $X_1,X_2,\ldots$ with mean $\mu$ and standard deviation at most $c…

Statistics Theory · Mathematics 2014-11-18 Mark Huber

Posterior inference with an intractable likelihood is becoming an increasingly common task in scientific domains which rely on sophisticated computer simulations. Typically, these forward models do not admit tractable densities forcing…

Machine Learning · Statistics 2020-06-29 Joeri Hermans , Volodimir Begy , Gilles Louppe

We introduce a class of Monte Carlo estimators that aim to overcome the rapid growth of variance with dimension often observed for standard estimators by exploiting the target's independence structure. We identify the most basic…

Statistics Theory · Mathematics 2021-11-02 Juan Kuntz , Francesca R. Crucinio , Adam M. Johansen

Implicit probabilistic models are models defined naturally in terms of a sampling procedure and often induces a likelihood function that cannot be expressed explicitly. We develop a simple method for estimating parameters in implicit models…

Machine Learning · Computer Science 2018-10-23 Ke Li , Jitendra Malik

For a given parametric probability model, we consider the risk of the maximum likelihood estimator with respect to $\alpha$-divergence, which includes the special cases of Kullback--Leibler divergence, the Hellinger distance and $\chi^2$…

Statistics Theory · Mathematics 2018-10-12 Yo Sheena

Sampling from various kinds of distributions is an issue of paramount importance in statistics since it is often the key ingredient for constructing estimators, test procedures or confidence intervals. In many situations, the exact sampling…

Statistics Theory · Mathematics 2018-11-05 Avetik Karagulyan

We consider a stochastic process model with time trend and measurement error. We establish consistency and derive the limiting distributions of the maximum likelihood (ML) estimators of the covariance function parameters under a general…

Statistics Theory · Mathematics 2016-09-29 Chih-Hao Chang , Hsin-Cheng Huang , Ching-Kang Ing

Many statistical models have likelihoods which are intractable: it is impossible or too expensive to compute the likelihood exactly. In such settings, a common approach is to replace the likelihood with an approximation, and proceed with…

Statistics Theory · Mathematics 2016-11-23 Helen Ogden

This paper investigates the asymptotic properties of parameter estimation for the Ewens--Pitman partition with parameters $0<\alpha<1$ and $\theta>-\alpha$. Especially, we show that the maximum likelihood estimator (MLE) of $\alpha$ is…

Statistics Theory · Mathematics 2025-05-06 Takuya Koriyama , Takeru Matsuda , Fumiyasu Komaki

The Plackett--Luce model has been extensively used for rank aggregation in social choice theory. A central statistical question in this model concerns estimating the utility vector that governs the model's likelihood. In this paper, we…

Statistics Theory · Mathematics 2025-05-09 Ruijian Han , Yiming Xu

Motivated by studying asymptotic properties of the maximum likelihood estimator (MLE) in stochastic volatility (SV) models, in this paper we investigate likelihood estimation in state space models. We first prove, under some regularity…

Statistics Theory · Mathematics 2010-11-15 Cheng-Der Fuh

The paper studies large sample asymptotic properties of the Maximum Likelihood Estimator (MLE) for the parameter of a continuous time Markov chain, observed in white noise. Using the method of weak convergence of likelihoods due to…

Probability · Mathematics 2009-06-18 Pavel Chigansky

As is the case for many curved exponential families, the computation of maximum likelihood estimates in a multivariate normal model with a Kronecker covariance structure is typically carried out with an iterative algorithm, specifically, a…

Statistics Theory · Mathematics 2024-08-28 Mathias Drton , Alexandros Grosdos , Andrew McCormack

We analyze the extreme value dependence of independent, not necessarily identically distributed multivariate regularly varying random vectors. More specifically, we propose estimators of the spectral measure locally at some time point and…

Statistics Theory · Mathematics 2023-06-05 Holger Drees

The problem of estimating the probability p=P(g(X<0) is considered when X represents a multivariate stochastic input of a monotone function g. First, a heuristic method to bound p is formally described, involving a specialized design of…

Statistics Theory · Mathematics 2015-03-17 Nicolas Bousquet

Statisticians often use Monte Carlo methods to approximate probability distributions, primarily with Markov chain Monte Carlo and importance sampling. Sequential Monte Carlo samplers are a class of algorithms that combine both techniques to…

Computation · Statistics 2022-06-20 Chenguang Dai , Jeremy Heng , Pierre E. Jacob , Nick Whiteley

Monte Carlo simulations are based on the manipulation of random numbers to evaluate probable outcomes, with applicability in a variety of different fields. By assigning probabilities, which can be determined a priori, to various events, it…

Physics Education · Physics 2022-01-03 Parasuraman Swaminathan

With the growing availability of large-scale biomedical data, it is often time-consuming or infeasible to directly perform traditional statistical analysis with relatively limited computing resources at hand. We propose a fast subsampling…

Methodology · Statistics 2023-05-18 Haixiang Zhang , Lulu Zuo , HaiYing Wang , Liuquan Sun

For real symmetric matrices that are accessible only through matrix vector products, we present Monte Carlo estimators for computing the diagonal elements. Our probabilistic bounds for normwise absolute and relative errors apply to Monte…

Numerical Analysis · Mathematics 2022-03-18 Eric Hallman , Ilse C. F. Ipsen , Arvind Saibaba

We consider a one dimensional ballistic random walk evolving in an i.i.d. parametric random environment. We provide a maximum likelihood estimation procedure of the environment parameters based on a single observation of the path till the…

Statistics Theory · Mathematics 2014-02-13 Francis Comets , Mikael Falconnet , Oleg Loukianov , Dasha Loukianova , Catherine Matias