English
Related papers

Related papers: Implicit Maximum Likelihood Estimation

200 papers

Spatial-temporal linear model and the corresponding likelihood-based statistical inference are important tools for the analysis of spatial-temporal lattice data. In this paper, we study the asymptotic properties of maximum likelihood…

Statistics Theory · Mathematics 2012-07-27 Xiang Zhang , Yanbing Zheng

Maximum pseudolikelihood (MPL) estimators are useful alternatives to maximum likelihood (ML) estimators when likelihood functions are more difficult to manipulate than their marginal and conditional components. Furthermore, MPL estimators…

Methodology · Statistics 2017-08-30 Hien D. Nguyen

Probabilistic and set-based methods are two approaches for model invalidation, parameter and state estimation. Both classes of methods use different types of data, i.e. deterministic or probabilistic data, which allow different statements…

Optimization and Control · Mathematics 2013-11-28 Stefan Streif , Didier Henrion , Rolf Findeisen

We extend a recently established asymptotic normality theorem for generalized linear mixed models to include the dispersion parameter. The new results show that the maximum likelihood estimators of all model parameters have asymptotically…

Statistics Theory · Mathematics 2022-08-11 Aishwarya Bhaskaran , Matt P. Wand

Many applications require that we learn the parameters of a model from data. EM is a method used to learn the parameters of probabilistic models for which the data for some of the variables in the models is either missing or hidden. There…

Machine Learning · Computer Science 2013-01-30 Luis E. Ortiz , Leslie Pack Kaelbling

This paper discusses a general framework for smoothing parameter estimation for models with regular likelihoods constructed in terms of unknown smooth functions of covariates. Gaussian random effects and parametric terms may also be…

Methodology · Statistics 2016-05-10 Simon N. Wood , Natalya Pya , Benjamin Säfken

We consider the problem of estimating the distribution function, the density and the hazard rate of the (unobservable) event time in the current status model. A well studied and natural nonparametric estimator for the distribution function…

Statistics Theory · Mathematics 2010-01-13 Piet Groeneboom , Geurt Jongbloed , Birgit I. Witte

Learning the parameters of graphical models using the maximum likelihood estimation is generally hard which requires an approximation. Maximum composite likelihood estimations are statistical approximations of the maximum likelihood…

Machine Learning · Computer Science 2014-06-25 Muneki Yasuda , Shun Kataoka , Yuji Waizumi , Kazuyuki Tanaka

Likelihood-free methods are an essential tool for performing inference for implicit models which can be simulated from, but for which the corresponding likelihood is intractable. However, common likelihood-free methods do not scale well to…

Methodology · Statistics 2022-07-15 Christopher Drovandi , David J Nott , David T Frazier

Estimations of physical parameters using data usually involve non-uniform experimental efficiencies. In this article, a method of maximum likelihood fit is introduced using the efficiency as a weight, while the probability distribution…

Data Analysis, Statistics and Probability · Physics 2023-08-31 Chenxu Yu , Yanxi Zhang

Implicit models, which allow for the generation of samples but not for point-wise evaluation of probabilities, are omnipresent in real-world problems tackled by machine learning and a hot topic of current research. Some examples include…

Machine Learning · Statistics 2018-04-27 Yingzhen Li , Richard E. Turner

Probabilistic modeling enables combining domain knowledge with learning from data, thereby supporting learning from fewer training instances than purely data-driven methods. However, learning probabilistic models is difficult and has not…

Machine Learning · Computer Science 2017-05-17 Avi Pfeffer

Probabilistic classifiers output a probability distribution on target classes rather than just a class prediction. Besides providing a clear separation of prediction and decision making, the main advantage of probabilistic models is their…

Machine Learning · Computer Science 2019-02-20 Juozas Vaicenavicius , David Widmann , Carl Andersson , Fredrik Lindsten , Jacob Roll , Thomas B. Schön

Probabilistic models often have parameters that can be translated, scaled, permuted, or otherwise transformed without changing the model. These symmetries can lead to strong correlation and multimodality in the posterior distribution over…

Machine Learning · Statistics 2013-12-20 Robert Nishihara , Thomas Minka , Daniel Tarlow

When a mathematical or computational model is used to analyse some system, it is usual that some parameters resp.\ functions or fields in the model are not known, and hence uncertain. These parametric quantities are then identified by…

Probability · Mathematics 2016-07-01 Hermann G. Matthies , Elmar Zander , Bojana Rosic , Alexander Litvinenko

Empirical economic research frequently applies maximum likelihood estimation in cases where the likelihood function is analytically intractable. Most of the theoretical literature focuses on maximum simulated likelihood (MSL) estimators,…

Econometrics · Economics 2019-08-13 Michael Griebel , Florian Heiss , Jens Oettershagen , Constantin Weiser

Probabilistic inference procedures are usually coded painstakingly from scratch, for each target model and each inference algorithm. We reduce this effort by generating inference procedures from models automatically. We make this code…

Machine Learning · Statistics 2017-07-13 Robert Zinkov , Chung-chieh Shan

This paper deals with parameter estimation in pair hidden Markov models (pair-HMMs). We first provide a rigorous formalism for these models and discuss possible definitions of likelihoods. The model being biologically motivated, some…

Statistics Theory · Mathematics 2010-12-09 Ana Arribas-Gil , Elisabeth Gassiat , Catherine Matias

Suppose we observe a geometrically ergodic semi-Markov process and have a parametric model for the transition distribution of the embedded Markov chain, for the conditional distribution of the inter-arrival times, or for both. The first two…

Statistics Theory · Mathematics 2007-12-21 Ursula U. Müller , Anton Schick , Wolfgang Wefelmeyer

Due to lack of scientific understanding, some mechanisms may be missing in mathematical modeling of complex phenomena in science and engineering. These mathematical models thus contain some uncertainties such as uncertain parameters. One…

Probability · Mathematics 2012-04-05 Jinqiao Duan , Ting Gao , Guowei He