English
Related papers

Related papers: Marginal likelihood computation for model selectio…

200 papers

Probabilistic model checking is an approach to the formal modelling and analysis of stochastic systems. Over the past twenty five years, the number of different formalisms and techniques developed in this field has grown considerably, as…

Logic in Computer Science · Computer Science 2025-09-17 Marta Kwiatkowska , Gethin Norman , David Parker

Linear mixed models (LMMs) are used as an important tool in the data analysis of repeated measures and longitudinal studies. The most common form of LMMs utilize a normal distribution to model the random effects. Such assumptions can often…

Methodology · Statistics 2016-02-16 Hien D. Nguyen , Geoffrey J. McLachlan

Factor analysis, a classical multivariate statistical technique is popularly used as a fundamental tool for dimensionality reduction in statistics, econometrics and data science. Estimation is often carried out via the Maximum Likelihood…

Optimization and Control · Mathematics 2018-01-19 Koulik Khamaru , Rahul Mazumder

Likelihood-free methods are an essential tool for performing inference for implicit models which can be simulated from, but for which the corresponding likelihood is intractable. However, common likelihood-free methods do not scale well to…

Methodology · Statistics 2022-07-15 Christopher Drovandi , David J Nott , David T Frazier

Calibration of large-scale differential equation models to observational or experimental data is a widespread challenge throughout applied sciences and engineering. A crucial bottleneck in state-of-the art calibration methods is the…

Optimization and Control · Mathematics 2021-02-23 Jon Cockayne , Andrew B. Duncan

Probabilistic concurrent systems are foundational models for modern mobile computing. In this paper, a unifying approach to probabilistic testing equivalences is proposed. With the help of a new distribution-based semantics for…

Logic in Computer Science · Computer Science 2026-04-08 Weijun Chen , Yuxi Fu , Huan Long , Hao Wu

Inference based on the penalized density ratio model is proposed and studied. The model under consideration is specified by assuming that the log--likelihood function of two unknown densities is of some parametric form. The model has been…

Statistics Theory · Mathematics 2008-07-17 Konstantinos Fokianos

The study of the dynamics of the size of a population via mathematical modelling is a problem of interest and widely studied. Traditionally, continuous deterministic methods based on differential equations have been used to deal with this…

Probability · Mathematics 2020-01-08 J. -C. Cortés , A. Navarro-Quiles , J. -V. Romero , M. -D. Roselló

Methods of determination of constants of the Standard Model are considered. The constants values obtained now are presented and experiments for improving some values are pointed out. A few possible generalized models are considered together…

High Energy Physics - Phenomenology · Physics 2007-05-23 V. V. Khruschov

Monte Carlo methods to evaluate and maximize the likelihood function enable the construction of confidence intervals and hypothesis tests, facilitating scientific investigation using models for which the likelihood function is intractable.…

Methodology · Statistics 2017-02-13 Edward L. Ionides , Carles Breto , Joonha Park , Richard A. Smith , Aaron A. King

Large Language Models (LLMs) are widely used to evaluate natural language generation tasks as automated metrics. However, the likelihood, a measure of LLM's plausibility for a sentence, can vary due to superficial differences in sentences,…

Computation and Language · Computer Science 2025-11-11 Masanari Oi , Masahiro Kaneko , Ryuto Koike , Mengsay Loem , Naoaki Okazaki

Since their appearance in the 1950s, computational models capable of performing probabilistic choices have received wide attention and are nowadays pervasive in almost every areas of computer science. Their development was also inextricably…

Logic in Computer Science · Computer Science 2024-09-19 Melissa Antonelli , Ugo Dal Lago , Paolo Pistone

Quantitative studies in many fields involve the analysis of multivariate data of diverse types, including measurements that we may consider binary, ordinal and continuous. One approach to the analysis of such mixed data is to use a copula…

Statistics Theory · Mathematics 2007-06-13 Peter D. Hoff

Data driven modelling is vital to many analyses at collider experiments, however the derived inference of physical properties becomes subject to details of the model fitting procedure. This work brings a principled Bayesian picture, based…

Data Analysis, Statistics and Probability · Physics 2023-05-23 David Yallup , Will Handley

Normalisation in probability theory turns a subdistribution into a proper distribution. It is a partial operation, since it is undefined for the zero subdistribution. This partiality makes it hard to reason equationally about normalisation.…

Logic in Computer Science · Computer Science 2023-06-22 Bart Jacobs

Estimation of the mean vector and covariance matrix is of central importance in the analysis of multivariate data. In the framework of generalized linear models, usually the variances are certain functions of the means with the normal…

Methodology · Statistics 2023-01-25 Anupam Kundu , Mohsen Pourahmadi

Many common loss functions such as mean-squared-error, cross-entropy, and reconstruction loss are unnecessarily rigid. Under a probabilistic interpretation, these common losses correspond to distributions with fixed shapes and scales. We…

Machine Learning · Computer Science 2020-10-05 Mark Hamilton , Evan Shelhamer , William T. Freeman

The Metropolis-Hastings algorithm allows one to sample asymptotically from any probability distribution $\pi$. There has been recently much work devoted to the development of variants of the MH update which can handle scenarios where such…

Computation · Statistics 2018-03-28 Christophe Andrieu , Arnaud Doucet , Sinan Yıldırım , Nicolas Chopin

Computing the marginal likelihood (ML) of a model requires marginalizing out all of the parameters and latent variables, a difficult high-dimensional summation or integration problem. To make matters worse, it is often hard to measure the…

Machine Learning · Statistics 2015-11-10 Roger B. Grosse , Zoubin Ghahramani , Ryan P. Adams

In this work, we investigate Batch Normalization technique and propose its probabilistic interpretation. We propose a probabilistic model and show that Batch Normalization maximazes the lower bound of its marginalized log-likelihood. Then,…

Machine Learning · Statistics 2018-03-22 Andrei Atanov , Arsenii Ashukha , Dmitry Molchanov , Kirill Neklyudov , Dmitry Vetrov