English
Related papers

Related papers: Easy Variational Inference for Categorical Models …

200 papers

Advances in data collecting technologies in genomics have significantly increased the need for tools designed to study the genetic basis of many diseases. Effective statistical methods should excel in both prediction accuracy and biomarker…

Methodology · Statistics 2025-11-13 Anthony-Alexander Christidis , Stefan Van Aelst , Ruben Zamar

Finite mixtures are a broad class of models useful in scenarios where observed data is generated by multiple distinct processes but without explicit information about the responsible process for each data point. Estimating Bayesian mixture…

Machine Learning · Statistics 2026-03-17 Šimon Kucharský , Paul Christian Bürkner

Recent developments in statistical regression methodology shift away from pure mean regression towards distributional regression models. One important strand thereof is that of conditional transformation models (CTMs). CTMs infer the entire…

Methodology · Statistics 2022-05-24 Manuel Carlan , Thomas Kneib , Nadja Klein

We present a sequential Monte Carlo sampler algorithm for the Bayesian analysis of generalised linear mixed models (GLMMs). These models support a variety of interesting regression-type analyses, but performing inference is often extremely…

Computation · Statistics 2008-10-08 Y. Fan , D. S. Leslie , M. P. Wand

The main challenge in Bayesian models is to determine the posterior for the model parameters. Already, in models with only one or few parameters, the analytical posterior can only be determined in special settings. In Bayesian neural…

Machine Learning · Statistics 2021-06-02 Sefan Hörtling , Daniel Dold , Oliver Dürr , Beate Sick

This paper considers an extension of the linear non-Gaussian acyclic model (LiNGAM) that determines the causal order among variables from a dataset when the variables are expressed by a set of linear equations, including noise. In…

Machine Learning · Computer Science 2021-08-17 Joe Suzuki , Yusuke Inaoka

Bayesian inference allows us to define a posterior distribution over the weights of a generic neural network (NN). Exact posteriors are usually intractable, in which case approximations can be employed. One such approximation - variational…

Machine Learning · Computer Science 2026-01-30 Andrew Millard , Joshua Murphy , Peter Green , Simon Maskell

Approximate Bayesian computation methods are useful for generative models with intractable likelihoods. These methods are however sensitive to the dimension of the parameter space, requiring exponentially increasing resources as this…

Computation · Statistics 2026-02-09 Grégoire Clarté , Christian P. Robert , Robin Ryder , Julien Stoehr

Despite their widespread applications, Large Language Models (LLMs) often struggle to express uncertainty, posing a challenge for reliable deployment in high stakes and safety critical domains like clinical diagnostics. Existing standard…

Machine Learning · Computer Science 2025-09-25 Mridul Sharma , Adeetya Patel , Zaneta D' Souza , Samira Abbasgholizadeh Rahimi , Siva Reddy , Sreenath Madathil

Non-Gaussian likelihoods are essential for modelling complex real-world observations but pose significant computational challenges in learning and inference. Even with Gaussian priors, non-Gaussian likelihoods often lead to analytically…

Machine Learning · Statistics 2024-10-29 Thang D. Bui

Mixture models with Gamma and or inverse-Gamma distributed mixture components are useful for medical image tissue segmentation or as post-hoc models for regression coefficients obtained from linear regression within a Generalised Linear…

Machine Learning · Statistics 2016-07-27 A. Llera , D. Vidaurre , R. H. R. Pruim , C. F. Beckmann

We describe a probabilistic (generative) view of affinity matrices along with inference algorithms for a subclass of problems associated with data clustering. This probabilistic view is helpful in understanding different models and…

Machine Learning · Computer Science 2012-12-12 Romer Rosales , Brendan J. Frey

A connection between the General Linear Model (GLM) in combination with classical statistical inference and the machine learning (MLE)-based inference is described in this paper. Firstly, the estimation of the GLM parameters is expressed as…

Machine Learning · Statistics 2022-02-10 Juan Manuel Gorriz , SIPBA group , John Suckling

Due to its causal semantics, Bayesian networks (BN) have been widely employed to discover the underlying data relationship in exploratory studies, such as brain research. Despite its success in modeling the probability distribution of…

Computer Vision and Pattern Recognition · Computer Science 2015-06-24 Luping Zhou , Lei Wang , Lingqiao Liu , Philip Ogunbona , Dinggang Shen

Despite major methodological developments, Bayesian inference for Gaussian graphical models remains challenging in high dimension due to the tremendous size of the model space. This article proposes a method to infer the marginal and…

Methodology · Statistics 2018-04-10 Gwenaël G. R. Leday , Sylvia Richardson

Learning a Bayesian network (BN) from data can be useful for decision-making or discovering causal relationships. However, traditional methods often fail in modern applications, which exhibit a larger number of observed variables than data…

Computation · Statistics 2018-06-26 Raj Agrawal , Tamara Broderick , Caroline Uhler

Linear Mixed Models (LMMs) are important tools in statistical genetics. When used for feature selection, they allow to find a sparse set of genetic traits that best predict a continuous phenotype of interest, while simultaneously correcting…

Many statistical models can be simulated forwards but have intractable likelihoods. Approximate Bayesian Computation (ABC) methods are used to infer properties of these models from data. Traditionally these methods approximate the posterior…

Machine Learning · Statistics 2018-04-03 George Papamakarios , Iain Murray

In variational inference, the benefits of Bayesian models rely on accurately capturing the true posterior distribution. We propose using neural samplers that specify implicit distributions, which are well-suited for approximating complex…

Machine Learning · Computer Science 2023-11-10 Anshuk Uppal , Kristoffer Stensbo-Smidt , Wouter Boomsma , Jes Frellsen

Logistic regression models are a popular and effective method to predict the probability of categorical response data. However inference for these models can become computationally prohibitive for large datasets. Here we adapt ideas from…

Methodology · Statistics 2020-08-25 Tom Whitaker , Boris Beranger , Scott A. Sisson