English
Related papers

Related papers: Bayesian learning of weakly structural Markov grap…

200 papers

The R package BiDAG implements Markov chain Monte Carlo (MCMC) methods for structure learning and sampling of Bayesian networks. The package includes tools to search for a maximum a posteriori (MAP) graph and to sample graphs from the…

Computation · Statistics 2021-05-04 Polina Suter , Jack Kuipers , Giusi Moffa , Niko Beerenwinkel

The Gaussian process (GP) is a popular way to specify dependencies between random variables in a probabilistic model. In the Bayesian framework the covariance structure can be specified using unknown hyperparameters. Integrating over these…

Computation · Statistics 2010-11-01 Iain Murray , Ryan Prescott Adams

We propose an empirical Bayes formulation of the structure learning problem, where the prior specification assumes that all node variables have the same error variance, an assumption known to ensure the identifiability of the underlying…

Computation · Statistics 2023-08-17 Hyunwoong Chang , James Cai , Quan Zhou

Decision tree learning is a popular approach for classification and regression in machine learning and statistics, and Bayesian formulations---which introduce a prior distribution over decision trees, and formulate learning as posterior…

Machine Learning · Statistics 2013-08-26 Balaji Lakshminarayanan , Daniel M. Roy , Yee Whye Teh

In this study, we present a multi-class graphical Bayesian predictive classifier that incorporates the uncertainty in the model selection into the standard Bayesian formalism. For each class, the dependence structure underlying the observed…

Machine Learning · Statistics 2018-06-08 Tatjana Pavlenko , Felix Leopoldo Rios

Deep learning models, such as convolutional neural networks, have long been applied to image and multi-media tasks, particularly those with structured data. More recently, there has been more attention to unstructured data that can be…

Machine Learning · Computer Science 2021-09-17 Rohitash Chandra , Ayush Bhagat , Manavendra Maharana , Pavel N. Krivitsky

Bayesian Neural Networks (BNNs) provide a promising framework for modeling predictive uncertainty and enhancing out-of-distribution robustness (OOD) by estimating the posterior distribution of network parameters. Stochastic Gradient Markov…

Machine Learning · Computer Science 2025-03-04 Hyunsu Kim , Giung Nam , Chulhee Yun , Hongseok Yang , Juho Lee

In performing a Bayesian analysis, two difficult problems often emerge. First, in estimating the parameters of some model for the data, the resulting posterior distribution may be multi-modal or exhibit pronounced (curving) degeneracies.…

Instrumentation and Methods for Astrophysics · Physics 2013-12-20 F. Feroz , J. Skilling

The health condition of components in civil infrastructures can be described by various discrete states according to their performance degradation. Inferring these states from measurable responses is typically an ill-posed inverse problem.…

Machine Learning · Statistics 2026-04-30 Teng Li , Stephen Wu , Yong Huang , James L. Beck , Hui Li

We consider the situation where a temporal process is composed of contiguous segments with differing slopes and replicated noise-corrupted time series measurements are observed. The unknown mean of the data generating process is modelled as…

It has become increasingly easy nowadays to collect approximate posterior samples via fast algorithms such as variational Bayes, but concerns exist about the estimation accuracy. It is tempting to build solutions that exploit approximate…

Computation · Statistics 2024-06-17 Leo L. Duan , Anirban Bhattacharya

The advantages of sequential Monte Carlo (SMC) are exploited to develop parameter estimation and model selection methods for GARCH (Generalized AutoRegressive Conditional Heteroskedasticity) style models. It provides an alternative method…

Applications · Statistics 2020-03-06 Dan Li , Adam Clements , Christopher Drovandi

We propose a Bayesian nonparametric mixture model for the reconstruction and prediction from observed time series data, of discretized stochastic dynamical systems, based on Markov Chain Monte Carlo methods (MCMC). Our results can be used…

Applications · Statistics 2017-10-03 Christos Merkatas , Konstantinos Kaloudis , Spyridon J. Hatjispyros

We extend the decomposition approach for learning Bayesian networks (BNs) proposed by (Xie et. al.) to learning multivariate regression chain graphs (MVR CGs), which include BNs as a special case. The same advantages of this decomposition…

Artificial Intelligence · Computer Science 2020-02-26 Mohammad Ali Javidian , Marco Valtorta

Particle Markov chain Monte Carlo (PMCMC) is a systematic way of combining the two main tools used for Monte Carlo statistical inference: sequential Monte Carlo (SMC) and Markov chain Monte Carlo (MCMC). We present a novel PMCMC algorithm…

Computation · Statistics 2014-09-17 Fredrik Lindsten , Michael I. Jordan , Thomas B. Schön

A new algorithm based on bayesian inference for learning local graph conductance based on Gaussian Process(GP) is given that uses advanced MCMC convergence ideas to create a scalable and fast algorithm for convergence to stationary…

Machine Learning · Computer Science 2022-04-28 Farshad Noravesh

Uncertainty estimation in deep models is essential in many real-world applications and has benefited from developments over the last several years. Recent evidence suggests that existing solutions dependent on simple Gaussian formulations…

Machine Learning · Computer Science 2022-05-11 Jurijs Nazarovs , Ronak R. Mehta , Vishnu Suresh Lokhande , Vikas Singh

Markov chain Monte Carlo (MCMC) methods asymptotically sample from complex probability distributions. The pseudo-marginal MCMC framework only requires an unbiased estimator of the unnormalized probability distribution function to construct…

Computation · Statistics 2016-05-25 Iain Murray , Matthew M. Graham

Markov chain Monte Carlo (MCMC) methods have not been broadly adopted in Bayesian neural networks (BNNs). This paper initially reviews the main challenges in sampling from the parameter posterior of a neural network via MCMC. Such…

Machine Learning · Statistics 2021-10-05 Theodore Papamarkou , Jacob Hinkle , M. Todd Young , David Womble

Using Markov chain Monte Carlo to sample from posterior distributions was the key innovation which made Bayesian data analysis practical. Notoriously, however, MCMC is hard to tune, hard to diagnose, and hard to parallelize. This…

Computation · Statistics 2022-03-18 Cosma Rohilla Shalizi