English
Related papers

Related papers: Dirichlet Bayesian Network Scores and the Maximum …

200 papers

We propose a globally optimal Bayesian network structure discovery algorithm based on a progressively leveled scoring approach. Bayesian network structure discovery is a fundamental yet NP-hard problem in the field of probabilistic…

Machine Learning · Statistics 2024-07-25 Hongming Huang , Joe Suzuki

This paper introduces a novel prior called Diversified Block Sparse Prior to characterize the widespread block sparsity phenomenon in real-world data. By allowing diversification on intra-block variance and inter-block correlation matrices,…

Machine Learning · Computer Science 2024-10-31 Yanhao Zhang , Zhihan Zhu , Yong Xia

We study the problem of learning Bayesian networks where an $\epsilon$-fraction of the samples are adversarially corrupted. We focus on the fully-observable case where the underlying graph structure is known. In this work, we present the…

Machine Learning · Computer Science 2021-05-13 Yu Cheng , Honghao Lin

Variational dropout (VD) is a generalization of Gaussian dropout, which aims at inferring the posterior of network weights based on a log-uniform prior on them to learn these weights as well as dropout rate simultaneously. The log-uniform…

Machine Learning · Computer Science 2019-04-05 Yuhang Liu , Wenyong Dong , Lei Zhang , Dong Gong , Qinfeng Shi

In this work, we propose a Bayesian type sparse deep learning algorithm. The algorithm utilizes a set of spike-and-slab priors for the parameters in the deep neural network. The hierarchical Bayesian mixture will be trained using an…

Numerical Analysis · Mathematics 2021-03-17 Yating Wang , Wei Deng , Lin Guang

We study the Bayesian model averaging approach to learning Bayesian network structures (DAGs) from data. We develop new algorithms including the first algorithm that is able to efficiently sample DAGs according to the exact structure…

Artificial Intelligence · Computer Science 2015-01-20 Ru He , Jin Tian , Huaiqing Wu

State-of-the-art neural network-based methods for learning summary statistics have delivered promising results for simulation-based likelihood-free parameter inference. Existing approaches require density estimation as a post-processing…

Noninformative uniform priors are staples of Bayesian inference, especially in Bayesian machine learning. This study challenges the assumption that they are optimal and their use in Bayesian inference yields optimal outcomes. Instead of…

Machine Learning · Computer Science 2021-01-05 Ozan Kaan Kayaalp

Due to its causal semantics, Bayesian networks (BN) have been widely employed to discover the underlying data relationship in exploratory studies, such as brain research. Despite its success in modeling the probability distribution of…

Computer Vision and Pattern Recognition · Computer Science 2015-06-24 Luping Zhou , Lei Wang , Lingqiao Liu , Philip Ogunbona , Dinggang Shen

Deep hashing enables image retrieval by end-to-end learning of deep representations and hash codes from training data with pairwise similarity information. Subject to the distribution skewness underlying the similarity information, most…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Zhangjie Cao , Ziping Sun , Mingsheng Long , Jianmin Wang , Philip S. Yu

The adaptive processing of structured data is a long-standing research topic in machine learning that investigates how to automatically learn a mapping from a structured input to outputs of various nature. Recently, there has been an…

Machine Learning · Computer Science 2022-02-28 Federico Errica

In this work, we develop a novel Bayesian estimation method for the Dirichlet process (DP) mixture of the inverted Dirichlet distributions, which has been shown to be very flexible for modeling vectors with positive elements. The recently…

Machine Learning · Computer Science 2020-02-04 Zhanyu Ma , Yuping Lai

A discrete Bayesian network is a directed acyclic graph (DAG) consisting of categorical variables. Two popular approaches for DBN modeling include classification and nonparametric methods. However, both methods often require a large number…

Methodology · Statistics 2026-04-29 Alexander Dombowsky , David B. Dunson

The need to avoid confident predictions on unfamiliar data has sparked interest in out-of-distribution (OOD) detection. It is widely assumed that Bayesian neural networks (BNN) are well suited for this task, as the endowed epistemic…

Machine Learning · Computer Science 2021-07-27 Christian Henning , Francesco D'Angelo , Benjamin F. Grewe

Modeling uncertainty in deep neural networks, despite recent important advances, is still an open problem. Bayesian neural networks are a powerful solution, where the prior over network weights is a design choice, often a normal…

Machine Learning · Statistics 2019-10-29 Raanan Y. Rohekar , Yaniv Gurwicz , Shami Nisimov , Gal Novik

We consider the problem of Bayesian parameter estimation for deep neural networks, which is important in problem settings where we may have little data, and/ or where we need accurate posterior predictive densities, e.g., for applications…

Machine Learning · Computer Science 2015-11-10 Anoop Korattikara , Vivek Rathod , Kevin Murphy , Max Welling

Gaussian graphical models are a popular tool to learn the dependence structure in the form of a graph among variables of interest. Bayesian methods have gained in popularity in the last two decades due to their ability to simultaneously…

Statistics Theory · Mathematics 2019-04-02 Yabo Niu , Debdeep Pati , Bani Mallick

In this paper, we compare the performance of two methods for estimating Bayesian networks from data containing exogenous variables and random effects. The first method is fully Bayesian in which a prior distribution is placed on the…

Methodology · Statistics 2011-12-02 Jessica Kasza , Patty Solomon

We propose an empirical Bayes estimator based on Dirichlet process mixture model for estimating the sparse normalized mean difference, which could be directly applied to the high dimensional linear classification. In theory, we build a…

Machine Learning · Statistics 2017-02-17 Yunbo Ouyang , Feng Liang

In networks of dynamic systems, one challenge is to identify the interconnection structure on the basis of measured signals. Inspired by a Bayesian approach in [1], in this paper, we explore a Bayesian model selection method for identifying…

Systems and Control · Computer Science 2019-03-18 Shengling Shi , Giulio Bottegal , Paul M. J. Van den Hof