English
Related papers

Related papers: Learning Bayesian Networks from Big Data with Gree…

200 papers

This paper investigates a new learning formulation called structured sparsity, which is a natural extension of the standard sparsity concept in statistical learning and compressive sensing. By allowing arbitrary structures on the feature…

Methodology · Statistics 2009-05-05 Junzhou Huang , Tong Zhang , Dimitris Metaxas

In this paper, we address the problem of learning the structure of a pairwise graphical model from samples in a high-dimensional setting. Our first main result studies the sparsistency, or consistency in sparsity pattern recovery,…

Machine Learning · Computer Science 2012-02-28 Ali Jalali , Chris Johnson , Pradeep Ravikumar

This work initiates a systematic investigation of testing high-dimensional structured distributions by focusing on testing Bayesian networks -- the prototypical family of directed graphical models. A Bayesian network is defined by a…

Data Structures and Algorithms · Computer Science 2020-01-28 Clement Canonne , Ilias Diakonikolas , Daniel Kane , Alistair Stewart

Bayesian network classifiers provide a feasible solution to tabular data classification, with a number of merits like high time and memory efficiency, and great explainability. However, due to the parameter explosion and data sparsity…

Machine Learning · Computer Science 2025-08-18 Huan Zhang , Daokun Zhang , Kexin Meng , Geoffrey I. Webb

We give a new consistent scoring function for structure learning of Bayesian networks. In contrast to traditional approaches to score-based structure learning, such as BDeu or MDL, the complexity penalty that we propose is data-dependent…

Machine Learning · Computer Science 2015-05-13 Eliot Brenner , David Sontag

We study the problem of learning Bayesian networks where an $\epsilon$-fraction of the samples are adversarially corrupted. We focus on the fully-observable case where the underlying graph structure is known. In this work, we present the…

Machine Learning · Computer Science 2021-05-13 Yu Cheng , Honghao Lin

Continual Learning is a learning paradigm where learning systems are trained with sequential or streaming tasks. Two notable directions among the recent advances in continual learning with neural networks are ($i$) variational Bayes based…

Machine Learning · Computer Science 2020-02-24 Abhishek Kumar , Sunabha Chatterjee , Piyush Rai

Greedy algorithms have long been a workhorse for learning graphical models, and more broadly for learning statistical models with sparse structure. In the context of learning directed acyclic graphs, greedy algorithms are popular despite…

Machine Learning · Computer Science 2021-11-01 Goutham Rajendran , Bohdan Kivva , Ming Gao , Bryon Aragam

Federated learning makes it possible to train a machine learning model on decentralized data. Bayesian networks are probabilistic graphical models that have been widely used in artificial intelligence applications. Their popularity stems…

Machine Learning · Computer Science 2024-05-22 Florian van Daalen , Lianne Ippel , Andre Dekker , Inigo Bermejo

Due to its causal semantics, Bayesian networks (BN) have been widely employed to discover the underlying data relationship in exploratory studies, such as brain research. Despite its success in modeling the probability distribution of…

Computer Vision and Pattern Recognition · Computer Science 2015-06-24 Luping Zhou , Lei Wang , Lingqiao Liu , Philip Ogunbona , Dinggang Shen

Causal Bayesian networks are widely used tools for summarising the dependencies between variables and elucidating their putative causal relationships. By restricting the search to trees, for example, learning the optimum from data is…

Computation · Statistics 2025-03-10 Felix L. Rios , Giusi Moffa , Jack Kuipers

Correlation Networks (CNs) inherently suffer from redundant information in their network topology. Bayesian Networks (BNs), on the other hand, include only non-redundant information (from a probabilistic perspective) resulting in a sparse…

Data Analysis, Statistics and Probability · Physics 2020-11-03 Catharina Graafland , José M. Gutiérrez , Juan M. López , Diego Pazó , Miguel A. Rodríguez

Complex network reconstruction is a hot topic in many fields. Currently, the most popular data-driven reconstruction framework is based on lasso. However, it is found that, in the presence of noise, lasso loses efficiency for weighted…

Machine Learning · Statistics 2020-03-03 Shuang Xu , Chun-Xia Zhang , Pei Wang , Jiangshe Zhang

Several methods have recently been developed for joint structure learning of multiple (related) graphical models or networks. These methods treat individual networks as exchangeable, such that each pair of networks are equally encouraged to…

Methodology · Statistics 2014-06-03 Chris J. Oates , Sach Mukherjee

Modeling uncertainty in deep neural networks, despite recent important advances, is still an open problem. Bayesian neural networks are a powerful solution, where the prior over network weights is a design choice, often a normal…

Machine Learning · Statistics 2019-10-29 Raanan Y. Rohekar , Yaniv Gurwicz , Shami Nisimov , Gal Novik

The score-based structure learning of Bayesian network (BN) is an effective way to learn BN models, which are regarded as some of the most compelling probabilistic graphical models in the field of representation and reasoning under…

Machine Learning · Computer Science 2025-04-08 Mingcan Wang , Junchang Xin , Luxuan Qu , Qi Chen , Zhiqiong Wang

Bayesian networks (BN) are directed acyclic graphical (DAG) models that have been adopted into many fields for their strengths in transparency, interpretability, probabilistic reasoning, and causal modeling. Given a set of data, one hurdle…

Artificial Intelligence · Computer Science 2023-05-19 Christian D. Blakely

Structural learning of directed acyclic graphs (DAGs) or Bayesian networks has been studied extensively under the assumption that data are independent. We propose a new Gaussian DAG model for dependent data which assumes the observations…

Machine Learning · Statistics 2021-07-30 Hangjian Li , Oscar Hernan Madrid Padilla , Qing Zhou

Dependency networks (Heckerman et al., 2000) are potential probabilistic graphical models for systems comprising a large number of variables. Like Bayesian networks, the structure of a dependency network is represented by a directed graph,…

Machine Learning · Computer Science 2021-07-05 Kazuya Takabatake , Shotaro Akaho

There is increasing interest in learning how human brain networks vary as a function of a continuous trait, but flexible and efficient procedures to accomplish this goal are limited. We develop a Bayesian semiparametric model, which…

Methodology · Statistics 2017-02-02 Lu Wang , Daniele Durante , Rex E. Jung , David B. Dunson