English
Related papers

Related papers: Information-theoretic limits of Bayesian network s…

200 papers

We study the Bayesian model averaging approach to learning Bayesian network structures (DAGs) from data. We develop new algorithms including the first algorithm that is able to efficiently sample DAGs according to the exact structure…

Artificial Intelligence · Computer Science 2015-01-20 Ru He , Jin Tian , Huaiqing Wu

We study the problem of causal structure learning over a set of random variables when the experimenter is allowed to perform at most $M$ experiments in a non-adaptive manner. We consider the optimal learning strategy in terms of minimizing…

Machine Learning · Computer Science 2017-03-01 AmirEmad Ghassami , Saber Salehkaleybar , Negar Kiyavash

We consider the problem of learning the structure of ferromagnetic Ising models Markov on sparse Erdos-Renyi random graph. We propose simple local algorithms and analyze their performance in the regime of correlation decay. We prove that an…

Statistics Theory · Mathematics 2015-03-17 Animashree Anandkumar , Vincent Tan , Alan Willsky

The vast majority of network datasets contains errors and omissions, although this is rarely incorporated in traditional network analysis. Recently, an increasing effort has been made to fill this methodological gap by developing network…

Social and Information Networks · Computer Science 2018-10-19 Tiago P. Peixoto

We present a Bayesian method for feature selection in the presence of grouping information with sparsity on the between- and within group level. Instead of using a stochastic algorithm for parameter inference, we employ expectation…

Machine Learning · Statistics 2018-09-26 Edgar Steiger , Martin Vingron

Various iterative reconstruction algorithms for inverse problems can be unfolded as neural networks. Empirically, this approach has often led to improved results, but theoretical guarantees are still scarce. While some progress on…

Statistics Theory · Mathematics 2021-08-16 Arash Behboodi , Holger Rauhut , Ekkehard Schnoor

We present a method for learning treewidth-bounded Bayesian networks from data sets containing thousands of variables. Bounding the treewidth of a Bayesian greatly reduces the complexity of inferences. Yet, being a global property of the…

Artificial Intelligence · Computer Science 2016-05-12 Mauro Scanagatta , Giorgio Corani , Cassio P. de Campos , Marco Zaffalon

We consider the problem of learning structures and parameters of Continuous-time Bayesian Networks (CTBNs) from time-course data under minimal experimental resources. In practice, the cost of generating experimental data poses a bottleneck,…

Machine Learning · Statistics 2022-01-12 Dominik Linzner , Heinz Koeppl

This paper presents a stochastic geometry model for the investigation of fundamental information theoretic limitations in wireless networks. We derive a new unified multi-parameter cut-set bound on the capacity of networks of arbitrary…

Information Theory · Computer Science 2013-05-02 Georgios Rodolakis

The support recovery problem consists of determining a sparse subset of a set of variables that is relevant in generating a set of observations, and arises in a diverse range of settings such as compressive sensing, and subset selection in…

Information Theory · Computer Science 2016-08-31 Jonathan Scarlett , Volkan Cevher

Learning a Bayesian networks with bounded treewidth is important for reducing the complexity of the inferences. We present a novel anytime algorithm (k-MAX) method for this task, which scales up to thousands of variables. Through extensive…

Artificial Intelligence · Computer Science 2018-02-08 Mauro Scanagatta , Giorgio Corani , Marco Zaffalon , Jaemin Yoo , U Kang

Unifying probabilistic and logical learning is a key challenge in AI. We introduce a Bayesian inductive logic programming approach that learns minimum message length hypotheses from noisy data. Our approach balances hypothesis complexity…

Artificial Intelligence · Computer Science 2026-01-26 Ruben Sharma , Sebastijan Dumančić , Ross D. King , Andrew Cropper

Continuous-time Bayesian Networks (CTBNs) represent a compact yet powerful framework for understanding multivariate time-series data. Given complete data, parameters and structure can be estimated efficiently in closed-form. However, if…

Machine Learning · Statistics 2019-11-04 Dominik Linzner , Michael Schmidt , Heinz Koeppl

We consider the problem of learning Bayesian network classifiers that maximize the marginover a set of classification variables. We find that this problem is harder for Bayesian networks than for undirected graphical models like maximum…

Machine Learning · Computer Science 2012-07-09 Yuhong Guo , Dana Wilkinson , Dale Schuurmans

In this work, we focus on variational Bayesian inference on the sparse Deep Neural Network (DNN) modeled under a class of spike-and-slab priors. Given a pre-specified sparse DNN structure, the corresponding variational posterior contraction…

Statistics Theory · Mathematics 2020-08-04 Jincheng Bai , Qifan Song , Guang Cheng

Bayesian learning is a powerful learning framework which combines the external information of the data (background information) with the internal information (training data) in a logically consistent way in inference and prediction. By…

Machine Learning · Statistics 2026-02-11 Erdong Guo , David Draper

We present novel information-theoretic limits on detecting sparse changes in Ising models, a problem that arises in many applications where network changes can occur due to some external stimuli. We show that the sample complexity for…

Information Theory · Computer Science 2020-11-10 Aditya Gangrade , Bobak Nazer , Venkatesh Saligrama

Reconstructing weighted networks from partial information is necessary in many important circumstances, e.g. for a correct estimation of systemic risk. It has been shown that, in order to achieve an accurate reconstruction, it is crucial to…

Physics and Society · Physics 2017-03-07 Tiziano Squartini , Giulio Cimini , Andrea Gabrielli , Diego Garlaschelli

This work establishes a novel link between the problem of PAC-learning high-dimensional graphical models and the task of (efficient) counting and sampling of graph structures, using an online learning framework. We observe that if we apply…

Machine Learning · Computer Science 2025-11-14 Arnab Bhattacharyya , Sutanu Gayen , Philips George John , Sayantan Sen , N. V. Vinodchandran

This paper extends the work in [Suzuki, 1996] and presents an efficient depth-first branch-and-bound algorithm for learning Bayesian network structures, based on the minimum description length (MDL) principle, for a given (consistent)…

Artificial Intelligence · Computer Science 2013-01-18 Jin Tian
‹ Prev 1 4 5 6 7 8 10 Next ›