English
Related papers

Related papers: Greedy Learning of Markov Network Structure

200 papers

Directed acyclic graphical models, or DAG models, are widely used to represent complex causal systems. Since the basic task of learning such a model from data is NP-hard, a standard approach is greedy search over the space of directed…

Statistics Theory · Mathematics 2021-06-09 Liam Solus , Yuhao Wang , Caroline Uhler

Markov random fields are used to model high dimensional distributions in a number of applied areas. Much recent interest has been devoted to the reconstruction of the dependency structure from independent samples from the Markov random…

Computational Complexity · Computer Science 2010-03-09 Guy Bresler , Elchanan Mossel , Allan Sly

We introduce a new embarrassingly parallel parameter learning algorithm for Markov random fields with untied parameters which is efficient for a large class of practical models. Our algorithm parallelizes naturally over cliques and, for…

Machine Learning · Statistics 2014-02-06 Yariv Dror Mizrahi , Misha Denil , Nando de Freitas

We propose an extension of the Contextual Graph Markov Model, a deep and probabilistic machine learning model for graphs, to model the distribution of edge features. Our approach is architectural, as we introduce an additional Bayesian…

Machine Learning · Computer Science 2023-08-21 Daniele Atzeni , Federico Errica , Davide Bacciu , Alessio Micheli

We study a number of graph exploration problems in the following natural scenario: an algorithm starts exploring an undirected graph from some seed node; the algorithm, for an arbitrary node $v$ that it is aware of, can ask an oracle to…

Data Structures and Algorithms · Computer Science 2017-10-25 Flavio Chierichetti , Shahrzad Haddadan

We derive new results for the performance of a simple greedy algorithm for finding large independent sets and matchings in constant degree regular graphs. We show that for $r$-regular graphs with $n$ nodes and girth at least $g$, the…

Discrete Mathematics · Computer Science 2008-07-09 David Gamarnik , David Goldberg

A Markov network characterizes the conditional independence structure, or Markov property, among a set of random variables. Existing work focuses on specific families of distributions (e.g., exponential families) and/or certain structures…

Machine Learning · Computer Science 2023-05-22 Yujia Zheng , Ignavier Ng , Yewen Fan , Kun Zhang

The problem of learning Markov equivalence classes of Bayesian network structures may be solved by searching for the maximum of a scoring metric in a space of these classes. This paper deals with the definition and analysis of one such…

Artificial Intelligence · Computer Science 2013-01-07 Vincent Auvray , Louis Wehenkel

We propose a greedy algorithm to select $N$ important features among $P$ input features for a non-linear prediction problem. The features are selected one by one sequentially, in an iterative loss minimization procedure. We use neural…

Machine Learning · Computer Science 2023-09-14 Sandipan Das , Alireza M. Javid , Prakash Borpatra Gohain , Yonina C. Eldar , Saikat Chatterjee

A graphical model is a statistical model that is associated to a graph whose nodes correspond to variables of interest. The edges of the graph reflect allowed conditional dependencies among the variables. Graphical models admit…

Methodology · Statistics 2016-06-09 Mathias Drton , Marloes H. Maathuis

We consider the problem of identifying a subset of nodes in a network that will enable the fastest spread of information in a decentralized environment.In a model of communication based on a random walk on an undirected graph, the optimal…

Discrete Mathematics · Computer Science 2014-08-20 Fern Y. Hunt

We propose a new computationally efficient method for quantizing the weights of pre- trained neural networks that is general enough to handle both multi-layer perceptrons and convolutional neural networks. Our method deterministically…

Machine Learning · Computer Science 2021-08-17 Eric Lybrand , Rayan Saab

We consider the problem of learning a directed graph $G^\star$ from observational data. We assume that the distribution which gives rise to the samples is Markov and faithful to the graph $G^\star$ and that there are no unobserved…

Statistics Theory · Mathematics 2025-02-25 Pardis Semnani , Elina Robeva

One of the most influential recent results in network analysis is that many natural networks exhibit a power-law or log-normal degree distribution. This has inspired numerous generative models that match this property. However, more recent…

Data Structures and Algorithms · Computer Science 2011-09-01 Isabelle Stanton , Ali Pinar

Learning the structure of Bayesian networks from data is known to be a computationally challenging, NP-hard problem. The literature has long investigated how to perform structure learning from data containing large numbers of variables,…

Computation · Statistics 2019-10-25 Marco Scutari , Claudia Vitolo , Allan Tucker

Semi-supervised learning on graphs is a widely applicable problem in network science and machine learning. Two standard algorithms -- label propagation and graph neural networks -- both operate by repeatedly passing information along edges,…

Machine Learning · Computer Science 2021-02-02 Junteng Jia , Austin R. Benson

We consider the problem of model selection in Gaussian Markov fields in the sample deficient scenario. In many practically important cases, the underlying networks are embedded into Euclidean spaces. Using the natural geometric structure,…

Machine Learning · Statistics 2018-10-31 Ilya Soloveychik , Vahid Tarokh

We consider the problem of learning the structure of ferromagnetic Ising models Markov on sparse Erdos-Renyi random graph. We propose simple local algorithms and analyze their performance in the regime of correlation decay. We prove that an…

Statistics Theory · Mathematics 2015-03-17 Animashree Anandkumar , Vincent Tan , Alan Willsky

In this paper we investigate the computational complexity of learning the graph structure underlying a discrete undirected graphical model from i.i.d. samples. We first observe that the notoriously difficult problem of learning parities…

Machine Learning · Statistics 2014-12-04 Guy Bresler , David Gamarnik , Devavrat Shah

Computing the size of maximum independent sets is a NP-hard problem for fixed graphs. Characterizing and designing efficient algorithms to estimate this independence number for random graphs are notoriously difficult and still largely open…

Probability · Mathematics 2020-10-01 Paola Bermolen , Matthieu Jonckheere , Federico Larroca , Manuel Saenz