English
Related papers

Related papers: Structural perspective on constraint-based learnin…

200 papers

We investigate the maximum size of graph families on a common vertex set of cardinality $n$ such that the symmetric difference of the edge sets of any two members of the family satisfies some prescribed condition. We solve the problem…

Combinatorics · Mathematics 2022-04-05 Noga Alon , Anna Gujgiczer , János Körner , Aleksa Milojević , Gábor Simonyi

Graphs are fundamental data structures which concisely capture the relational structure in many important real-world domains, such as knowledge graphs, physical and social interactions, language, and chemistry. Here we introduce a powerful…

Machine Learning · Computer Science 2018-03-12 Yujia Li , Oriol Vinyals , Chris Dyer , Razvan Pascanu , Peter Battaglia

Several types of graphs with different conditional independence interpretations --- also known as Markov properties --- have been proposed and used in graphical models. In this paper we unify these Markov properties by introducing a class…

Statistics Theory · Mathematics 2017-07-12 Steffen Lauritzen , Kayvan Sadeghi

Ordered sequences of univariate or multivariate regressions provide statistical models for analysing data from randomized, possibly sequential interventions, from cohort or multi-wave panel studies, but also from cross-sectional or…

Methodology · Statistics 2015-03-19 Nanny Wermuth , Kayvan Sadeghi

We present two algorithms for learning the structure of a Markov network from data: GSMN* and GSIMN. Both algorithms use statistical independence tests to infer the structure by successively constraining the set of structures consistent…

Machine Learning · Computer Science 2014-01-16 Facundo Bromberg , Dimitris Margaritis , Vasant Honavar

Markov networks are frequently used in sciences to represent conditional independence relationships underlying observed variables arising from a complex system. It is often of interest to understand how an underlying network differs between…

Methodology · Statistics 2021-04-26 Byol Kim , Song Liu , Mladen Kolar

We introduce a statistical mechanics formalism for the study of constrained graph evolution as a Markovian stochastic process, in analogy with that available for spin systems, deriving its basic properties and highlighting the role of the…

Disordered Systems and Neural Networks · Physics 2015-05-13 A. C. C. Coolen , A. De Martino , A. Annibale

Theory of graphical models has matured over more than three decades to provide the backbone for several classes of models that are used in a myriad of applications such as genetic mapping of diseases, credit risk evaluation, reliability and…

Machine Learning · Statistics 2014-11-13 Henrik Nyman , Johan Pensar , Timo Koski , Jukka Corander

Symmetric independence relations are often studied using graphical representations. Ancestral graphs or acyclic directed mixed graphs with $m$-separation provide classes of symmetric graphical independence models that are closed under…

Statistics Theory · Mathematics 2020-09-14 Søren Wengel Mogensen , Niels Richard Hansen

We introduce a principled approach for unsupervised structure learning of deep neural networks. We propose a new interpretation for depth and inter-layer connectivity where conditional independencies in the input distribution are encoded…

Machine Learning · Statistics 2018-10-18 Raanan Y. Rohekar , Shami Nisimov , Yaniv Gurwicz , Guy Koren , Gal Novik

Representing the conditional independences present in a multivariate random vector via graphs has found widespread use in applications, and such representations are popularly known as graphical models or Markov random fields. These models…

Probability · Mathematics 2015-02-02 David Montague , Bala Rajaratnam

We study a class of graphs that represent local independence structures in stochastic processes allowing for correlated error processes. Several graphs may encode the same local independencies and we characterize such equivalence classes of…

Statistics Theory · Mathematics 2022-09-01 Søren Wengel Mogensen , Niels Richard Hansen

We consider the problem of estimating the marginal independence structure of a Bayesian network from observational data, learning an undirected graph we call the unconditional dependence graph. We show that unconditional dependence graphs…

Methodology · Statistics 2024-05-22 Danai Deligeorgaki , Alex Markham , Pratik Misra , Liam Solus

Traditional statistical learning theory relies on the assumption that data are identically and independently distributed (i.i.d.). However, this assumption often does not hold in many real-life applications. In this survey, we explore…

Machine Learning · Computer Science 2024-04-09 Rui-Ray Zhang , Massih-Reza Amini

Human learners are adept at grasping the complex relationships underlying incoming sequential input. In the present work, we formalize complex relationships as graph structures derived from temporal associations in motor sequences. Next, we…

Neurons and Cognition · Quantitative Biology 2018-10-31 Ari E. Kahn , Elisabeth A. Karuza , Jean M. Vettel , Danielle S. Bassett

In this paper, we consider the problem of recovering a graph that represents the statistical data dependency among nodes for a set of data samples generated by nodes, which provides the basic structure to perform an inference task, such as…

Machine Learning · Statistics 2018-05-01 Hyeryung Jang , HyungSeok Song , Yung Yi

Three classes of algorithms to learn the structure of Bayesian networks from data are common in the literature: constraint-based algorithms, which use conditional independence tests to learn the dependence structure of the data; score-based…

Methodology · Statistics 2021-02-10 Marco Scutari , Catharina Elisabeth Graafland , José Manuel Gutiérrez

We describe a new method for the random sampling of connected networks with a specified degree sequence. We consider both the case of simple graphs and that of loopless multigraphs. The constraints of fixed degrees and of connectedness are…

Physics and Society · Physics 2020-12-03 Szabolcs Horvát , Carl D. Modes

Graphical Markov models combine conditional independence constraints with graphical representations of stepwise data generating processes.The models started to be formulated about 40 years ago and vigorous development is ongoing.…

Methodology · Statistics 2015-10-12 Nanny Wermuth

Graphical causal models are an important tool for knowledge discovery because they can represent both the causal relations between variables and the multivariate probability distributions over the data. Once learned, causal graphs can be…

Artificial Intelligence · Computer Science 2017-04-11 Andrew J Sedgewick , Joseph D. Ramsey , Peter Spirtes , Clark Glymour , Panayiotis V. Benos