English
Related papers

Related papers: Efficient Independence-Based MAP Approach for Robu…

200 papers

In Bayesian Networks (BNs), the direction of edges is crucial for causal reasoning and inference. However, Markov equivalence class considerations mean it is not always possible to establish edge orientations, which is why many BN structure…

Machine Learning · Computer Science 2022-10-19 Kiattikun Chobtham , Anthony C. Constantinou , Neville K. Kitson

We consider the task of learning a causal graph in the presence of latent confounders given i.i.d.~samples from the model. While current algorithms for causal structure discovery in the presence of latent confounders are constraint-based,…

Statistics Theory · Mathematics 2020-03-26 Daniel Irving Bernstein , Basil Saeed , Chandler Squires , Caroline Uhler

We give the first efficient algorithm for learning the structure of an Ising model that tolerates independent failures; that is, each entry of the observed sample is missing with some unknown probability p. Our algorithm matches the…

Data Structures and Algorithms · Computer Science 2019-02-14 Surbhi Goel , Daniel M. Kane , Adam R. Klivans

We give a new consistent scoring function for structure learning of Bayesian networks. In contrast to traditional approaches to scorebased structure learning, such as BDeu or MDL, the complexity penalty that we propose is data-dependent and…

Machine Learning · Computer Science 2013-09-27 Eliot Brenner , David Sontag

Probabilistic circuits (PCs) such as sum-product networks efficiently represent large multi-variate probability distributions. They are preferred in practice over other probabilistic representations such as Bayesian and Markov networks…

Machine Learning · Computer Science 2024-02-07 Shivvrat Arya , Tahrima Rahman , Vibhav Gogate

Markov networks are extensively used to model complex sequential, spatial, and relational interactions in a wide range of fields. By learning the structure of independences of a domain, more accurate joint probability distributions can be…

Artificial Intelligence · Computer Science 2017-11-01 Federico Schlüter , Yanela Strappa , Diego H. Milone , Facundo Bromberg

Learning the undirected graph structure of a Markov network from data is a problem that has received a lot of attention during the last few decades. As a result of the general applicability of the model class, a myriad of methods have been…

The primary example of instance-based learning is the $k$-nearest neighbor rule (kNN), praised for its simplicity and the capacity to adapt to new unseen data and toss away old data. The main disadvantages often mentioned are the…

Machine Learning · Computer Science 2021-02-05 Ariana Talamantes , Edgar Chavez

Markov networks are probabilistic graphical models that employ undirected graphs to depict conditional independence relationships among variables. Our focus lies in constraint-based structure learning, which entails learning the undirected…

Machine Learning · Computer Science 2024-03-14 Tuukka Korhonen , Fedor V. Fomin , Pekka Parviainen

Various graph neural networks (GNNs) have been proposed to solve node classification tasks in machine learning for graph data. GNNs use the structural information of graph data by aggregating the features of neighboring nodes. However, they…

Machine Learning · Computer Science 2022-12-29 Yuga Oishi , Ken kaneiwa

Constraint-based methods are one of the main approaches for causal structure learning that are particularly valued as they are asymptotically guaranteed to find a structure that is Markov equivalent to the causal graph of the system. On the…

Machine Learning · Computer Science 2021-05-24 Ehsan Mokhtarian , Sina Akbari , AmirEmad Ghassami , Negar Kiyavash

Finding the most likely (MAP) configuration of a Markov random field (MRF) is NP-hard in general. A promising, recent technique is to reduce the problem to finding a maximum weight stable set (MWSS) on a derived weighted graph, which if…

Artificial Intelligence · Computer Science 2013-09-27 Adrian Weller , Tony S. Jebara

We consider the problem of learning a sparse graph underlying an undirected Gaussian graphical model, a key problem in statistical machine learning. Given $n$ samples from a multivariate Gaussian distribution with $p$ variables, the goal is…

Machine Learning · Computer Science 2026-04-07 Kayhan Behdin , Wenyu Chen , Rahul Mazumder

This paper presents a novel Integer Programming (IP) approach for discovering the Markov Equivalent Class (MEC) of Bayesian Networks (BNs) through observational data. The MEC-IP algorithm utilizes a unique clique-focusing strategy and…

Machine Learning · Computer Science 2024-10-25 Abdelmonem Elrefaey , Rong Pan

The information bottleneck (IB) method is a technique designed to extract meaningful information related to one random variable from another random variable, and has found extensive applications in machine learning problems. In this paper,…

Information Theory · Computer Science 2025-07-29 Lingyi Chen , Shitong Wu , Sicheng Xu , Huihui Wu , Wenyi Zhang

We learn the structure of a Markov Network between two groups of random variables from joint observations. Since modelling and learning the full MN structure may be hard, learning the links between two groups directly may be a preferable…

Machine Learning · Statistics 2016-05-30 Song Liu , Taiji Suzuki , Masashi Sugiyama , Kenji Fukumizu

Independent component analysis (ICA) has been widely used for blind source separation in many fields such as brain imaging analysis, signal processing and telecommunication. Many statistical techniques based on M-estimates have been…

Methodology · Statistics 2009-09-29 Aiyou Chen , Peter J. Bickel

We present an algorithm to identify sparse dependence structure in continuous and non-Gaussian probability distributions, given a corresponding set of data. The conditional independence structure of an arbitrary distribution can be…

Machine Learning · Computer Science 2017-11-07 Rebecca E. Morrison , Ricardo Baptista , Youssef Marzouk

Many tools exist to detect dependence between random variables, a core question across a wide range of machine learning, statistical, and scientific endeavors. Although several statistical tests guarantee eventual detection of any…

Machine Learning · Statistics 2026-03-23 Nathaniel Xu , Feng Liu , Danica J. Sutherland

We introduce a new graph polynomial that encodes interesting properties of graphs, for example, the number of matchings and the number of perfect matchings. Most importantly, for bipartite graphs the polynomial encodes the number of…

Discrete Mathematics · Computer Science 2010-02-10 Qi Ge , Daniel Stefankovic