English
Related papers

Related papers: Beyond normality: Learning sparse probabilistic gr…

200 papers

We explore the usage of meta-learning to derive the causal direction between variables by optimizing over a measure of distribution simplicity. We incorporate a stochastic graph representation which includes latent variables and allows for…

Machine Learning · Computer Science 2021-06-11 Justin Wong , Dominik Damjakob

In a traditional Gaussian graphical model, data homogeneity is routinely assumed with no extra variables affecting the conditional independence. In modern genomic datasets, there is an abundance of auxiliary information, which often gets…

Methodology · Statistics 2023-08-16 Yabo Niu , Yang Ni , Debdeep Pati , Bani K. Mallick

Graphical models are commonly used to represent conditional dependence relationships between variables. There are multiple methods available for exploring them from high-dimensional data, but almost all of them rely on the assumption that…

Machine Learning · Statistics 2020-04-22 Tianxi Li , Cheng Qian , Elizaveta Levina , Ji Zhu

Causal discovery with latent variables is a fundamental task. Yet most existing methods rely on strong structural assumptions, such as enforcing specific indicator patterns for latents or restricting how they can interact with others. We…

Machine Learning · Computer Science 2026-03-06 Haoyue Dai , Immanuel Albrecht , Peter Spirtes , Kun Zhang

This paper considers the problem of randomized influence maximization over a Markovian graph process: given a fixed set of nodes whose connectivity graph is evolving as a Markov chain, estimate the probability distribution (over this fixed…

Social and Information Networks · Computer Science 2017-11-10 Buddhika Nettasinghe , Vikram Krishnamurthy

We consider the problem of learning the structure of a pairwise graphical model over continuous and discrete variables. We present a new pairwise model for graphical models with both continuous and discrete variables that is amenable to…

Machine Learning · Statistics 2013-07-05 Jason D. Lee , Trevor J. Hastie

We explore various Bayesian approaches to estimate partial Gaussian graphical models. Our hierarchical structures enable to deal with single-output as well as multiple-output linear regressions, in small or high dimension, enforcing either…

Methodology · Statistics 2021-12-14 Eunice Okome Obiang , Pascal Jézéquel , Frédéric Proïa

We propose a novel algorithm for the support estimation of partially known Gaussian graphical models that incorporates prior information about the underlying graph. In contrast to classical approaches that provide a point estimate based on…

Machine Learning · Statistics 2024-02-26 Martín Sevilla , Antonio García Marques , Santiago Segarra

We revisit the probabilistic construction of sparse random matrices where each column has a fixed number of nonzeros whose row indices are drawn uniformly at random. These matrices have a one-to-one correspondence with the adjacency…

Information Theory · Computer Science 2013-07-25 Bubacarr Bah , Jared Tanner

Within the framework of Gaussian graphical models, a prior distribution for the underlying graph is introduced to induce a block structure in the adjacency matrix of the graph and learning relationships between fixed groups of variables. A…

Methodology · Statistics 2023-05-15 Alessandro Colombi , Raffaele Argiento , Lucia Paci , Alessia Pini

In the process of building (structural learning) a probabilistic graphical model from a set of observed data, the directional, cyclic dependencies between the random variables of the model are often found. Existing graphical models such as…

Machine Learning · Computer Science 2023-10-26 Oleksii Sirotkin

Sparse structure learning in high-dimensional Gaussian graphical models is an important problem in multivariate statistical signal processing; since the sparsity pattern naturally encodes the conditional independence relationship among…

Methodology · Statistics 2023-09-26 Ksheera Sagar , Jyotishka Datta , Sayantan Banerjee , Anindya Bhadra

This paper considers learning of the graphical structure of a $p$-dimensional random vector $X \in R^p$ using both parametric and non-parametric methods. Unlike the previous works which observe $x$ directly, we consider the indirect…

Machine Learning · Statistics 2022-05-10 Hang Zhang , Afshin Abdi , Faramarz Fekri

Models with dimension more than the available sample size are now commonly used in various applications. A sensible inference is possible using a lower-dimensional structure. In regression problems with a large number of predictors, the…

Statistics Theory · Mathematics 2025-11-25 Sayantan Banerjee , Ismaël Castillo , Subhashis Ghosal

We revisit the probabilistic construction of sparse random matrices where each column has a fixed number of nonzeros whose row indices are drawn uniformly at random with replacement. These matrices have a one-to-one correspondence with the…

Information Theory · Computer Science 2013-07-16 Bubacarr Bah , Jared Tanner

We introduce a general framework for undirected graphical models. It generalizes Gaussian graphical models to a wide range of continuous, discrete, and combinations of different types of data. The models in the framework, called exponential…

Statistics Theory · Mathematics 2019-06-18 Rui Zhuang , Noah Simon , Johannes Lederer

Graphs are naturally sparse objects that are used to study many problems involving networks, for example, distributed learning and graph signal processing. In some cases, the graph is not given, but must be learned from the problem and…

Machine Learning · Statistics 2017-08-31 Martin Sundin , Arun Venkitaraman , Magnus Jansson , Saikat Chatterjee

Structured prediction requires searching over a combinatorial number of structures. To tackle it, we introduce SparseMAP: a new method for sparse structured inference, and its natural loss function. SparseMAP automatically selects only a…

Machine Learning · Statistics 2018-06-21 Vlad Niculae , André F. T. Martins , Mathieu Blondel , Claire Cardie

Recent years have seen an increasing popularity of learning the sparse \emph{changes} in Markov Networks. Changes in the structure of Markov Networks reflect alternations of interactions between random variables under different regimes and…

Machine Learning · Statistics 2017-01-10 Song Liu , Kenji Fukumizu , Taiji Suzuki

The problem of learning a directed acyclic graph (DAG) up to Markov equivalence is equivalent to the problem of finding a permutation of the variables that induces the sparsest graph. Without additional assumptions, this task is known to be…

Methodology · Statistics 2020-11-10 Chandler Squires , Joshua Amaniampong , Caroline Uhler