English
Related papers

Related papers: Accelerating Bayesian Structure Learning in Sparse…

200 papers

The Gaussian graphical model, a popular paradigm for studying relationship among variables in a wide range of applications, has attracted great attention in recent years. This paper considers a fundamental question: When is it possible to…

Statistics Theory · Mathematics 2015-06-04 Zhao Ren , Tingni Sun , Cun-Hui Zhang , Harrison H. Zhou

The proliferation of automated inference algorithms in Bayesian statistics has provided practitioners newfound access to fast, reproducible data analysis and powerful statistical models. Designing automated methods that are also both…

Machine Learning · Statistics 2019-10-29 Trevor Campbell , Boyan Beronov

In recent literature, the Gaussian Graphical model (GGM; Lauritzen, 1996),a network of partial correlation coefficients, has been used to capture potential dynamic relationships between observed variables. The GGM can be estimated using…

Methodology · Statistics 2017-09-25 Sacha Epskamp

In probabilstic supervised learning of an input-output relationship - as a sample function of a Gaussian Process (GP) - priors are typically specified for the hyperparameters of the kernel that parametrises the covariance function of the…

Machine Learning · Statistics 2026-05-27 Kane Warrior , Dalia Chakrabarty

We propose estimating Gaussian graphical models (GGMs) that are fair with respect to sensitive nodal attributes. Many real-world models exhibit unfair discriminatory behavior due to biases in data. Such discrimination is known to be…

Machine Learning · Statistics 2024-06-17 Madeline Navarro , Samuel Rey , Andrei Buciulea , Antonio G. Marques , Santiago Segarra

Studying conditional independence among many variables with few observations is a challenging task. Gaussian Graphical Models (GGMs) tackle this problem by encouraging sparsity in the precision matrix through $l_q$ regularization with…

Machine Learning · Computer Science 2023-11-17 Marcello Massimo Negri , F. Arend Torres , Volker Roth

Similarity graphs are an active research direction for the nearest neighbor search (NNS) problem. New algorithms for similarity graph construction are continuously being proposed and analyzed by both theoreticians and practitioners.…

Machine Learning · Computer Science 2020-02-14 Dmitry Baranchuk , Artem Babenko

We propose a novel sparse spectrum approximation of Gaussian process (GP) tailored for Bayesian optimization. Whilst the current sparse spectrum methods provide desired approximations for regression problems, it is observed that this…

Machine Learning · Computer Science 2020-06-09 Ang Yang , Cheng Li , Santu Rana , Sunil Gupta , Svetha Venkatesh

Computational efficiency is a major bottleneck in using classic graph-based approaches for semi-supervised learning on datasets with a large number of unlabeled examples. Known techniques to improve efficiency typically involve an…

Machine Learning · Computer Science 2023-06-13 Dravyansh Sharma , Maxwell Jones

Traditional approaches to Bayes net structure learning typically assume little regularity in graph structure other than sparseness. However, in many cases, we expect more systematicity: variables in real-world systems often group into…

Machine Learning · Computer Science 2012-07-02 Vikash Mansinghka , Charles Kemp , Thomas Griffiths , Joshua Tenenbaum

Genetical genomics experiments have now been routinely conducted to measure both the genetic markers and gene expression data on the same subjects. The gene expression levels are often treated as quantitative traits and are subject to…

Applications · Statistics 2012-03-01 Jianxin Yin , Hongzhe Li

Stochastic optimization algorithms update models with cheap per-iteration costs sequentially, which makes them amenable for large-scale data analysis. Such algorithms have been widely studied for structured sparse models where the sparsity…

Machine Learning · Computer Science 2019-05-10 Baojian Zhou , Feng Chen , Yiming Ying

In Gaussian graphical model selection, noise-corrupted samples present significant challenges. It is known that even minimal amounts of noise can obscure the underlying structure, leading to fundamental identifiability issues. A recent line…

Machine Learning · Statistics 2024-05-09 Abrar Zahin , Rajasekhar Anguluri , Lalitha Sankar , Oliver Kosut , Gautam Dasarathy

In image reconstruction, an accurate quantification of uncertainty is of great importance for informed decision making. Here, the Bayesian approach to inverse problems can be used: the image is represented through a random function that…

Numerical Analysis · Mathematics 2025-04-24 Jonas Latz , Aretha L. Teckentrup , Simon Urbainczyk

Graph learning from data represents a canonical problem that has received substantial attention in the literature. However, insufficient work has been done in incorporating prior structural knowledge onto the learning of underlying…

Machine Learning · Statistics 2019-04-23 Sandeep Kumar , Jiaxi Ying , José Vinícius de M. Cardoso , Daniel Palomar

Learning a Gaussian Mixture Model (GMM) is hard when the number of parameters is too large given the amount of available data. As a remedy, we propose restricting the GMM to a Gaussian Markov Random Field Mixture Model (GMRF-MM), as well as…

Machine Learning · Computer Science 2022-01-25 Shahaf E. Finder , Eran Treister , Oren Freifeld

Cross-modal metric learning is a prominent research topic that bridges the semantic heterogeneity between vision and language. Existing methods frequently utilize simple cosine or complex distance metrics to transform the pairwise features…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Haiwen Diao , Ying Zhang , Shang Gao , Jiawen Zhu , Long Chen , Huchuan Lu

One of the most challenging tasks when adopting Bayesian Networks (BNs) is the one of learning their structure from data. This task is complicated by the huge search space of possible solutions, and by the fact that the problem is NP-hard.…

Machine Learning · Computer Science 2018-08-07 Stefano Beretta , Mauro Castelli , Ivo Goncalves , Roberto Henriques , Daniele Ramazzotti

A Bayesian approach is used to estimate the covariance matrix of Gaussian data. Ideas from Gaussian graphical models and model selection are used to construct a prior for the covariance matrix that is a mixture over all decomposable graphs.…

Methodology · Statistics 2007-06-12 Helen Armstrong , Christopher K. Carter , Kevin F. Wong , Robert Kohn

We study the estimation of the latent variable Gaussian graphical model (LVGGM), where the precision matrix is the superposition of a sparse matrix and a low-rank matrix. In order to speed up the estimation of the sparse plus low-rank…

Machine Learning · Statistics 2017-03-01 Pan Xu , Jian Ma , Quanquan Gu