English
Related papers

Related papers: Deep Gaussian Markov Random Fields for Graph-Struc…

200 papers

Hidden Markov models (HMMs) are powerful tools for analysing time series data that depend on discrete underlying but unobserved states. As such, they have gained prominence across numerous empirical disciplines, in particular ecology,…

Methodology · Statistics 2026-03-19 Jan-Ole Fischer

We propose a Bayesian approximate inference method for learning the dependence structure of a Gaussian graphical model. Using pseudo-likelihood, we derive an analytical expression to approximate the marginal likelihood for an arbitrary…

Machine Learning · Statistics 2017-04-13 Janne Leppä-aho , Johan Pensar , Teemu Roos , Jukka Corander

We present a generic framework for spatio-temporal (ST) data modeling, analysis, and forecasting, with a special focus on data that is sparse in both space and time. Our multi-scaled framework is a seamless coupling of two major components:…

Machine Learning · Computer Science 2018-04-04 Bao Wang , Xiyang Luo , Fangbo Zhang , Baichuan Yuan , Andrea L. Bertozzi , P. Jeffrey Brantingham

We propose Graphical Generative Adversarial Networks (Graphical-GAN) to model structured data. Graphical-GAN conjoins the power of Bayesian networks on compactly representing the dependency structures among random variables and that of…

Machine Learning · Computer Science 2018-12-18 Chongxuan Li , Max Welling , Jun Zhu , Bo Zhang

We introduce the probabilistic sequential matrix factorization (PSMF) method for factorizing time-varying and non-stationary datasets consisting of high-dimensional time-series. In particular, we consider nonlinear Gaussian state-space…

Machine Learning · Statistics 2021-03-19 Ömer Deniz Akyildiz , Gerrit J. J. van den Burg , Theodoros Damoulas , Mark F. J. Steel

Reinforcement learning is well known for its ability to model sequential tasks and learn latent data patterns adaptively. Deep learning models have been widely explored and adopted in regression and classification tasks. However, deep…

Machine Learning · Computer Science 2025-06-17 Thanveer Shaik , Xiaohui Tao , Haoran Xie , Lin Li , Jianming Yong , Yuefeng Li

Hybrid-Vlasov simulations resolve ion-kinetic effects in the solar wind-magnetosphere interaction, but even 5D (2D + 3V) configurations are computationally expensive. We show that graph-based machine learning emulators can learn the…

Latent variable time-series models are among the most heavily used tools from machine learning and applied statistics. These models have the advantage of learning latent structure both from noisy observations and from the temporal ordering…

Machine Learning · Statistics 2015-11-24 Evan Archer , Il Memming Park , Lars Buesing , John Cunningham , Liam Paninski

In this paper, we propose a new estimation procedure for discovering the structure of Gaussian Markov random fields (MRFs) with false discovery rate (FDR) control, making use of the sorted l1-norm (SL1) regularization. A Gaussian MRF is an…

Machine Learning · Statistics 2019-10-25 Sangkyun Lee , Piotr Sobczyk , Malgorzata Bogdan

This paper presents an efficient variational inference framework for deriving a family of structured gaussian process regression network (SGPRN) models. The key idea is to incorporate auxiliary inducing variables in latent functions and…

Machine Learning · Computer Science 2021-11-19 Rui Meng , Herbie Lee , Kristofer Bouchard

A key goal of unsupervised learning is to go beyond density estimation and sample generation to reveal the structure inherent within observed data. Such structure can be expressed in the pattern of interactions between explanatory latent…

Machine Learning · Computer Science 2022-11-11 Changmin Yu , Hugo Soulat , Neil Burgess , Maneesh Sahani

Bayesian estimation of Gaussian graphical models has proven to be challenging because the conjugate prior distribution on the Gaussian precision matrix, the G-Wishart distribution, has a doubly intractable partition function. Recent…

Neurons and Cognition · Quantitative Biology 2014-09-10 Max Hinne , Alex Lenkoski , Tom Heskes , Marcel van Gerven

This work attempts to approximate a linear Gaussian system with a finite-state hidden Markov model (HMM), which is found useful in solving sophisticated event-based state estimation problems. An indirect modeling approach is developed,…

Systems and Control · Electrical Eng. & Systems 2020-07-10 Kaikai Zheng , Dawei Shi , Ling Shi

We study linear models under heavy-tailed priors from a probabilistic viewpoint. Instead of computing a single sparse most probable (MAP) solution as in standard deterministic approaches, the focus in the Bayesian compressed sensing…

Computer Vision and Pattern Recognition · Computer Science 2014-03-05 George Papandreou , Alan Yuille

Graphs are fundamental data structures which concisely capture the relational structure in many important real-world domains, such as knowledge graphs, physical and social interactions, language, and chemistry. Here we introduce a powerful…

Machine Learning · Computer Science 2018-03-12 Yujia Li , Oriol Vinyals , Chris Dyer , Razvan Pascanu , Peter Battaglia

Gaussian graphical models (GGM) have been widely used in many high-dimensional applications ranging from biological and financial data to recommender systems. Sparsity in GGM plays a central role both statistically and computationally.…

Machine Learning · Statistics 2014-06-12 Zhaoshi Meng , Brian Eriksson , Alfred O. Hero

Devising and analyzing learning models for spatiotemporal network data is of importance for tasks including forecasting, anomaly detection, and multi-agent coordination, among others. Graph Convolutional Neural Networks (GCNNs) are an…

Machine Learning · Computer Science 2022-07-01 Mohammad Sabbaqi , Elvin Isufi

Deep Gaussian Processes learn probabilistic data representations for supervised learning by cascading multiple Gaussian Processes. While this model family promises flexible predictive distributions, exact inference is not tractable.…

Machine Learning · Statistics 2020-10-23 Jakob Lindinger , David Reeb , Christoph Lippert , Barbara Rakitsch

We introduce Graph-Structured Sum-Product Networks (GraphSPNs), a probabilistic approach to structured prediction for problems where dependencies between latent variables are expressed in terms of arbitrary, dynamic graphs. While many…

Machine Learning · Computer Science 2017-11-23 Kaiyu Zheng , Andrzej Pronobis , Rajesh P. N. Rao

We propose a nonparametric procedure to achieve fast inference in generative graphical models when the number of latent states is very large. The approach is based on iterative latent variable preselection, where we alternate between…

Machine Learning · Statistics 2021-10-06 Jacquelyn A. Shelton , Jan Gasthaus , Zhenwen Dai , Joerg Luecke , Arthur Gretton