English
Related papers

Related papers: Learning Gaussian Graphical Models with Observed o…

200 papers

This work proposes an algorithmic framework to learn time-varying graphs from online data. The generality offered by the framework renders it model-independent, i.e., it can be theoretically analyzed in its abstract formulation and then…

Machine Learning · Computer Science 2022-05-25 Alberto Natali , Elvin Isufi , Mario Coutino , Geert Leus

Graphs are a powerful data structure to represent relational data and are widely used to describe complex real-world data structures. Probabilistic Graphical Models (PGMs) have been well-developed in the past years to mathematically model…

Artificial Intelligence · Computer Science 2023-01-31 Chenqing Hua , Sitao Luan , Qian Zhang , Jie Fu

We show that a collection of Gaussian mixture models (GMMs) in $R^{n}$ can be optimally classified using $O(n)$ neurons in a neural network with two hidden layers (deep neural network), whereas in contrast, a neural network with a single…

Machine Learning · Computer Science 2019-02-18 Shirin Jalali , Carl Nuzman , Iraj Saniee

We present an algorithm to identify sparse dependence structure in continuous and non-Gaussian probability distributions, given a corresponding set of data. The conditional independence structure of an arbitrary distribution can be…

Machine Learning · Computer Science 2017-11-07 Rebecca E. Morrison , Ricardo Baptista , Youssef Marzouk

We consider structure discovery of undirected graphical models from observational data. Inferring likely structures from few examples is a complex task often requiring the formulation of priors and sophisticated inference procedures.…

Machine Learning · Statistics 2017-08-04 Eugene Belilovsky , Kyle Kastner , Gaël Varoquaux , Matthew Blaschko

Graph Neural Networks (GNNs) have shown superior performance in node classification. However, GNNs perform poorly in the Few-Shot Node Classification (FSNC) task that requires robust generalization to make accurate predictions for unseen…

Machine Learning · Computer Science 2024-10-23 Yihong Luo , Yuhan Chen , Siya Qiu , Yiwei Wang , Chen Zhang , Yan Zhou , Xiaochun Cao , Jing Tang

Restricted Boltzmann Machines (RBMs) are a common family of undirected graphical models with latent variables. An RBM is described by a bipartite graph, with all observed variables in one layer and all latent variables in the other. We…

Machine Learning · Computer Science 2020-10-20 Guy Bresler , Rares-Darius Buhai

The Gaussian graphical model (GGM) incorporates an undirected graph to represent the conditional dependence between variables, with the precision matrix encoding partial correlation between pair of variables given the others. To achieve…

Methodology · Statistics 2023-07-03 Yueqi Qian , Xianghong Hu , Can Yang

3D Gaussian Splatting (3DGS) has demonstrated impressive novel view synthesis performance. While conventional methods require per-scene optimization, more recently several feed-forward methods have been proposed to generate pixel-aligned…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Shengjun Zhang , Xin Fei , Fangfu Liu , Haixu Song , Yueqi Duan

Generative adversarial networks (GANs) learn the distribution of observed samples through a zero-sum game between two machine players, a generator and a discriminator. While GANs achieve great success in learning the complex distribution of…

Machine Learning · Computer Science 2020-06-19 Farzan Farnia , William Wang , Subhro Das , Ali Jadbabaie

Graph Convolutional Networks (GCNs) are extensively utilized for deep learning on graphs. The large data sizes of graphs and their vertex features make scalable training algorithms and distributed memory systems necessary. Since the…

Machine Learning · Computer Science 2022-12-14 Gunduz Vehbi Demirci , Aparajita Haldar , Hakan Ferhatosmanoglu

In many structured prediction problems, complex relationships between variables are compactly defined using graphical structures. The most prevalent graphical prediction methods---probabilistic graphical models and large margin…

Machine Learning · Statistics 2018-11-08 Rizal Fathony , Ashkan Rezaei , Mohammad Ali Bashiri , Xinhua Zhang , Brian D. Ziebart

Node representation learning by using Graph Neural Networks (GNNs) has been widely explored. However, in recent years, compelling evidence has revealed that GNN-based node representation learning can be substantially deteriorated by…

Machine Learning · Computer Science 2023-12-19 Jun Zhuang , Mohammad Al Hasan

Understanding the impact of data structure on the computational tractability of learning is a key challenge for the theory of neural networks. Many theoretical works do not explicitly model training data, or assume that inputs are drawn…

Machine Learning · Statistics 2022-05-23 Sebastian Goldt , Bruno Loureiro , Galen Reeves , Florent Krzakala , Marc Mézard , Lenka Zdeborová

Machine learning frameworks such as graph neural networks typically rely on a given, fixed graph to exploit relational inductive biases and thus effectively learn from network data. However, when said graphs are (partially) unobserved,…

Machine Learning · Computer Science 2022-05-20 Max Wasserman , Saurabh Sihag , Gonzalo Mateos , Alejandro Ribeiro

This paper presents an efficient variational inference framework for deriving a family of structured gaussian process regression network (SGPRN) models. The key idea is to incorporate auxiliary inducing variables in latent functions and…

Machine Learning · Computer Science 2021-11-19 Rui Meng , Herbie Lee , Kristofer Bouchard

We explore the use of graph neural networks (GNNs) to model spatial processes in which there is no a priori graphical structure. Similar to finite element analysis, we assign nodes of a GNN to spatial locations and use a computational…

Machine Learning · Computer Science 2019-11-19 Ferran Alet , Adarsh K. Jeewajee , Maria Bauza , Alberto Rodriguez , Tomas Lozano-Perez , Leslie Pack Kaelbling

Probabilistic graphical models (PGMs) are widely used to discover latent structure in data, but their success hinges on selecting an appropriate model design. In practice, model specification is difficult and often requires iterative…

Machine Learning · Computer Science 2026-04-08 Kevin Zhang , Yixin Wang

Hidden Markov models (HMMs) are powerful tools for analysing time series data that depend on discrete underlying but unobserved states. As such, they have gained prominence across numerous empirical disciplines, in particular ecology,…

Methodology · Statistics 2026-03-19 Jan-Ole Fischer

In this paper, we study the problem of learning multi-dimensional Gaussian Mixture Models (GMMs), with a specific focus on model order selection and efficient mixing distribution estimation. We first establish an information-theoretic lower…

Machine Learning · Statistics 2026-03-23 Xinyu Liu , Hai Zhang