English
Related papers

Related papers: Generalization bounds for learning under graph-dep…

200 papers

In the process of building (structural learning) a probabilistic graphical model from a set of observed data, the directional, cyclic dependencies between the random variables of the model are often found. Existing graphical models such as…

Machine Learning · Computer Science 2023-10-26 Oleksii Sirotkin

Multiplex graphs, characterised by their layered structure, exhibit informative interdependencies within layers that are crucial for understanding complex network dynamics. Quantifying the interaction and shared information among these…

Statistics Theory · Mathematics 2024-05-24 Anda Skeja , Sofia C. Olhede

Graphical models have been popularly used for capturing conditional independence structure in multivariate data, which are often built upon independent and identically distributed observations, limiting their applicability to complex…

Methodology · Statistics 2025-07-03 Yuwen Wang , Changyu Liu , Xin He , Junhui Wang

Continual learning (CL) is concerned with learning multiple tasks sequentially without forgetting previously learned tasks. Despite substantial empirical advances over recent years, the theoretical development of CL remains in its infancy.…

Machine Learning · Computer Science 2026-04-27 Liangzu Peng , Uday Kiran Reddy Tadipatri , Ziqing Xu , Eric Eaton , René Vidal

Gaussian graphical models provide a powerful framework to reveal the conditional dependency structure between multivariate variables. The process of uncovering the conditional dependency network is known as structure learning. Bayesian…

Methodology · Statistics 2024-07-30 Lucas Vogels , Reza Mohammadi , Marit Schoonhoven , S. Ilker Birbil

We address catastrophic forgetting issues in graph learning as incoming data transits from one to another graph distribution. Whereas prior studies primarily tackle one setting of graph continual learning such as incremental node…

Machine Learning · Computer Science 2023-08-29 Thanh Duc Hoang , Do Viet Tung , Duy-Hung Nguyen , Bao-Sinh Nguyen , Huy Hoang Nguyen , Hung Le

We study computational and sample complexity of parameter and structure learning in graphical models. Our main result shows that the class of factor graphs with bounded factor size and bounded connectivity can be learned in polynomial time…

Machine Learning · Computer Science 2012-07-09 Pieter Abbeel , Daphne Koller , Andrew Y. Ng

Graphical model learning and inference are often performed using Bayesian techniques. In particular, learning is usually performed in two separate steps. First, the graph structure is learned from the data; then the parameters of the model…

Statistics Theory · Mathematics 2013-09-09 Marco Scutari

The covariance graph (aka bi-directed graph) of a probability distribution $p$ is the undirected graph $G$ where two nodes are adjacent iff their corresponding random variables are marginally dependent in $p$. In this paper, we present a…

Machine Learning · Statistics 2012-06-27 Jose M. Peña

There has been much recent interest in random graphs sampled uniformly from the n-vertex graphs in a suitable structured class, such as the class of all planar graphs. Here we consider a general 'bridge-addable' class of graphs - if a graph…

Combinatorics · Mathematics 2012-08-02 Colin McDiarmid

Score-based generative models (SGMs) have emerged as one of the most popular classes of generative models. A substantial body of work now exists on the analysis of SGMs, focusing either on discretization aspects or on their statistical…

Machine Learning · Statistics 2026-02-10 Benjamin Dupuis , Dario Shariatian , Maxime Haddouche , Alain Durmus , Umut Simsekli

Graph learning has rapidly evolved into a critical subfield of machine learning and artificial intelligence (AI). Its development began with early graph-theoretic methods, gaining significant momentum with the advent of graph neural…

Machine Learning · Computer Science 2025-11-10 Feng Xia , Ciyuan Peng , Jing Ren , Falih Gozi Febrinanto , Renqiang Luo , Vidya Saikrishna , Shuo Yu , Xiangjie Kong

Small language models fine-tuned for graph property estimation have demonstrated strong in-distribution performance, yet their generalization capabilities beyond training conditions remain poorly understood. In this work, we systematically…

Machine Learning · Computer Science 2026-04-21 Michal Podstawski

Graph Neural Networks (GNNs) extend convolutional neural networks to operate on graphs. Despite their impressive performances in various graph learning tasks, the theoretical understanding of their generalization capability is still…

Machine Learning · Computer Science 2025-06-10 Zhiyang Wang , Juan Cervino , Alejandro Ribeiro

In this work, we upper bound the generalization error of batch learning algorithms trained on samples drawn from a mixing stochastic process (i.e., a dependent data source) both in expectation and with high probability. Unlike previous…

Machine Learning · Computer Science 2025-02-20 Sagnik Chatterjee , Manuj Mukherjee , Alhad Sethi

Graphical models are commonly used to represent conditional dependence relationships between variables. There are multiple methods available for exploring them from high-dimensional data, but almost all of them rely on the assumption that…

Machine Learning · Statistics 2020-04-22 Tianxi Li , Cheng Qian , Elizaveta Levina , Ji Zhu

We consider a general statistical estimation problem wherein binary labels across different observations are not independent conditioned on their feature vectors, but dependent, capturing settings where e.g. these observations are collected…

Machine Learning · Computer Science 2021-07-22 Yuval Dagan , Constantinos Daskalakis , Nishanth Dikkala , Surbhi Goel , Anthimos Vardis Kandiros

This work proposes an algorithmic framework to learn time-varying graphs from online data. The generality offered by the framework renders it model-independent, i.e., it can be theoretically analyzed in its abstract formulation and then…

Machine Learning · Computer Science 2022-05-25 Alberto Natali , Elvin Isufi , Mario Coutino , Geert Leus

Statistical learning theory under independent and identically distributed (iid) sampling and online learning theory for worst case individual sequences are two of the best developed branches of learning theory. Statistical learning under…

Machine Learning · Statistics 2022-03-14 A. Philip Dawid , Ambuj Tewari

Traditional statistical theory assumes that the analysis to be performed on a given data set is selected independently of the data themselves. This assumption breaks downs when data are re-used across analyses and the analysis to be…

Machine Learning · Computer Science 2017-06-06 Adam Smith