English
Related papers

Related papers: Graph-based Generalization Bounds for Learning Bin…

200 papers

This article provides an original understanding of the behavior of a class of graph-oriented semi-supervised learning algorithms in the limit of large and numerous data. It is demonstrated that the intuition at the root of these methods…

Machine Learning · Computer Science 2017-11-10 Xiaoyi Mai , Romain Couillet

spectral-based subspace learning is a common data preprocessing step in many machine learning pipelines. The main aim is to learn a meaningful low dimensional embedding of the data. However, most subspace learning methods do not take into…

Machine Learning · Computer Science 2023-06-14 Firas Laakom , Jenni Raitoharju , Nikolaos Passalis , Alexandros Iosifidis , Moncef Gabbouj

Outstanding achievements of graph neural networks for spatiotemporal time series analysis show that relational constraints introduce an effective inductive bias into neural forecasting architectures. Often, however, the relational…

Machine Learning · Computer Science 2023-08-03 Andrea Cini , Daniele Zambon , Cesare Alippi

Graphs are a natural representation for systems based on relations between connected entities. Combinatorial optimization problems, which arise when considering an objective function related to a process of interest on discrete structures,…

Machine Learning · Computer Science 2024-08-21 Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi

Graph Neural Networks (GNNs) have become essential in interpreting relational data across various domains, yet, they often struggle to generalize to unseen graph data that differs markedly from training instances. In this paper, we…

Machine Learning · Computer Science 2024-12-10 Xinke Jiang , Rihong Qiu , Yongxin Xu , Wentao Zhang , Yichen Zhu , Ruizhe Zhang , Yuchen Fang , Xu Chu , Junfeng Zhao , Yasha Wang

Existing generalization bounds fail to explain crucial factors that drive the generalization of modern neural networks. Since such bounds often hold uniformly over all parameters, they suffer from over-parametrization and fail to account…

Machine Learning · Statistics 2023-11-14 Songyan Hou , Parnian Kassraie , Anastasis Kratsios , Andreas Krause , Jonas Rothfuss

In this work, we propose a notion of practical learnability grounded in finite sample settings, and develop a conjugate learning theoretical framework based on convex conjugate duality to characterize this learnability property. Building on…

Machine Learning · Statistics 2026-02-20 Binchuan Qi

Current graph neural networks (GNNs) lack generalizability with respect to scales (graph sizes, graph diameters, edge weights, etc..) when solving many graph analysis problems. Taking the perspective of synthesizing graph theory programs,…

Machine Learning · Computer Science 2020-10-27 Hao Tang , Zhiao Huang , Jiayuan Gu , Bao-Liang Lu , Hao Su

Graph-based semi-supervised learning is a powerful paradigm in machine learning for modeling and exploiting the underlying graph structure that captures the relationship between labeled and unlabeled data. A large number of classical as…

Machine Learning · Computer Science 2025-07-17 Ally Yalei Du , Eric Huang , Dravyansh Sharma

A graph neural network transforms features in each vertex's neighborhood into a vector representation of the vertex. Afterward, each vertex's representation is used independently for predicting its label. This standard pipeline implicitly…

Machine Learning · Computer Science 2020-06-18 Junteng Jia , Austin R. Benson

We propose a new framework for discovering landmarks that automatically generalize across a domain. These generalized landmarks are learned from a set of solved instances and describe intermediate goals for planning problems where…

Artificial Intelligence · Computer Science 2025-09-01 Issa Hanou , Sebastijan Dumančić , Mathijs de Weerdt

Graph learning from data represents a canonical problem that has received substantial attention in the literature. However, insufficient work has been done in incorporating prior structural knowledge onto the learning of underlying…

Machine Learning · Statistics 2019-04-23 Sandeep Kumar , Jiaxi Ying , José Vinícius de M. Cardoso , Daniel Palomar

We consider information-theoretic bounds on expected generalization error for statistical learning problems in a networked setting. In this setting, there are $K$ nodes, each with its own independent dataset, and the models from each node…

Information Theory · Computer Science 2024-01-17 L. P. Barnes , Alex Dytso , H. V. Poor

Transfer learning methods address the situation where little labeled training data from the "target" problem exists, but much training data from a related "source" domain is available. However, the overwhelming majority of transfer learning…

Machine Learning · Computer Science 2017-12-27 Aubrey Gress , Ian Davidson

Graphs are used in many disciplines to model the relationships that exist between objects in a complex discrete system. Researchers may wish to compare a network of interest to a "typical" graph from a family (or ensemble) of graphs which…

Combinatorics · Mathematics 2025-08-08 Catherine Greenhill

Graphical model selection is a seemingly impossible task when many pairs of variables are never jointly observed; this requires inference of conditional dependencies with no observations of corresponding marginal dependencies. This…

Statistics Theory · Mathematics 2023-02-16 Giuseppe Vinci , Gautam Dasarathy , Genevera I. Allen

Graph-based semi-supervised learning usually involves two separate stages, constructing an affinity graph and then propagating labels for transductive inference on the graph. It is suboptimal to solve them independently, as the correlation…

Computer Vision and Pattern Recognition · Computer Science 2019-02-19 Qilin Li , Senjian An , Ling Li , Wanquan Liu

For the problem of binary linear classification and feature selection, we propose algorithmic approaches to classifier design based on the generalized approximate message passing (GAMP) algorithm, recently proposed in the context of…

Information Theory · Computer Science 2015-06-18 Justin Ziniel , Philip Schniter , Per Sederberg

Graph Neural Networks (GNNs), a generalization of deep neural networks on graph data have been widely used in various domains, ranging from drug discovery to recommender systems. However, GNNs on such applications are limited when there are…

Machine Learning · Computer Science 2021-11-09 Debmalya Mandal , Sourav Medya , Brian Uzzi , Charu Aggarwal

In this paper, we propose a novel graph-based approach for semi-supervised learning problems, which considers an adaptive adjacency of the examples throughout the unsupervised portion of the training. Adjacency of the examples is inferred…

Machine Learning · Computer Science 2020-08-06 Ozsel Kilinc , Ismail Uysal