English
Related papers

Related papers: Discrete Curvature Graph Information Bottleneck

200 papers

Self-supervised learning is gaining considerable attention as a solution to avoid the requirement of extensive annotations in representation learning on graphs. Current algorithms are based on contrastive learning, which is computation an…

Machine Learning · Computer Science 2023-09-06 Oscar Pina , Verónica Vilaplana

Since the proposal of the graph neural network (GNN) by Gori et al. (2005) and Scarselli et al. (2008), one of the major problems in training GNNs was their struggle to propagate information between distant nodes in the graph. We propose a…

Machine Learning · Computer Science 2021-03-10 Uri Alon , Eran Yahav

Molecular relational learning, whose goal is to learn the interaction behavior between molecular pairs, got a surge of interest in molecular sciences due to its wide range of applications. Recently, graph neural networks have recently shown…

Molecular Networks · Quantitative Biology 2023-07-11 Namkyeong Lee , Dongmin Hyun , Gyoung S. Na , Sungwon Kim , Junseok Lee , Chanyoung Park

Recent years have witnessed great success in handling graph-related tasks with Graph Neural Networks (GNNs). However, most existing GNNs are based on message passing to perform feature aggregation and transformation, where the structural…

Machine Learning · Computer Science 2024-09-10 Lirong Wu , Haitao Lin , Guojiang Zhao , Cheng Tan , Stan Z. Li

The integration of Spiking Neural Networks (SNNs) and Graph Neural Networks (GNNs) is gradually attracting attention due to the low power consumption and high efficiency in processing the non-Euclidean data represented by graphs. However,…

Neural and Evolutionary Computing · Computer Science 2025-07-15 Nan Yin , Mengzhu Wang , Zhenghan Chen , Giulia De Masi , Bin Gu , Huan Xiong

Collaborative perception systems leverage multiple edge devices, such surveillance cameras or autonomous cars, to enhance sensing quality and eliminate blind spots. Despite their advantages, challenges such as limited channel capacity and…

Networking and Internet Architecture · Computer Science 2025-01-07 Zhengru Fang , Senkang Hu , Jingjing Wang , Yiqin Deng , Xianhao Chen , Yuguang Fang

The richness in the content of various information networks such as social networks and communication networks provides the unprecedented potential for learning high-quality expressive representations without external supervision. This…

Machine Learning · Computer Science 2020-02-06 Zhen Peng , Wenbing Huang , Minnan Luo , Qinghua Zheng , Yu Rong , Tingyang Xu , Junzhou Huang

Geometric deep learning (GDL) models have demonstrated a great potential for the analysis of non-Euclidian data. They are developed to incorporate the geometric and topological information of non-Euclidian data into the end-to-end deep…

Machine Learning · Computer Science 2023-06-26 Cong Shen , Xiang Liu , Jiawei Luo , Kelin Xia

In this paper, we consider the problem of approximately aligning/matching two graphs. Given two graphs $G_{1}=(V_{1},E_{1})$ and $G_{2}=(V_{2},E_{2})$, the objective is to map nodes $u, v \in G_1$ to nodes $u',v'\in G_2$ such that when $u,…

Social and Information Networks · Computer Science 2018-09-11 Chien-Chun Ni , Yu-Yao Lin , Jie Gao , Xianfeng David Gu

Recently, Graph Convolutional Networks (GCNs) and their variants have been receiving many research interests for learning graph-related tasks. While the GCNs have been successfully applied to this problem, some caveats inherited from…

Machine Learning · Computer Science 2019-11-11 Mustafa Coskun

The Information Bottleneck (IB) principle offers an information-theoretic framework for analyzing the training process of deep neural networks (DNNs). Its essence lies in tracking the dynamics of two mutual information (MI) values: between…

Machine Learning · Computer Science 2024-05-10 Ivan Butakov , Alexander Tolmachev , Sofia Malanchuk , Anna Neopryatnaya , Alexey Frolov , Kirill Andreev

Graph condensation (GC), which reduces the size of a large-scale graph by synthesizing a small-scale condensed graph as its substitution, has benefited various graph learning tasks. However, existing GC methods rely on centralized data…

Machine Learning · Computer Science 2024-12-23 Bo Yan , Sihao He , Cheng Yang , Shang Liu , Yang Cao , Chuan Shi

Most Graph Neural Networks follow the message-passing paradigm, assuming the observed structure depicts the ground-truth node relationships. However, this fundamental assumption cannot always be satisfied, as real-world graphs are always…

Machine Learning · Computer Science 2023-01-03 Qingyun Sun , Jianxin Li , Beining Yang , Xingcheng Fu , Hao Peng , Philip S. Yu

Graphs effectively characterize relational data, driving graph representation learning methods that uncover underlying predictive information. As state-of-the-art approaches, Graph Neural Networks (GNNs) enable end-to-end learning for…

Machine Learning · Computer Science 2025-04-24 Mao Wang , Tao Wu , Xingping Xian , Shaojie Qiao , Weina Niu , Canyixing Cui

Graph Neural Networks (GNNs) are exemplary deep models designed for graph data. Message passing mechanism enables GNNs to effectively capture graph topology and push the performance boundaries across various graph tasks. However, the trend…

Neural and Evolutionary Computing · Computer Science 2025-09-29 Huizhe Zhang , Jintang Li , Yuchang Zhu , Liang Chen , Li Kuang

Graph convolution is the core of most Graph Neural Networks (GNNs) and usually approximated by message passing between direct (one-hop) neighbors. In this work, we remove the restriction of using only the direct neighbors by introducing a…

Social and Information Networks · Computer Science 2022-04-06 Johannes Gasteiger , Stefan Weißenberger , Stephan Günnemann

Deep Neural Nets (DNNs) learn latent representations induced by their downstream task, objective function, and other parameters. The quality of the learned representations impacts the DNN's generalization ability and the coherence of the…

Machine Learning · Computer Science 2024-02-13 Nir Weingarten , Zohar Yakhini , Moshe Butman , Ran Gilad-Bachrach

Graph Neural Networks (GNNs) have achieved great successes in many learning tasks performed on graph structures. Nonetheless, to propagate information GNNs rely on a message passing scheme which can become prohibitively expensive when…

Machine Learning · Computer Science 2022-11-09 Ariel R. Ramos Vela , Johannes F. Lutzeyer , Anastasios Giovanidis , Michalis Vazirgiannis

Graphs provide a powerful means for representing complex interactions between entities. Recently, deep learning approaches are emerging for representing and modeling graph-structured data, although the conventional deep learning methods…

Neural and Evolutionary Computing · Computer Science 2016-12-06 Jaekoo Lee , Hyunjae Kim , Jongsun Lee , Sungroh Yoon

Graph condensation (GC) aims to distill the original graph into a small-scale graph, mitigating redundancy and accelerating GNN training. However, conventional GC approaches heavily rely on rigid GNNs and task-specific supervision. Such a…

Machine Learning · Computer Science 2025-09-19 Yeyu Yan , Shuai Zheng , Wenjun Hui , Xiangkai Zhu , Dong Chen , Zhenfeng Zhu , Yao Zhao , Kunlun He