English
Related papers

Related papers: Adaptive Message Passing: A General Framework to M…

200 papers

Oversmoothing is a central challenge of building more powerful Graph Neural Networks (GNNs). While previous works have only demonstrated that oversmoothing is inevitable when the number of graph convolutions tends to infinity, in this…

Machine Learning · Computer Science 2023-03-02 Xinyi Wu , Zhengdao Chen , William Wang , Ali Jadbabaie

Existing message passing neural networks for heterogeneous graphs rely on the concepts of meta-paths or meta-graphs due to the intrinsic nature of heterogeneous graphs. However, the meta-paths and meta-graphs need to be pre-configured…

Machine Learning · Computer Science 2022-10-27 Jiwoong Park , Jisu Jeong , Kyungmin Kim , Jin Young Choi

We propose Dynamically Pruned Message Passing Networks (DPMPN) for large-scale knowledge graph reasoning. In contrast to existing models, embedding-based or path-based, we learn an input-dependent subgraph to explicitly model reasoning…

Artificial Intelligence · Computer Science 2020-04-09 Xiaoran Xu , Wei Feng , Yunsheng Jiang , Xiaohui Xie , Zhiqing Sun , Zhi-Hong Deng

Graph convolutional networks (GCNs) have achieved remarkable learning ability for dealing with various graph structural data recently. In general, deep GCNs do not work well since graph convolution in conventional GCNs is a special form of…

Machine Learning · Computer Science 2021-12-08 Zhilong Xiong , Jia Cai

Information over-squashing is a phenomenon of inefficient information propagation between distant nodes on networks. It is an important problem that is known to significantly impact the training of graph neural networks (GNNs), as the…

Machine Learning · Statistics 2022-07-19 Jakub Bober , Anthea Monod , Emil Saucan , Kevin N. Webster

Social networks represent a common form of interconnected data frequently depicted as graphs within the domain of deep learning-based inference. These communities inherently form dynamic systems, achieving stability through continuous…

Social and Information Networks · Computer Science 2023-10-04 Outongyi Lv , Bingxin Zhou , Jing Wang , Xiang Xiao , Weishu Zhao , Lirong Zheng

Information on social media spreads through an underlying diffusion network that connects people of common interests and opinions. This diffusion network often comprises multiple layers, each capturing the spreading dynamics of a certain…

Social and Information Networks · Computer Science 2024-10-08 Yan Xia , Ted Hsuan Yun Chen , Mikko Kivelä

Social relationships (e.g., friends, couple etc.) form the basis of the social network in our daily life. Automatically interpreting such relationships bears a great potential for the intelligent systems to understand human behavior in…

Computer Vision and Pattern Recognition · Computer Science 2018-07-03 Zhouxia Wang , Tianshui Chen , Jimmy Ren , Weihao Yu , Hui Cheng , Liang Lin

This paper presents a framework for deep transfer learning, which aims to leverage information from multi-domain upstream data with a large number of samples $n$ to a single-domain downstream task with a considerably smaller number of…

Machine Learning · Computer Science 2025-01-07 Yuling Jiao , Huazhen Lin , Yuchen Luo , Jerry Zhijian Yang

Message-passing graph neural networks (MPNNs) emerged as powerful tools for processing graph-structured input. However, they operate on a fixed input graph structure, ignoring potential noise and missing information. Furthermore, their…

Machine Learning · Computer Science 2024-03-27 Chendi Qian , Andrei Manolache , Kareem Ahmed , Zhe Zeng , Guy Van den Broeck , Mathias Niepert , Christopher Morris

Graph pattern matching algorithms to handle million-scale dynamic graphs are widely used in many applications such as social network analytics and suspicious transaction detections from financial networks. On the other hand, the computation…

Databases · Computer Science 2019-07-10 Hiroki Kanezashi , Toyotaro Suzumura , Dario Garcia-Gasulla , Min-hwan Oh , Satoshi Matsuoka

Message Passing Neural Networks (MPNNs) are a staple of graph machine learning. MPNNs iteratively update each node's representation in an input graph by aggregating messages from the node's neighbors, which necessitates a memory complexity…

Machine Learning · Computer Science 2024-12-24 Ben Finkelshtein , İsmail İlkan Ceylan , Michael Bronstein , Ron Levie

Graphs are fundamental data structures which concisely capture the relational structure in many important real-world domains, such as knowledge graphs, physical and social interactions, language, and chemistry. Here we introduce a powerful…

Machine Learning · Computer Science 2018-03-12 Yujia Li , Oriol Vinyals , Chris Dyer , Razvan Pascanu , Peter Battaglia

Understanding the structural complexity and predictability of complex networks is a central challenge in network science. Although recent studies have revealed a relationship between compression-based entropy and link prediction…

Social and Information Networks · Computer Science 2025-10-14 Sebastián Brzovic , Cristóbal Rojas , Andrés Abeliuk

Graph Convolutional Networks (GCNs) are known to suffer from performance degradation as the number of layers increases, which is usually attributed to over-smoothing. Despite the apparent consensus, we observe that there exists a…

Machine Learning · Computer Science 2021-10-29 Weilin Cong , Morteza Ramezani , Mehrdad Mahdavi

In recent years, network embedding methods have garnered increasing attention because of their effectiveness in various information retrieval tasks. The goal is to learn low-dimensional representations of vertexes in an information network…

Social and Information Networks · Computer Science 2017-11-02 Chih-Ming Chen , Yi-Hsuan Yang , Yian Chen , Ming-Feng Tsai

Graphon models provide a flexible nonparametric framework for estimating latent connectivity probabilities in networks, enabling a range of downstream applications such as link prediction and data augmentation. However, accurate graphon…

Machine Learning · Computer Science 2025-10-28 Yuyao Wang , Yu-Hung Cheng , Debarghya Mukherjee , Huimin Cheng

We present a probabilistic framework for overlapping community discovery and link prediction for relational data, given as a graph. The proposed framework has: (1) a deep architecture which enables us to infer multiple layers of latent…

Machine Learning · Statistics 2017-06-19 Changwei Hu , Piyush Rai , Lawrence Carin

Graph spanners are sparse subgraphs which approximately preserve all pairwise shortest-path distances in an input graph. The notion of approximation can be additive, multiplicative, or both, and many variants of this problem have been…

Data Structures and Algorithms · Computer Science 2019-11-19 Manuel Fernandez , David P. Woodruff , Taisuke Yasuda

Message passing neural networks (MPNNs) have emerged as go-to models for learning on graph-structured data in the past decade. Despite their effectiveness, most of such models still incur severe issues such as over-smoothing and…

Machine Learning · Computer Science 2025-11-26 Haoran Zheng , Renchi Yang , Yubo Zhou , Jianliang Xu