English
Related papers

Related papers: Sequential Signal Mixing Aggregation for Message P…

200 papers

Recommender systems are essential components of modern online platforms which presents personalized content in various domain. The traditional collaborative filtering methods depends on static user-item interaction graphs and a limited…

Information Retrieval · Computer Science 2026-05-08 Aadarsh Senapati , Neha Kujur , Vivek Yelleti

Graph Neural Networks (GNNs) have shown great success in various graph-based learning tasks. However, it often faces the issue of over-smoothing as the model depth increases, which causes all node representations to converge to a single…

Machine Learning · Computer Science 2026-04-13 Xin He , Yili Wang , Wenqi Fan , Xu Shen , Xin Juan , Rui Miao , Xin Wang

Graph neural networks (GNN) typically rely on localized message passing, requiring increasing depth to capture long range dependencies. In this work, we introduce Graph Linear Transformations, a linear transformation that realizes direct…

Machine Learning · Computer Science 2026-01-19 Marshall Rosenhoover , Huaming Zhang

Many real-world graphs (networks) are heterogeneous with different types of nodes and edges. Heterogeneous graph embedding, aiming at learning the low-dimensional node representations of a heterogeneous graph, is vital for various…

Social and Information Networks · Computer Science 2021-12-15 Wentao Xu , Yingce Xia , Weiqing Liu , Jiang Bian , Jian Yin , Tie-Yan Liu

Graph Neural Networks (GNNs) have gained significant attention as a powerful modeling and inference method, especially for homophilic graph-structured data. To empower GNNs in heterophilic graphs, where adjacent nodes exhibit dissimilar…

Machine Learning · Computer Science 2024-06-03 Langzhang Liang , Sunwoo Kim , Kijung Shin , Zenglin Xu , Shirui Pan , Yuan Qi

Learning graph-structured data with graph neural networks (GNNs) has been recently emerging as an important field because of its wide applicability in bioinformatics, chemoinformatics, social network analysis and data mining. Recent GNN…

Machine Learning · Computer Science 2021-12-16 Cheolhyeong Kim , Haeseong Moon , Hyung Ju Hwang

In graph neural networks (GNNs), message passing iteratively aggregates nodes' information from their direct neighbors while neglecting the sequential nature of multi-hop node connections. Such sequential node connections e.g., metapaths,…

Large-scale decentralized learning frameworks such as federated learning (FL), require both communication efficiency and strong data security, motivating the study of secure aggregation (SA). While information-theoretic SA is well…

Information Theory · Computer Science 2026-01-28 Xiang Zhang , Zhou Li , Han Yu , Kai Wan , Hua Sun , Mingyue Ji , Giuseppe Caire

Graph Neural Networks (GNNs) have become a dominant approach to learning graph representations, primarily because of their message-passing mechanisms. However, GNNs typically adopt a fixed aggregator function such as Mean, Max, or Sum…

Machine Learning · Computer Science 2025-07-29 Xuanting Xie , Bingheng Li , Erlin Pan , Zhao Kang , Wenyu Chen

This paper studies asynchronous message passing (AMP), a new paradigm for applying neural network based learning to graphs. Existing graph neural networks use the synchronous distributed computing model and aggregate their neighbors in each…

Machine Learning · Computer Science 2022-05-25 Lukas Faber , Roger Wattenhofer

This paper introduces a Transformer-based integrative feature and cost aggregation network designed for dense matching tasks. In the context of dense matching, many works benefit from one of two forms of aggregation: feature aggregation,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Sunghwan Hong , Seokju Cho , Seungryong Kim , Stephen Lin

While Graph Neural Networks (GNNs) have achieved remarkable success, their design largely relies on empirical intuition rather than theoretical understanding. In this paper, we present a comprehensive analysis of GNN behavior through three…

Machine Learning · Computer Science 2025-02-04 Qin Jiang , Chengjia Wang , Michael Lones , Wei Pang

Graph neural networks (GNNs), which capture graph structures via a feature aggregation mechanism following the graph embedding framework, have demonstrated a powerful ability to support various tasks. According to the topology properties…

Machine Learning · Computer Science 2025-05-28 Meng Qin , Jiahong Liu , Irwin King

Aggregating features in terms of different convolutional blocks or contextual embeddings has been proven to be an effective way to strengthen feature representations for semantic segmentation. However, most of the current popular network…

Computer Vision and Pattern Recognition · Computer Science 2021-03-03 Zilong Huang , Yunchao Wei , Xinggang Wang , Wenyu Liu , Thomas S. Huang , Humphrey Shi

Graph neural networks (GNNs) have been shown to be highly sensitive to the choice of aggregation function. While summing over a node's neighbours can approximate any permutation-invariant function over discrete inputs, Cohen-Karlik et al.…

Machine Learning · Computer Science 2022-12-19 Euan Ong , Petar Veličković

Graphs are naturally used to describe the structures of various real-world systems in biology, society, computer science etc., where subgraphs or motifs as basic blocks play an important role in function expression and information…

Social and Information Networks · Computer Science 2021-02-11 Jinhuan Wang , Pengtao Chen , Bin Ma , Jiajun Zhou , Zhongyuan Ruan , Guanrong Chen , Qi Xuan

Graph neural networks (GNNs), and especially message-passing neural networks, excel in various domains such as physics, drug discovery, and molecular modeling. The expressivity of GNNs with respect to their ability to discriminate…

Graph neural networks (GNNs) are emerging machine learning models on graphs. Permutation-equivariance and proximity-awareness are two important properties highly desirable for GNNs. Both properties are needed to tackle some challenging…

Machine Learning · Computer Science 2022-02-23 Ziwei Zhang , Chenhao Niu , Peng Cui , Jian Pei , Bo Zhang , Wenwu Zhu

Graph Neural Networks (GNNs) learn low dimensional representations of nodes by aggregating information from their neighborhood in graphs. However, traditional GNNs suffer from two fundamental shortcomings due to their local ($l$-hop…

Machine Learning · Computer Science 2021-04-28 Kashob Kumar Roy , Amit Roy , A K M Mahbubur Rahman , M Ashraful Amin , Amin Ahsan Ali

Last year has witnessed the re-flourishment of tag-aware recommender systems supported by the LLM-enriched tags. Unfortunately, though large efforts have been made, current solutions may fail to describe the diversity and uncertainty…

Information Retrieval · Computer Science 2024-06-25 Fake Lin , Ziwei Zhao , Xi Zhu , Da Zhang , Shitian Shen , Xueying Li , Tong Xu , Suojuan Zhang , Enhong Chen