English
Related papers

Related papers: Are Message Passing Neural Networks Really Helpful…

200 papers

Message Passing Neural Networks (MPNNs) are a common type of Graph Neural Network (GNN), in which each node's representation is computed recursively by aggregating representations (messages) from its immediate neighbors akin to a…

Machine Learning · Computer Science 2022-04-22 Lingxiao Zhao , Wei Jin , Leman Akoglu , Neil Shah

We study the generalization capabilities of Message Passing Neural Networks (MPNNs), a prevalent class of Graph Neural Networks (GNN). We derive generalization bounds specifically for MPNNs with normalized sum aggregation and mean…

Machine Learning · Computer Science 2024-04-05 Sohir Maskey , Gitta Kutyniok , Ron Levie

Message Passing Neural Networks (MPNNs) model local relations effectively but struggle to propagate information over long distances. Graph Transformers (GTs) mitigate this via global self-attention, yet their quadratic cost in the number of…

Machine Learning · Computer Science 2025-09-03 Shuo Wang , Ge Cheng , Yun Zhang

Graph neural networks (GNNs) have achieved state-of-the-art performance in graph representation learning. Message passing neural networks, which learn representations through recursively aggregating information from each node and its…

Machine Learning · Computer Science 2024-05-20 Rongrong Ma , Guansong Pang , Ling Chen

We study the problem of knowledge graph (KG) embedding. A widely-established assumption to this problem is that similar entities are likely to have similar relational roles. However, existing related methods derive KG embeddings mainly…

Artificial Intelligence · Computer Science 2019-05-14 Lingbing Guo , Zequn Sun , Wei Hu

Leveraging graphs on recommender systems has gained popularity with the development of graph representation learning (GRL). In particular, knowledge graph embedding (KGE) and graph neural networks (GNNs) are representative GRL approaches,…

Information Retrieval · Computer Science 2022-05-25 Daisuke Kikuta , Toyotaro Suzumura , Md Mostafizur Rahman , Yu Hirate , Satyen Abrol , Manoj Kondapaka , Takuma Ebisu , Pablo Loyola

The performance analytics domain in High Performance Computing (HPC) uses tabular data to solve regression problems, such as predicting the execution time. Existing Machine Learning (ML) techniques leverage the correlations among features…

Machine Learning · Computer Science 2024-01-22 Tarek Ramadan , Ankur Lahiry , Tanzima Z. Islam

Recent advancements have witnessed the ascension of Large Language Models (LLMs), endowed with prodigious linguistic capabilities, albeit marred by shortcomings including factual inconsistencies and opacity. Conversely, Knowledge Graphs…

Information Retrieval · Computer Science 2024-07-29 DaiFeng Li , Fan Xu

Large Language Models (LLMs) have revolutionized Natural Language Processing (NLP) based applications including automated text generation, question answering, chatbots, and others. However, they face a significant challenge: hallucinations,…

Computation and Language · Computer Science 2024-11-22 Ernests Lavrinovics , Russa Biswas , Johannes Bjerva , Katja Hose

Graph Neural Networks (GNNs) have attracted tremendous attention by demonstrating their capability to handle graph data. However, they are difficult to be deployed in resource-limited devices due to model sizes and scalability constraints…

Machine Learning · Computer Science 2023-02-02 Yijun Tian , Shichao Pei , Xiangliang Zhang , Chuxu Zhang , Nitesh V. Chawla

Knowledge graphs (KGs) store enormous facts as relationships between entities. Due to the long-tailed distribution of relations and the incompleteness of KGs, there is growing interest in few-shot knowledge graph completion (FKGC). Existing…

Information Retrieval · Computer Science 2024-08-06 Zicheng Zhao , Linhao Luo , Shirui Pan , Chengqi Zhang , Chen Gong

Knowledge Graph Completion (KGC) is crucial for addressing knowledge graph incompleteness and supporting downstream applications. Many models have been proposed for KGC. They can be categorized into two main classes: triple-based and…

Computation and Language · Computer Science 2024-02-26 Yanbin Wei , Qiushi Huang , James T. Kwok , Yu Zhang

Large language models (LLMs) based Multilingual Knowledge Graph Completion (MKGC) aim to predict missing facts by leveraging LLMs' multilingual understanding capabilities, improving the completeness of multilingual knowledge graphs (KGs).…

Computation and Language · Computer Science 2025-10-10 Cunli Mao , Xiaofei Gao , Ran Song , Shizhu He , Shengxiang Gao , Kang Liu , Zhengtao Yu

Knowledge graphs (KG) have served as the key component of various natural language processing applications. Commonsense knowledge graphs (CKG) are a special type of KG, where entities and relations are composed of free-form text. However,…

Computation and Language · Computer Science 2023-01-04 Haodi Ma , Daisy Zhe Wang

Traditional computer vision approaches, based on neural networks (NN), are typically trained on a large amount of image data. By minimizing the cross-entropy loss between a prediction and a given class label, the NN and its visual embedding…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Sebastian Monka , Lavdim Halilaj , Stefan Schmid , Achim Rettinger

Graph neural networks have recently emerged as a very effective framework for processing graph-structured data. These models have achieved state-of-the-art performance in many tasks. Most graph neural networks can be described in terms of…

Computation and Language · Computer Science 2019-11-25 Giannis Nikolentzos , Antoine J. -P. Tixier , Michalis Vazirgiannis

The automated segmentation of cortical areas has been a long-standing challenge in medical image analysis. The complex geometry of the cortex is commonly represented as a polygon mesh, whose segmentation can be addressed by graph-based…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Dániel Unyi , Ferdinando Insalata , Petar Veličković , Bálint Gyires-Tóth

Graph representation learning has now become the de facto standard when handling graph-structured data, with the framework of message-passing graph neural networks (MPNN) being the most prevailing algorithmic tool. Despite its popularity,…

Machine Learning · Computer Science 2023-10-18 Jiawang Dan , Ruofan Wu , Yunpeng Liu , Baokun Wang , Changhua Meng , Tengfei Liu , Tianyi Zhang , Ningtao Wang , Xing Fu , Qi Li , Weiqiang Wang

Graph neural networks (GNNs) have become a powerful tool for processing graph-structured data but still face challenges in effectively aggregating and propagating information between layers, which limits their performance. We tackle this…

Machine Learning · Computer Science 2023-02-09 Maxim Fishman , Chaim Baskin , Evgenii Zheltonozhskii , Almog David , Ron Banner , Avi Mendelson

Knowledge Graphs (KGs) provide a structured representation of knowledge but often suffer from challenges of incompleteness. To address this, link prediction or knowledge graph completion (KGC) aims to infer missing new facts based on…

Machine Learning · Computer Science 2025-01-03 Wenkai Tu , Guojia Wan , Zhengchun Shang , Bo Du