English
Related papers

Related papers: Layer-to-Layer Knowledge Mixing in Graph Neural Ne…

200 papers

Recent years have witnessed great success in handling graph-related tasks with Graph Neural Networks (GNNs). Despite their great academic success, Multi-Layer Perceptrons (MLPs) remain the primary workhorse for practical industrial…

Machine Learning · Computer Science 2023-06-06 Lirong Wu , Jun Xia , Haitao Lin , Zhangyang Gao , Zicheng Liu , Guojiang Zhao , Stan Z. Li

A graph neural network (GNN) is a good choice for predicting the chemical properties of molecules. Compared with other deep networks, however, the current performance of a GNN is limited owing to the "curse of depth." Inspired by…

Machine Learning · Computer Science 2020-08-19 Katsuhiko Ishiguro , Kenta Oono , Kohei Hayashi

Knowledge Graphs (KGs) represent human-crafted factual knowledge in the form of triplets (head, relation, tail), which collectively form a graph. Question Answering over KGs (KGQA) is the task of answering natural questions grounding the…

Computation and Language · Computer Science 2024-05-31 Costas Mavromatis , George Karypis

Predicting the properties of a molecule from its structure is a challenging task. Recently, deep learning methods have improved the state of the art for this task because of their ability to learn useful features from the given data. By…

Machine Learning · Computer Science 2020-08-28 Shengli Jiang , Prasanna Balaprakash

Large language models (LLMs) have shown remarkable generalization capability with exceptional performance in various language modeling tasks. However, they still exhibit inherent limitations in precisely capturing and returning grounded…

Computation and Language · Computer Science 2024-01-01 Yijun Tian , Huan Song , Zichen Wang , Haozhu Wang , Ziqing Hu , Fang Wang , Nitesh V. Chawla , Panpan Xu

Machine learning (ML) models have emerged as powerful tools for accelerating materials discovery and design by enabling accurate predictions of properties from compositional and structural data. These capabilities are vital for developing…

Graph neural networks (GNNs) have been widely applied to numerous fields. A recent work which combines layered structure and residual connection proposes an improved deep architecture to extend CAmouflage-REsistant GNN (CARE-GNN) to deep…

Machine Learning · Computer Science 2022-02-15 Yufan Zeng , Jiashan Tang

Graph neural networks (GNNs) are a class of deep models that operate on data with arbitrary topology represented as graphs. We introduce an efficient memory layer for GNNs that can jointly learn node representations and coarsen the graph.…

Machine Learning · Computer Science 2020-06-11 Amir Hosein Khasahmadi , Kaveh Hassani , Parsa Moradi , Leo Lee , Quaid Morris

How can we learn effective node representations on textual graphs? Graph Neural Networks (GNNs) that use Language Models (LMs) to encode textual information of graphs achieve state-of-the-art performance in many node classification tasks.…

Knowledge Graph (KG) can effectively integrate valuable information from massive data, and thus has been rapidly developed and widely used in many fields. Traditional KG construction methods rely on manual annotation, which often consumes a…

Computation and Language · Computer Science 2026-04-22 Qiubai Zhu , Qingwang Wang , Haibin Yuan , Wei Chen , Tao Shen

Heterogeneous Graph Neural Networks (HGNNs) have achieved promising results in various heterogeneous graph learning tasks, owing to their superiority in capturing the intricate relationships and diverse relational semantics inherent in…

Machine Learning · Computer Science 2025-07-15 Yunhui Liu , Xinyi Gao , Tieke He , Jianhua Zhao , Hongzhi Yin

Rapid advancements in machine learning (ML) are transforming materials science by significantly speeding up material property calculations. However, the proliferation of ML approaches has made it challenging for scientists to keep up with…

Machine Learning · Computer Science 2024-07-12 Ali Ramlaoui , Théo Saulus , Basile Terver , Victor Schmidt , David Rolnick , Fragkiskos D. Malliaros , Alexandre Duval

Graphs play an important role in representing complex relationships in various domains like social networks, knowledge graphs, and molecular discovery. With the advent of deep learning, Graph Neural Networks (GNNs) have emerged as a…

Machine Learning · Computer Science 2024-06-05 Wenqi Fan , Shijie Wang , Jiani Huang , Zhikai Chen , Yu Song , Wenzhuo Tang , Haitao Mao , Hui Liu , Xiaorui Liu , Dawei Yin , Qing Li

Graph Neural Networks (GNNs) have emerged as a prominent class of data-driven methods for molecular property prediction. However, a key limitation of typical GNN models is their inability to quantify uncertainties in the predictions. This…

Machine Learning · Computer Science 2024-07-02 Shengli Jiang , Shiyi Qin , Reid C. Van Lehn , Prasanna Balaprakash , Victor M. Zavala

Graph kernels are historically the most widely-used technique for graph classification tasks. However, these methods suffer from limited performance because of the hand-crafted combinatorial features of graphs. In recent years, graph neural…

Machine Learning · Computer Science 2022-02-28 Aosong Feng , Chenyu You , Shiqiang Wang , Leandros Tassiulas

Graph mining is an important area in data mining and machine learning that involves extracting valuable information from graph-structured data. In recent years, significant progress has been made in this field through the development of…

Machine Learning · Computer Science 2024-12-30 Yuxin You , Zhen Liu , Xiangchao Wen , Yongtao Zhang , Wei Ai

Precision process planning in Computer Numerical Control (CNC) machining demands rapid, context-aware decisions on tool selection, feed-speed pairs, and multi-axis routing, placing immense cognitive and procedural burdens on engineers from…

Artificial Intelligence · Computer Science 2025-06-17 Danny Hoang , David Gorsich , Matthew P. Castanier , Farhad Imani

Graph Neural Networks (GNNs) have become essential for handling large-scale graph applications. However, the computational demands of GNNs necessitate the development of efficient methods to accelerate inference. Mixed precision…

Machine Learning · Computer Science 2025-05-15 Samir Moustafa , Nils M. Kriege , Wilfried N. Gansterer

Advancements in neural machinery have led to a wide range of algorithmic solutions for molecular property prediction. Two classes of models in particular have yielded promising results: neural networks applied to computed molecular…

Functional groups (FGs) are molecular substructures that are served as a foundation for analyzing and predicting chemical properties of molecules. Automatic discovery of FGs will impact various fields of research, including medicinal…

Machine Learning · Computer Science 2019-10-11 Phillip Pope , Soheil Kolouri , Mohammad Rostrami , Charles Martin , Heiko Hoffmann