English
Related papers

Related papers: Layer-to-Layer Knowledge Mixing in Graph Neural Ne…

200 papers

The graph neural network (GNN) has been a powerful deep-learning tool in chemistry domain, due to its close connection with molecular graphs. Most GNN models collect and update atom and molecule features from the fed atom (and, in some…

Chemical Physics · Physics 2022-03-18 Yeji Kim , Yoonho Jeong , Jihoo Kim , Eok Kyun Lee , Won June Kim , Insung S. Choi

Graph Neural Networks (GNNs) are popular for graph machine learning and have shown great results on wide node classification tasks. Yet, they are less popular for practical deployments in the industry owing to their scalability challenges…

Machine Learning · Computer Science 2022-03-24 Shichang Zhang , Yozen Liu , Yizhou Sun , Neil Shah

There is a perceived dichotomy between structure-based and descriptor-based molecular representations used for predictive chemistry tasks. Here, we study the performance, generalizability, and interpretability of the recently proposed…

Chemical Physics · Physics 2022-03-14 Thijs Stuyver , Connor W. Coley

The recent success of graph neural networks has significantly boosted molecular property prediction, advancing activities such as drug discovery. The existing deep neural network methods usually require large training dataset for each…

Machine Learning · Computer Science 2021-02-17 Zhichun Guo , Chuxu Zhang , Wenhao Yu , John Herr , Olaf Wiest , Meng Jiang , Nitesh V. Chawla

Graph Neural Networks (GNNs) have shown exceptional performance in the task of link prediction. Despite their effectiveness, the high latency brought by non-trivial neighborhood data dependency limits GNNs in practical deployments.…

Machine Learning · Computer Science 2023-06-06 Zhichun Guo , William Shiao , Shichang Zhang , Yozen Liu , Nitesh V. Chawla , Neil Shah , Tong Zhao

We explore different strategies to integrate prior domain knowledge into the design of a deep neural network (DNN). We focus on graph neural networks (GNN), with a use case of estimating the potential energy of chemical systems (molecules…

Machine Learning · Computer Science 2022-08-26 Jay Morgan , Adeline Paiement , Christian Klinke

To bridge the gaps between topology-aware Graph Neural Networks (GNNs) and inference-efficient Multi-Layer Perceptron (MLPs), GLNN proposes to distill knowledge from a well-trained teacher GNN into a student MLP. Despite their great…

Machine Learning · Computer Science 2023-06-12 Lirong Wu , Haitao Lin , Yufei Huang , Stan Z. Li

Graph networks are a new machine learning (ML) paradigm that supports both relational reasoning and combinatorial generalization. Here, we develop universal MatErials Graph Network (MEGNet) models for accurate property prediction in both…

Materials Science · Physics 2019-04-29 Chi Chen , Weike Ye , Yunxing Zuo , Chen Zheng , Shyue Ping Ong

Graph neural networks (GNNs) have been shown to be astonishingly capable models for molecular property prediction, particularly as surrogates for expensive density functional theory calculations of relaxed energy for novel material…

Machine Learning · Computer Science 2024-08-27 Joseph Musielewicz , Janice Lan , Matt Uyttendaele , John R. Kitchin

Question Answering over Knowledge Graph (KGQA) aims to seek answer entities for the natural language question from a large-scale Knowledge Graph~(KG). To better perform reasoning on KG, recent work typically adopts a pre-trained language…

Computation and Language · Computer Science 2024-01-02 Jinhao Jiang , Kun Zhou , Wayne Xin Zhao , Yaliang Li , Ji-Rong Wen

Surfactants are of high importance in different industrial sectors such as cosmetics, detergents, oil recovery and drug delivery systems. Therefore, many quantitative structure-property relationship (QSPR) models have been developed for…

Molecular property prediction is of crucial importance in many disciplines such as drug discovery, molecular biology, or material and process design. The frequently employed quantitative structure-property/activity relationships…

Biomolecules · Quantitative Biology 2024-01-17 Jan G. Rittig , Qinghe Gao , Manuel Dahmen , Alexander Mitsos , Artur M. Schweidtmann

Graph Neural Networks (GNNs) have revolutionized graph-based machine learning, but their heavy computational demands pose challenges for latency-sensitive edge devices in practical industrial applications. In response, a new wave of…

Machine Learning · Computer Science 2024-05-24 Weigang Lu , Ziyu Guan , Wei Zhao , Yaming Yang

Recent advances in applying Graph Neural Networks (GNNs) to molecular science have showcased the power of learning three-dimensional (3D) structure representations with GNNs. However, most existing GNNs suffer from the limitations of…

Biomolecules · Quantitative Biology 2023-11-21 Shuo Zhang , Yang Liu , Lei Xie

Knowledge distillation (KD) techniques have emerged as a powerful tool for transferring expertise from complex teacher models to lightweight student models, particularly beneficial for deploying high-performance models in…

Machine Learning · Computer Science 2025-10-28 Paul Agbaje , Arkajyoti Mitra , Afia Anjum , Pranali Khose , Ebelechukwu Nwafor , Habeeb Olufowobi

Recently, graph convolutional networks (GCNs) have shown great potential for the task of graph matching. It can integrate graph node feature embedding, node-wise affinity learning and matching optimization together in a unified end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Bo Jiang , Pengfei Sun , Jin Tang , Bin Luo

To accurately study chemical reactions in the condensed phase or within enzymes, both a quantum-mechanical description and sufficient configurational sampling is required to reach converged estimates. Here, quantum mechanics/molecular…

Chemical Physics · Physics 2022-10-05 Albert Hofstetter , Lennard Böselt , Sereina Riniker

Knowledge representation learning has been commonly adopted to incorporate knowledge graph (KG) into various online services. Although existing knowledge representation learning methods have achieved considerable performance improvement,…

Machine Learning · Computer Science 2022-05-18 Binbin Hu , Zhiyang Hu , Zhiqiang Zhang , Jun Zhou , Chuan Shi

Graph Neural Networks (GNNs) are the go-to model for graph data analysis. However, GNNs rely on two key operations - aggregation and update, which can pose challenges for low-latency inference tasks or resource-constrained scenarios. Simple…

Machine Learning · Computer Science 2026-01-14 Amir Eskandari , Aman Anand , Elyas Rashno , Farhana Zulkernine

To accelerate the process of materials design, materials science has increasingly used data driven techniques to extract information from collected data. Specially, machine learning (ML) algorithms, which span the ML discipline, have…