English
Related papers

Related papers: What drives performance in molecular MPNNs? An ope…

200 papers

Graph generation poses a significant challenge as it involves predicting a complete graph with multiple nodes and edges based on simply a given label. This task also carries fundamental importance to numerous real-world applications,…

Machine Learning · Computer Science 2024-02-21 Xiandong Zou , Xiangyu Zhao , Pietro Liò , Yiren Zhao

Message passing neural networks (MPNNs) learn the representation of graph-structured data based on graph original information, including node features and graph structures, and have shown astonishing improvement in node classification…

Machine Learning · Computer Science 2023-01-30 Xiao Liu , Lijun Zhang , Hui Guan

Despite the significant potential of Foundation Models (FMs) in medical imaging, their application to prognosis prediction remains challenging due to data scarcity, class imbalance, and task complexity, which limit their clinical adoption.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Filippo Ruffini , Elena Mulero Ayllon , Linlin Shen , Paolo Soda , Valerio Guarrasi

While Graph Neural Networks (GNNs) have achieved remarkable success, their design largely relies on empirical intuition rather than theoretical understanding. In this paper, we present a comprehensive analysis of GNN behavior through three…

Machine Learning · Computer Science 2025-02-04 Qin Jiang , Chengjia Wang , Michael Lones , Wei Pang

We introduce a new type of graphical model that we call a "memory factor network" (MFN). We show how to use MFNs to model the structure inherent in many types of data sets. We also introduce an associated message-passing style algorithm…

Artificial Intelligence · Computer Science 2016-01-19 Patrick Eschenfeldt , Dan Schmidt , Stark Draper , Jonathan Yedidia

Property prediction on molecular graphs is an important application of Graph Neural Networks. Recently, unlabeled molecular data has become abundant, which facilitates the rapid development of self-supervised learning for GNNs in the…

Machine Learning · Computer Science 2023-10-31 Kha-Dinh Luong , Ambuj Singh

There has been tremendous success in the field of graph neural networks (GNNs) as a result of the development of the message-passing (MP) layer, which updates the representation of a node by combining it with its neighbors to address…

Machine Learning · Computer Science 2022-02-11 Hyeokjin Kwon , Jong-Min Lee

Peridynamics is a non-local continuum mechanics theory that offers unique advantages for modeling problems involving discontinuities and complex deformations. Within the peridynamic framework, various formulations exist, among which the…

Computational Physics · Physics 2024-11-15 Xuan Hu , Qijun Chen , Nicholas H. Luo , Richy J. Zheng , Shaofan Li

Deep neural networks (DNNs) have revolutionized the field of artificial intelligence and have achieved unprecedented success in cognitive tasks such as image and speech recognition. Training of large DNNs, however, is computationally…

The graph neural network (GNN) has been a powerful deep-learning tool in chemistry domain, due to its close connection with molecular graphs. Most GNN models collect and update atom and molecule features from the fed atom (and, in some…

Chemical Physics · Physics 2022-03-18 Yeji Kim , Yoonho Jeong , Jihoo Kim , Eok Kyun Lee , Won June Kim , Insung S. Choi

Designing a neural network architecture for molecular representation is crucial for AI-driven drug discovery and molecule design. In this work, we propose a new framework for molecular representation learning. Our contribution is threefold:…

Machine Learning · Computer Science 2022-10-18 Jiye Kim , Seungbeom Lee , Dongwoo Kim , Sungsoo Ahn , Jaesik Park

Low-precision weights and activations in deep neural networks (DNNs) outperform their full-precision counterparts in terms of hardware efficiency. When implemented with low-precision operations, specifically in the extreme case where…

Artificial Intelligence · Computer Science 2024-07-09 Behnam Ghavami , Mohammad Shahidzadeh , Lesley Shannon , Steve Wilton

Machine learned interatomic potentials, particularly equivariant message-passing (MP) models, have demonstrated high fidelity in representing first-principles data, revolutionizing computational studies in materials science, biophysics, and…

Chemical Physics · Physics 2025-09-01 Yaolong Zhang , Hua Guo

Neural architectures that learn potential energy surfaces from molecular data have undergone fast improvement in recent years. A key driver of this success is the Message Passing Neural Network (MPNN) paradigm. Its favorable scaling with…

Machine Learning · Computer Science 2023-06-07 Arthur Kosmala , Johannes Gasteiger , Nicholas Gao , Stephan Günnemann

Graph-based neural networks and, specifically, message-passing neural networks (MPNNs) have shown great potential in predicting physical properties of solids. In this work, we train an MPNN to first classify materials through density…

Computational Physics · Physics 2023-09-13 Tim Bechtel , Daniel T. Speckhard , Jonathan Godwin , Claudia Draxl

Pre-trained Language Models have emerged as promising tools for predicting molecular properties, yet their development is in its early stages, necessitating further research to enhance their efficacy and address challenges such as…

Machine Learning · Computer Science 2023-10-24 Eduardo Soares , Akihiro Kishimoto , Emilio Vital Brazil , Seiji Takeda , Hiroshi Kajino , Renato Cerqueira

Molecular communication (MC) provides a foundational framework for information transmission in the Internet of Bio-Nano Things (IoBNT), where efficiency and reliability are crucial. However, the inherent limitations of molecular channels,…

Signal Processing · Electrical Eng. & Systems 2025-04-02 Hanlin Cai , Ozgur B. Akan

Mixture-of-Experts (MoE) architectures have emerged as a promising direction, offering efficiency and scalability by activating only a subset of parameters during inference. However, current research remains largely performance-centric,…

Machine Learning · Computer Science 2025-09-30 Jiahao Ying , Mingbao Lin , Qianru Sun , Yixin Cao

Complex systems such as aircraft engines, turbines, and industrial machinery often operate under dynamically changing conditions. These varying operating conditions can substantially influence degradation behavior and make prognostic…

Machine Learning · Computer Science 2026-04-14 Yuqi Su , Xiaolei Fang

Graph Neural Networks (GNNs), especially message-passing neural networks (MPNNs), have emerged as powerful architectures for learning on graphs in diverse applications. However, MPNNs face challenges when modeling non-local interactions in…

Machine Learning · Statistics 2024-01-31 Ilyes Batatia , Lars L. Schaaf , Huajie Chen , Gábor Csányi , Christoph Ortner , Felix A. Faber