English
Related papers

Related papers: Learning Long-Range Representations with Equivaria…

200 papers

This work concerns receiver design for light emitting diode (LED) communications where the LED nonlinearity can severely degrade the performance of communications. We propose extreme learning machine (ELM) based non-iterative receivers and…

Signal Processing · Electrical Eng. & Systems 2020-12-30 Dawei Gao , Qinghua Guo , Jun Tong , Nan Wu , Jiangtao Xi , Yanguang Yu

Computational simulation of chemical and biological systems using ab initio molecular dynamics has been a challenge over decades. Researchers have attempted to address the problem with machine learning and fragmentation-based methods.…

Chemical Physics · Physics 2024-07-16 Yunyang Li , Yusong Wang , Lin Huang , Han Yang , Xinran Wei , Jia Zhang , Tong Wang , Zun Wang , Bin Shao , Tie-Yan Liu

Including covariant information, such as position, force, velocity or spin is important in many tasks in computational physics and chemistry. We introduce Steerable E(3) Equivariant Graph Neural Networks (SEGNNs) that generalise equivariant…

Machine Learning · Computer Science 2022-03-29 Johannes Brandstetter , Rob Hesselink , Elise van der Pol , Erik J Bekkers , Max Welling

Message passing neural networks have demonstrated significant efficacy in predicting molecular interactions. Introducing equivariant vectorial representations augments expressivity by capturing geometric data symmetries, thereby improving…

Machine Learning · Computer Science 2025-08-01 Zetian Mao , Chuan-Shen Hu , Jiawen Li , Chen Liang , Diptesh Das , Masato Sumita , Kelin Xia , Koji Tsuda

One essential ingredient in many machine learning (ML) based methods for atomistic modeling of materials and molecules is the use of locality. While allowing better system-size scaling, this systematically neglects long-range (LR) effects,…

Chemical Physics · Physics 2023-10-05 Kevin K. Huguenin-Dumittan , Philip Loche , Ni Haoran , Michele Ceriotti

Message-passing has proved to be an effective way to design graph neural networks, as it is able to leverage both permutation equivariance and an inductive bias towards learning local structures in order to achieve good generalization.…

Machine Learning · Computer Science 2020-10-26 Clement Vignac , Andreas Loukas , Pascal Frossard

Success of machine learning (ML) in the modern world is largely determined by abundance of data. However at many industrial and scientific problems, amount of data is limited. Application of ML methods to data-scarce scientific problems can…

Disordered Systems and Neural Networks · Physics 2024-06-13 I. Schurov , D. Alforov , M. Katsnelson , A. Bagrov , A. Itin

Machine-learning models in chemistry - when based on descriptors of atoms embedded within molecules - face essential challenges in transferring the quality of predictions of local electronic structures and their associated properties across…

Chemical Physics · Physics 2024-09-27 Frederik Ø. Kjeldal , Janus J. Eriksen

Predicting quantum operator matrices such as Hamiltonian, overlap, and density matrices in the density functional theory (DFT) framework is crucial for material science. Current methods often focus on individual operators and struggle with…

Materials Science · Physics 2025-03-12 Zhanghao Zhouyin , Zixi Gan , MingKang Liu , Shishir Kumar Pandey , Linfeng Zhang , Qiangqiang Gu

Neural networks that process the parameters of other neural networks find applications in domains as diverse as classifying implicit neural representations, generating neural network weights, and predicting generalization errors. However,…

Graph neural networks (GNNs) based on message passing between neighboring nodes are known to be insufficient for capturing long-range interactions in graphs. In this project we study hierarchical message passing models that leverage a…

Machine Learning · Computer Science 2021-08-17 Ladislav Rampášek , Guy Wolf

Graph neural networks based on iterative one-hop message passing have been shown to struggle in harnessing the information from distant nodes effectively. Conversely, graph transformers allow each node to attend to all other nodes directly,…

Machine Learning · Computer Science 2024-06-06 Yuhui Ding , Antonio Orvieto , Bobby He , Thomas Hofmann

Molecular interactions often involve high-order relationships that cannot be fully captured by traditional graph-based models limited to pairwise connections. Hypergraphs naturally extend graphs by enabling multi-way interactions, making…

Machine Learning · Computer Science 2025-05-12 Tien Dang , Truong-Son Hy

In modern computational materials science, deep learning has shown the capability to predict interatomic potentials, thereby supporting and accelerating conventional simulations. However, existing models typically sacrifice either accuracy…

Computational Engineering, Finance, and Science · Computer Science 2024-10-08 Ziduo Yang , Xian Wang , Yifan Li , Qiujie Lv , Calvin Yu-Chian Chen , Lei Shen

Graph Neural Network (GNN) potentials relying on chemical locality offer near-quantum mechanical accuracy at significantly reduced computational costs. Message-passing GNNs model interactions beyond their immediate neighborhood by…

Chemical Physics · Physics 2025-06-30 Paul Fuchs , Michał Sanocki , Julija Zavadlav

Hypergraphs offer a generalized framework for capturing high-order relationships between entities and have been widely applied in various domains, including healthcare, social networks, and bioinformatics. Hypergraph neural networks, which…

Machine Learning · Computer Science 2025-12-03 Akash Choudhuri , Yongjian Zhong , Bijaya Adhikari

Pre-trained deep image representations are useful for post-training tasks such as classification through transfer learning, image retrieval, and object detection. Data augmentations are a crucial aspect of pre-training robust…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Sangnie Bhardwaj , Willie McClinton , Tongzhou Wang , Guillaume Lajoie , Chen Sun , Phillip Isola , Dilip Krishnan

In Reinforcement Learning (RL), Convolutional Neural Networks(CNNs) have been successfully applied as function approximators in Deep Q-Learning algorithms, which seek to learn action-value functions and policies in various environments.…

Machine Learning · Computer Science 2020-07-08 Arnab Kumar Mondal , Pratheeksha Nair , Kaleem Siddiqi

Graph Neural Networks (GNNs) have been widely adopted for drug discovery with molecular graphs. Nevertheless, current GNNs mainly excel in leveraging short-range interactions (SRI) but struggle to capture long-range interactions (LRI), both…

Machine Learning · Computer Science 2024-04-02 Xuan Li , Zhanke Zhou , Jiangchao Yao , Yu Rong , Lu Zhang , Bo Han

Hypergraph representations are both more efficient and better suited to describe data characterized by relations between two or more objects. In this work, we present a new graph neural network based on message passing capable of processing…

Machine Learning · Computer Science 2022-09-19 Sajjad Heydari , Lorenzo Livi