English
Related papers

Related papers: Expressive Graph Informer Networks

200 papers

We propose a combination of a variational autoencoder and a transformer based model which fully utilises graph convolutional and graph pooling layers to operate directly on graphs. The transformer model implements a novel node encoding…

Machine Learning · Computer Science 2021-04-12 Joshua Mitton , Hans M. Senn , Klaas Wynne , Roderick Murray-Smith

The growing use of deep learning necessitates efficient network design and deployment, making neural predictors vital for estimating attributes such as accuracy and latency. Recently, Graph Neural Networks (GNNs) and transformers have shown…

Machine Learning · Computer Science 2025-07-02 Ruihan Xu , Haokui Zhang , Yaowei Wang , Wei Zeng , Shiliang Zhang

Graph neural networks (GNNs) have been used extensively for addressing problems in drug design and discovery. Both ligand and target molecules are represented as graphs with node and edge features encoding information about atomic elements…

Machine Learning · Computer Science 2021-10-14 Dhananjay Bhaskar , Jackson D. Grady , Michael A. Perlmutter , Smita Krishnaswamy

Recently, a novel two-phase framework named mol-infer for inference of chemical compounds with prescribed abstract structures and desired property values has been proposed. The framework mol-infer is primarily based on using mixed integer…

Machine Learning · Computer Science 2025-07-08 Jianshen Zhu , Naveed Ahmed Azam , Kazuya Haraguchi , Liang Zhao , Tatsuya Akutsu

The invariance to permutations of the adjacency matrix, i.e., graph isomorphism, is an overarching requirement for Graph Neural Networks (GNNs). Conventionally, this prerequisite can be satisfied by the invariant operations over node…

Machine Learning · Computer Science 2022-05-31 Zhongyu Huang , Yingheng Wang , Chaozhuo Li , Huiguang He

Graphs are ubiquitous data structures for representing interactions between entities. With an emphasis on the use of graphs to represent chemical molecules, we explore the task of learning to generate graphs that conform to a distribution…

Machine Learning · Computer Science 2019-03-08 Qi Liu , Miltiadis Allamanis , Marc Brockschmidt , Alexander L. Gaunt

Graph generation poses a significant challenge as it involves predicting a complete graph with multiple nodes and edges based on simply a given label. This task also carries fundamental importance to numerous real-world applications,…

Machine Learning · Computer Science 2024-02-21 Xiandong Zou , Xiangyu Zhao , Pietro Liò , Yiren Zhao

Graph learning is crucial in the fields of bioinformatics, social networks, and chemicals. Although high-order graphlets, such as cycles, are critical to achieving an informative graph representation for node classification, edge…

Machine Learning · Computer Science 2024-02-14 Ziquan Wei , Tingting Dan , Guorong Wu

Graph Neural Networks (GNNs) have been widely employed for feature representation learning in molecular graphs. Therefore, it is crucial to enhance the expressiveness of feature representation to ensure the effectiveness of GNNs. However, a…

Machine Learning · Computer Science 2024-09-16 Chengyu Yao , Hong Huang , Hang Gao , Fengge Wu , Haiming Chen , Junsuo Zhao

We propose an algorithm for deep learning on networks and graphs. It relies on the notion that many graph algorithms, such as PageRank, Weisfeiler-Lehman, or Message Passing can be expressed as iterative vertex updates. Unlike previous…

Machine Learning · Computer Science 2018-06-05 Emmanouil Antonios Platanios , Alex Smola

Advances in deep learning models have revolutionized the study of biomolecule systems and their mechanisms. Graph representation learning, in particular, is important for accurately capturing the geometric information of biomolecules at…

Quantitative Methods · Quantitative Biology 2023-04-07 Xinye Xiong , Bingxin Zhou , Yu Guang Wang

Motivation: Molecular interaction networks summarize complex biological processes as graphs, whose structure is informative of biological function at multiple scales. Simultaneously, omics technologies measure the variation or activity of…

Quantitative Methods · Quantitative Biology 2020-12-24 Ramin Hasibi , Tom Michoel

Graph neural networks (GNNs) demonstrate great performance in compound property and activity prediction due to their capability to efficiently learn complex molecular graph structures. However, two main limitations persist including…

Biomolecules · Quantitative Biology 2023-10-10 Apakorn Kengkanna , Masahito Ohue

In recent years, Graph Neural Network (GNN) has bloomly progressed for its power in processing graph-based data. Most GNNs follow a message passing scheme, and their expressive power is mathematically limited by the discriminative ability…

Machine Learning · Computer Science 2021-04-06 Alan J. X. Guo , Qing-Hu Hou , Ou Wu

Autoencoders are effective deep learning models that can function as generative models and learn latent representations for downstream tasks. The use of graph autoencoders - with both encoder and decoder implemented as message passing…

Machine Learning · Computer Science 2025-03-04 Magnus Cunow , Gerrit Großmann

Graph Neural Networks (GNNs) have emerged as a dominant paradigm for graph classification. Specifically, most existing GNNs mainly rely on the message passing strategy between neighbor nodes, where the expressivity is limited by the…

Machine Learning · Computer Science 2025-12-12 Lin Du , Lu Bai , Jincheng Li , Lixin Cui , Hangyuan Du , Lichi Zhang , Yuting Chen , Zhao Li

The crux of molecular property prediction is to generate meaningful representations of the molecules. One promising route is to exploit the molecular graph structure through Graph Neural Networks (GNNs). It is well known that both atoms and…

Quantitative Methods · Quantitative Biology 2020-06-15 Hehuan Ma , Yatao Bian , Yu Rong , Wenbing Huang , Tingyang Xu , Weiyang Xie , Geyan Ye , Junzhou Huang

It has been observed that message-passing graph neural networks (GNN) sometimes struggle to maintain a healthy balance between the efficient/scalable modeling of long-range dependencies across nodes while avoiding unintended consequences…

Machine Learning · Computer Science 2025-05-21 Yongyi Yang , Tang Liu , Yangkun Wang , Zengfeng Huang , David Wipf

Message passing Graph Neural Networks (GNNs) provide a powerful modeling framework for relational data. However, the expressive power of existing GNNs is upper-bounded by the 1-Weisfeiler-Lehman (1-WL) graph isomorphism test, which means…

Machine Learning · Computer Science 2021-02-08 Jiaxuan You , Jonathan Gomes-Selman , Rex Ying , Jure Leskovec

Robustness in complex systems is of significant engineering and economic importance. However, conventional attack-based a posteriori robustness assessments incur prohibitive computational overhead. Recently, deep learning methods, such as…

Machine Learning · Computer Science 2025-12-29 Chengyu Tian , Wenbin Pei