English
Related papers

Related papers: BiScale-GTR: Fragment-Aware Graph Transformers for…

200 papers

Molecular representation learning is vital for various downstream applications, including the analysis and prediction of molecular properties and side effects. While Graph Neural Networks (GNNs) have been a popular framework for modeling…

Machine Learning · Computer Science 2025-02-18 Pengcheng Jiang , Cao Xiao , Tianfan Fu , Parminder Bhatia , Taha Kass-Hout , Jimeng Sun , Jiawei Han

Graph neural networks (GNNs) demonstrate a robust capability for representation learning on graphs with complex structures, showcasing superior performance in various applications. The majority of existing GNNs employ a graph convolution…

Machine Learning · Computer Science 2025-02-19 Jinlu Wang , Jipeng Guo , Yanfeng Sun , Junbin Gao , Shaofan Wang , Yachao Yang , Baocai Yin

The crux of molecular property prediction is to generate meaningful representations of the molecules. One promising route is to exploit the molecular graph structure through Graph Neural Networks (GNNs). It is well known that both atoms and…

Quantitative Methods · Quantitative Biology 2020-06-15 Hehuan Ma , Yatao Bian , Yu Rong , Wenbing Huang , Tingyang Xu , Weiyang Xie , Geyan Ye , Junzhou Huang

Graph neural networks (GNNs) are designed to extract latent patterns from graph-structured data, making them particularly well suited for crystal representation learning. Here, we propose a GNN model tailored for estimating electronic…

Materials Science · Physics 2026-04-07 Yuxuan Zeng , Wei Cao , Yijing Zuo , Fang Lyu , Wenhao Xie , Tan Peng , Yue Hou , Ling Miao , Ziyu Wang , Jing Shi

Generative deep learning has become pivotal in molecular design for drug discovery, materials science, and chemical engineering. A widely used paradigm is to pretrain neural networks on string representations of molecules and fine-tune them…

Machine Learning · Computer Science 2025-03-21 Jonathan Pirnay , Jan G. Rittig , Alexander B. Wolf , Martin Grohe , Jakob Burger , Alexander Mitsos , Dominik G. Grimm

Graph Neural Networks (GNNs) have achieved tremendous success in graph representation learning. Unfortunately, current GNNs usually rely on loading the entire attributed graph into network for processing. This implicit assumption may not be…

Machine Learning · Computer Science 2022-02-15 Junfu Wang , Yunhong Wang , Zhen Yang , Liang Yang , Yuanfang Guo

Leveraging domain knowledge including fingerprints and functional groups in molecular representation learning is crucial for chemical property prediction and drug discovery. When modeling the relation between graph structure and molecular…

Machine Learning · Computer Science 2021-03-25 Yin Fang , Haihong Yang , Xiang Zhuang , Xin Shao , Xiaohui Fan , Huajun Chen

Integrating the structural inductive biases of Graph Neural Networks (GNNs) with the global contextual modeling capabilities of Transformers represents a pivotal challenge in graph representation learning. While GNNs excel at capturing…

Machine Learning · Computer Science 2025-03-05 Zhihua Duan , Jialin Wang

Molecular property prediction is a critical task in computational drug discovery. While recent advances in Graph Neural Networks (GNNs) and Transformers have shown to be effective and promising, they face the following limitations:…

Utilizing electromagnetic scattering information for SAR data interpretation is currently a prominent research focus in the SAR interpretation domain. Graph Neural Networks (GNNs) can effectively integrate domain-specific physical knowledge…

Image and Video Processing · Electrical Eng. & Systems 2025-05-14 Xuying Xiong , Xinyu Zhang , Weidong Jiang , Li Liu , Yongxiang Liu , Tianpeng Liu

Graph Neural Networks (GNNs) are widely used in graph data mining tasks. Traditional GNNs follow a message passing scheme that can effectively utilize local and structural information. However, the phenomena of over-smoothing and…

Machine Learning · Computer Science 2025-04-14 Zijie Zhou , Zhaoqi Lu , Xuekai Wei , Rongqin Chen , Shenghui Zhang , Pak Lon Ip , Leong Hou U

Research into deep learning models for molecular property prediction has primarily focused on the development of better Graph Neural Network (GNN) architectures. Though new GNN variants continue to improve performance, their modifications…

Quantitative Methods · Quantitative Biology 2021-11-23 Toni Sagayaraj , Carsten Eickhoff

Although substantial efforts have been made using graph neural networks (GNNs) for AI-driven drug discovery (AIDD), effective molecular representation learning remains an open challenge, especially in the case of insufficient labeled…

Machine Learning · Computer Science 2023-11-07 Zhen Wang , Zheng Feng , Yanjun Li , Bowen Li , Yongrui Wang , Chulin Sha , Min He , Xiaolin Li

Transformers serve as the backbone architectures of Foundational Models, where domain-specific tokenizers allow them to adapt to various domains. Graph Transformers (GTs) have recently emerged as leading models in geometric deep learning,…

Neural and Evolutionary Computing · Computer Science 2025-04-03 Limei Wang , Kaveh Hassani , Si Zhang , Dongqi Fu , Baichuan Yuan , Weilin Cong , Zhigang Hua , Hao Wu , Ning Yao , Bo Long

The difficult problem of relating the static structure of glassy liquids and their dynamics is a good target for Machine Learning, an approach which excels at finding complex patterns hidden in data. Indeed, this approach is currently a hot…

Soft Condensed Matter · Physics 2024-05-29 Francesco Saverio Pezzicoli , Guillaume Charpiat , François P. Landes

Graph neural networks are powerful architectures for structured datasets. However, current methods struggle to represent long-range dependencies. Scaling the depth or width of GNNs is insufficient to broaden receptive fields as larger GNNs…

Machine Learning · Computer Science 2022-01-24 Zhanghao Wu , Paras Jain , Matthew A. Wright , Azalia Mirhoseini , Joseph E. Gonzalez , Ion Stoica

Graph Neural Networks (GNNs) have paved the way for being a cornerstone in graph-related learning tasks. Yet, the ability of GNNs to capture structural interactions within graphs remains under-explored. In this work, we address this gap by…

Machine Learning · Computer Science 2025-03-04 Asela Hevapathige , Qing Wang

The quest for efficient and robust deep learning models for molecular systems representation is increasingly critical in scientific exploration. The advent of message passing neural networks has marked a transformative era in graph-based…

Computational Physics · Physics 2026-01-05 Jian Chang , Shuze Zhu

Graph neural networks (GNNs) have become the standard learning architectures for graphs. GNNs have been applied to numerous domains ranging from quantum chemistry, recommender systems to knowledge graphs and natural language processing. A…

Machine Learning · Computer Science 2022-02-11 Vijay Prakash Dwivedi , Anh Tuan Luu , Thomas Laurent , Yoshua Bengio , Xavier Bresson

Glycans are the most complex biological sequence, with monosaccharides forming extended, non-linear sequences. As post-translational modifications, they modulate protein structure, function, and interactions. Due to their diversity and…

Machine Learning · Computer Science 2025-02-12 Roman Joeres , Daniel Bojar