English
Related papers

Related papers: Pre-training Molecular Graph Representation with 3…

200 papers

This paper studies the problem of conducting self-supervised learning for node representation learning on graphs. Most existing self-supervised learning methods assume the graph is homophilous, where linked nodes often belong to the same…

Machine Learning · Computer Science 2023-10-03 Teng Xiao , Zhengyu Chen , Zhimeng Guo , Zeyang Zhuang , Suhang Wang

Graph neural networks (GNNs) have emerged as powerful tools for learning protein structures by capturing spatial relationships at the residue level. However, existing GNN-based methods often face challenges in learning multiscale…

Machine Learning · Computer Science 2026-02-03 Shih-Hsin Wang , Yuhao Huang , Taos Transue , Justin Baker , Jonathan Forstater , Thomas Strohmer , Bao Wang

The field of geometric deep learning has had a profound impact on the development of innovative and powerful graph neural network architectures. Disciplines such as computer vision and computational biology have benefited significantly from…

Machine Learning · Computer Science 2023-04-28 Alex Morehead , Jianlin Cheng

Graph Neural Networks (GNNs) have demonstrated their effectiveness in various graph learning tasks, yet their reliance on neighborhood aggregation during inference poses challenges for deployment in latency-sensitive applications, such as…

Machine Learning · Computer Science 2024-12-06 Zehong Wang , Zheyuan Zhang , Chuxu Zhang , Yanfang Ye

Throughout the history of computer vision, while research has explored the integration of images (visual) and point clouds (geometric), many advancements in image and 3D object recognition have tended to process these modalities separately.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Ryosuke Yamada , Kensho Hara , Hirokatsu Kataoka , Koshi Makihara , Nakamasa Inoue , Rio Yokota , Yutaka Satoh

Generating precise 3D molecular geometries is crucial for drug discovery and material science. While prior efforts leverage 1D representations like SELFIES to ensure molecular validity, they fail to fully exploit the rich chemical knowledge…

Machine Learning · Computer Science 2025-12-15 Zhanpeng Chen , Weihao Gao , Shunyu Wang , Yanan Zhu , Hong Meng , Yuexian Zou

Tiered graph autoencoders provide the architecture and mechanisms for learning tiered latent representations and latent spaces for molecular graphs that explicitly represent and utilize groups (e.g., functional groups). This enables the…

Machine Learning · Computer Science 2021-07-02 Daniel T. Chang

Predicting molecular properties is essential for drug discovery, and computational methods can greatly enhance this process. Molecular graphs have become a focus for representation learning, with Graph Neural Networks (GNNs) widely used.…

Machine Learning · Computer Science 2025-01-31 Yan Sun , Yutong Lu , Yan Yi Li , Zihao Jing , Carson K. Leung , Pingzhao Hu

Multimodal molecular representation learning, which jointly models molecular graphs and their textual descriptions, enhances predictive accuracy and interpretability by enabling more robust and reliable predictions of drug toxicity,…

Machine Learning · Computer Science 2025-10-21 Yingxu Wang , Kunyu Zhang , Jiaxin Huang , Nan Yin , Siwei Liu , Eran Segal

Machine learning on graphs is an important and ubiquitous task with applications ranging from drug design to friendship recommendation in social networks. The primary challenge in this domain is finding a way to represent, or encode, graph…

Social and Information Networks · Computer Science 2018-04-11 William L. Hamilton , Rex Ying , Jure Leskovec

Our work introduces an innovative approach to graph learning by leveraging Hyperdimensional Computing. Graphs serve as a widely embraced method for conveying information, and their utilization in learning has gained significant attention.…

Machine Learning · Computer Science 2024-03-20 Pere Verges , Igor Nunes , Mike Heddes , Tony Givargis , Alexandru Nicolau

Molecular graph neural networks (GNNs) often focus exclusively on XYZ-based geometric representations and thus overlook valuable chemical context available in public databases like PubChem. This work introduces a multimodal framework that…

Machine Learning · Computer Science 2025-05-20 Can Polat , Hasan Kurban , Erchin Serpedin , Mustafa Kurban

Molecule property prediction is a fundamental problem for computer-aided drug discovery and materials science. Quantum-chemical simulations such as density functional theory (DFT) have been widely used for calculating the molecule…

Machine Learning · Computer Science 2019-11-26 Hiroyuki Shindo , Yuji Matsumoto

Prediction of a molecule's 3D conformer ensemble from the molecular graph holds a key role in areas of cheminformatics and drug discovery. Existing generative models have several drawbacks including lack of modeling important molecular…

Self-supervised learning (SSL) of graph neural networks is emerging as a promising way of leveraging unlabeled data. Currently, most methods are based on contrastive learning adapted from the image domain, which requires view generation and…

Machine Learning · Computer Science 2022-07-12 Yaochen Xie , Zhao Xu , Shuiwang Ji

Recent years have seen a rapid growth of utilizing graph neural networks (GNNs) in the biomedical domain for tackling drug-related problems. However, like any other deep architectures, GNNs are data hungry. While requiring labels in real…

Biological Physics · Physics 2022-05-03 Mengying Sun , Jing Xing , Huijun Wang , Bin Chen , Jiayu Zhou

Self-supervised learning (SSL) has been extensively explored in recent years. Particularly, generative SSL has seen emerging success in natural language processing and other AI fields, such as the wide adoption of BERT and GPT. Despite…

Machine Learning · Computer Science 2022-07-14 Zhenyu Hou , Xiao Liu , Yukuo Cen , Yuxiao Dong , Hongxia Yang , Chunjie Wang , Jie Tang

Semi-supervised learning (SSL) is effectively used for numerous classification problems, thanks to its ability to make use of abundant unlabeled data. The main assumption of various SSL algorithms is that the nearby points on the data…

Machine Learning · Computer Science 2019-09-30 Xuan Wu , Lingxiao Zhao , Leman Akoglu

Recent years have witnessed increasing interest in code representation learning, which aims to represent the semantics of source code into distributed vectors. Currently, various works have been proposed to represent the complex semantics…

Programming Languages · Computer Science 2022-05-05 Xin Wang , Yasheng Wang , Yao Wan , Jiawei Wang , Pingyi Zhou , Li Li , Hao Wu , Jin Liu

Masked graph modeling excels in the self-supervised representation learning of molecular graphs. Scrutinizing previous studies, we can reveal a common scheme consisting of three key components: (1) graph tokenizer, which breaks a molecular…

Machine Learning · Computer Science 2024-01-17 Zhiyuan Liu , Yaorui Shi , An Zhang , Enzhi Zhang , Kenji Kawaguchi , Xiang Wang , Tat-Seng Chua