English
Related papers

Related papers: Dual-view Molecule Pre-training

200 papers

Molecular property prediction is a crucial foundation for drug discovery. In recent years, pre-trained deep learning models have been widely applied to this task. Some approaches that incorporate prior biological domain knowledge into the…

Machine Learning · Computer Science 2024-08-20 Tianyu Zhang , Yuxiang Ren , Chengbin Hou , Hairong Lv , Xuegong Zhang

Designing a neural network architecture for molecular representation is crucial for AI-driven drug discovery and molecule design. In this work, we propose a new framework for molecular representation learning. Our contribution is threefold:…

Machine Learning · Computer Science 2022-10-18 Jiye Kim , Seungbeom Lee , Dongwoo Kim , Sungsoo Ahn , Jaesik Park

Unlike vision and language data which usually has a unique format, molecules can naturally be characterized using different chemical formulations. One can view a molecule as a 2D graph or define it as a collection of atoms located in a 3D…

Machine Learning · Computer Science 2023-03-29 Shengjie Luo , Tianlang Chen , Yixian Xu , Shuxin Zheng , Tie-Yan Liu , Liwei Wang , Di He

How to produce expressive molecular representations is a fundamental challenge in AI-driven drug discovery. Graph neural network (GNN) has emerged as a powerful technique for modeling molecular data. However, previous supervised approaches…

Machine Learning · Computer Science 2020-12-22 Pengyong Li , Jun Wang , Yixuan Qiao , Hao Chen , Yihuan Yu , Xiaojun Yao , Peng Gao , Guotong Xie , Sen Song

Extracting informative representations of molecules using Graph neural networks (GNNs) is crucial in AI-driven drug discovery. Recently, the graph research community has been trying to replicate the success of self-supervised pretraining in…

Machine Learning · Computer Science 2022-11-03 Ruoxi Sun , Hanjun Dai , Adams Wei Yu

GNN-based methods have achieved excellent results as a mainstream task in drug response prediction tasks in recent years. Traditional GNN methods use only the atoms in a drug molecule as nodes to obtain the representation of the molecular…

Biomolecules · Quantitative Biology 2024-12-12 Kun Li , Jia Wu , Bo Du , Sergey V. Petoukhov , Huiting Xu , Zheman Xiao , Wenbin Hu

Graph neural networks (GNNs) and message passing neural networks (MPNNs) have been proven to be expressive for subgraph structures in many applications. Some applications in heterogeneous graphs require explicit edge modeling, such as…

Machine Learning · Computer Science 2021-12-17 Xin Liu , Yangqiu Song

Molecular property prediction (MPP) is a fundamental but challenging task in the computer-aided drug discovery process. More and more recent works employ different graph-based models for MPP, which have made considerable progress in…

Machine Learning · Computer Science 2023-12-29 Bangyi Zhao , Weixia Xu , Jihong Guan , Shuigeng Zhou

Many machine learning techniques have been proposed in the last few years to process data represented in graph-structured form. Graphs can be used to model several scenarios, from molecules and materials to RNA secondary structures. Several…

Machine Learning · Computer Science 2018-11-19 Nicolò Navarin , Dinh V. Tran , Alessandro Sperduti

Generative pre-trained Transformer (GPT) has demonstrates its great success in natural language processing and related techniques have been adapted into molecular modeling. Considering that text is the most important record for scientific…

Computation and Language · Computer Science 2023-05-29 Zequn Liu , Wei Zhang , Yingce Xia , Lijun Wu , Shufang Xie , Tao Qin , Ming Zhang , Tie-Yan Liu

Molecular property prediction is an increasingly critical task within drug discovery and development. Typically, neural networks can learn molecular properties using graph-based, language-based or feature-based methods. Recent advances in…

Machine Learning · Computer Science 2025-07-31 Philip Spence , Brooks Paige , Anne Osbourn

In recent years, artificial intelligence has played an important role on accelerating the whole process of drug discovery. Various of molecular representation schemes of different modals (e.g. textual sequence or graph) are developed. By…

Machine Learning · Computer Science 2022-11-28 Tianyu Wu , Yang Tang , Qiyu Sun , Luolin Xiong

Constructing appropriate representations of molecules lies at the core of numerous tasks such as material science, chemistry and drug designs. Recent researches abstract molecules as attributed graphs and employ graph neural networks (GNN)…

Machine Learning · Computer Science 2021-07-29 Jianwen Chen , Shuangjia Zheng , Ying Song , Jiahua Rao , Yuedong Yang

Purpose: Large Language Models (LLMs) like GPT (Generative Pre-trained Transformer) from OpenAI and LLaMA (Large Language Model Meta AI) from Meta AI are increasingly recognized for their potential in the field of cheminformatics,…

Biomolecules · Quantitative Biology 2024-05-22 Shaghayegh Sadeghi , Alan Bui , Ali Forooghi , Jianguo Lu , Alioune Ngom

In this work, we propose a simple transformer-based baseline for multimodal molecular representation learning, integrating three distinct modalities: SMILES strings, 2D graph representations, and 3D conformers of molecules. A key aspect of…

Machine Learning · Computer Science 2024-10-25 Andrei Manolache , Dragos Tantaru , Mathias Niepert

Machine learning interatomic potentials (MLIPs) enables molecular dynamics (MD) simulations with ab initio accuracy and has been applied to various fields of physical science. However, the performance and transferability of MLIPs are…

Chemical Physics · Physics 2024-04-16 Taoyong Cui , Chenyu Tang , Mao Su , Shufei Zhang , Yuqiang Li , Lei Bai , Yuhan Dong , Xingao Gong , Wanli Ouyang

Molecular representation learning has shown great success in advancing AI-based drug discovery. The core of many recent works is based on the fact that the 3D geometric structure of molecules provides essential information about their…

Machine Learning · Computer Science 2024-10-23 Jiying Zhang , Zijing Liu , Yu Wang , Yu Li

Recent research has demonstrated the efficacy of pre-training graph neural networks (GNNs) to capture the transferable graph semantics and enhance the performance of various downstream tasks. However, the semantic knowledge learned from…

Machine Learning · Computer Science 2023-12-19 Mouxiang Chen , Zemin Liu , Chenghao Liu , Jundong Li , Qiheng Mao , Jianling Sun

In the field of chemical structure recognition, the task of converting molecular images into machine-readable data formats such as SMILES string stands as a significant challenge, primarily due to the varied drawing styles and conventions…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Yufan Chen , Ching Ting Leung , Yong Huang , Jianwei Sun , Hao Chen , Hanyu Gao

Molecular representation learning is crucial for the problem of molecular property prediction, where graph neural networks (GNNs) serve as an effective solution due to their structure modeling capabilities. Since labeled data is often…

Machine Learning · Computer Science 2023-09-26 Cameron Diao , Kaixiong Zhou , Zirui Liu , Xiao Huang , Xia Hu