English
Related papers

Related papers: Transformer Based Molecule Encoding for Property P…

200 papers

The increasing number of protein sequences decoded from genomes is opening up new avenues of research on linking protein sequence to function with transformer neural networks. Recent research has shown that the number of known protein…

Machine Learning · Computer Science 2022-06-23 Anowarul Kabir , Amarda Shehu

Machine-learning models in chemistry - when based on descriptors of atoms embedded within molecules - face essential challenges in transferring the quality of predictions of local electronic structures and their associated properties across…

Chemical Physics · Physics 2024-09-27 Frederik Ø. Kjeldal , Janus J. Eriksen

Molecular property prediction is essential in chemistry, especially for drug discovery applications. However, available molecular property data is often limited, encouraging the transfer of information from related data. Transfer learning…

Machine Learning · Computer Science 2022-07-07 Johan Broberg , Maria Bånkestad , Erik Ylipää

Unlike vision and language data which usually has a unique format, molecules can naturally be characterized using different chemical formulations. One can view a molecule as a 2D graph or define it as a collection of atoms located in a 3D…

Machine Learning · Computer Science 2023-03-29 Shengjie Luo , Tianlang Chen , Yixian Xu , Shuxin Zheng , Tie-Yan Liu , Liwei Wang , Di He

Property prediction accuracy has long been a key parameter of machine learning in materials informatics. Accordingly, advanced models showing state-of-the-art performance turn into highly parameterized black boxes missing interpretability.…

Materials Science · Physics 2023-08-03 Vadim Korolev , Pavel Protsenko

Machine learning approaches have become popular for molecular modeling tasks, including molecular force fields and properties prediction. Traditional supervised learning methods suffer from scarcity of labeled data for particular tasks,…

Chemical Physics · Physics 2022-11-29 Xiang Gao , Weihao Gao , Wenzhi Xiao , Zhirui Wang , Chong Wang , Liang Xiang

Designing accurate deep learning models for molecular property prediction plays an increasingly essential role in drug and material discovery. Recently, due to the scarcity of labeled molecules, self-supervised learning methods for learning…

Biomolecules · Quantitative Biology 2022-06-08 Han Li , Dan Zhao , Jianyang Zeng

Molecular Representation Learning is essential to solving many drug discovery and computational chemistry problems. It is a challenging problem due to the complex structure of molecules and the vast chemical space. Graph representations of…

Machine Learning · Computer Science 2023-01-18 Atia Hamidizadeh , Tony Shen , Martin Ester

Graphs are ubiquitous data structures for representing interactions between entities. With an emphasis on the use of graphs to represent chemical molecules, we explore the task of learning to generate graphs that conform to a distribution…

Machine Learning · Computer Science 2019-03-08 Qi Liu , Miltiadis Allamanis , Marc Brockschmidt , Alexander L. Gaunt

We view molecular optimization as a graph-to-graph translation problem. The goal is to learn to map from one molecular graph to another with better properties based on an available corpus of paired molecules. Since molecules can be…

Machine Learning · Computer Science 2019-01-30 Wengong Jin , Kevin Yang , Regina Barzilay , Tommi Jaakkola

Machine learning has become a promising approach for molecular modeling. Positional quantities, such as interatomic distances and bond angles, play a crucial role in molecule physics. The existing works rely on careful manual design of…

Machine Learning · Computer Science 2022-11-24 Xiang Gao , Weihao Gao , Wenzhi Xiao , Zhirui Wang , Chong Wang , Liang Xiang

Transformer-based large language models have remarkable potential to accelerate design optimization for applications such as drug development and materials discovery. Self-supervised pretraining of transformer models requires large-scale…

Machine Learning · Computer Science 2023-10-27 Pei Zhang , Logan Kearney , Debsindhu Bhowmik , Zachary Fox , Amit K. Naskar , John Gounley

The Transformer architecture has become a dominant choice in many domains, such as natural language processing and computer vision. Yet, it has not achieved competitive performance on popular leaderboards of graph-level prediction compared…

Machine Learning · Computer Science 2021-11-25 Chengxuan Ying , Tianle Cai , Shengjie Luo , Shuxin Zheng , Guolin Ke , Di He , Yanming Shen , Tie-Yan Liu

Graph neural networks have recently become a standard method for analysing chemical compounds. In the field of molecular property prediction, the emphasis is now put on designing new model architectures, and the importance of atom…

Chemical Physics · Physics 2021-02-15 Agnieszka Pocha , Tomasz Danel , Łukasz Maziarka

Research into deep learning models for molecular property prediction has primarily focused on the development of better Graph Neural Network (GNN) architectures. Though new GNN variants continue to improve performance, their modifications…

Quantitative Methods · Quantitative Biology 2021-11-23 Toni Sagayaraj , Carsten Eickhoff

The problem of accelerating drug discovery relies heavily on automatic tools to optimize precursor molecules to afford them with better biochemical properties. Our work in this paper substantially extends prior state-of-the-art on…

Chemical Physics · Physics 2019-10-22 Wengong Jin , Regina Barzilay , Tommi Jaakkola

This paper proposes a latent prompt Transformer model for solving challenging optimization problems such as molecule design, where the goal is to find molecules with optimal values of a target chemical or biological property that can be…

Machine Learning · Computer Science 2024-02-07 Deqian Kong , Yuhao Huang , Jianwen Xie , Ying Nian Wu

Few-shot learning is a promising approach to molecular property prediction as supervised data is often very limited. However, many important molecular properties depend on complex molecular characteristics -- such as the various 3D…

Machine Learning · Computer Science 2023-10-10 Christopher Fifty , Joseph M. Paggi , Ehsan Amid , Jure Leskovec , Ron Dror

Multimodal molecular representation learning, which jointly models molecular graphs and their textual descriptions, enhances predictive accuracy and interpretability by enabling more robust and reliable predictions of drug toxicity,…

Machine Learning · Computer Science 2025-10-21 Yingxu Wang , Kunyu Zhang , Jiaxin Huang , Nan Yin , Siwei Liu , Eran Segal

Graph neural networks (GNNs) demonstrate great performance in compound property and activity prediction due to their capability to efficiently learn complex molecular graph structures. However, two main limitations persist including…

Biomolecules · Quantitative Biology 2023-10-10 Apakorn Kengkanna , Masahito Ohue