English
Related papers

Related papers: Transformer Based Molecule Encoding for Property P…

200 papers

Molecular property prediction is essential for drug discovery. In recent years, deep learning methods have been introduced to this area and achieved state-of-the-art performances. However, most of existing methods ignore the intrinsic…

Biomolecules · Quantitative Biology 2022-11-04 Yuancheng Sun , Yimeng Chen , Weizhi Ma , Wenhao Huang , Kang Liu , Zhiming Ma , Wei-Ying Ma , Yanyan Lan

In this work, we introduce a method to fine-tune a Transformer-based generative model for molecular de novo design. Leveraging the superior sequence learning capacity of Transformers over Recurrent Neural Networks (RNNs), our model can…

Machine Learning · Computer Science 2024-03-11 Pengcheng Xu , Tao Feng , Tianfan Fu , Siddhartha Laghuvarapu , Jimeng Sun

Molecular property prediction is a critical task in computational drug discovery. While recent advances in Graph Neural Networks (GNNs) and Transformers have shown to be effective and promising, they face the following limitations:…

Predictive coding is a message-passing framework initially developed to model information processing in the brain, and now also topic of research in machine learning due to some interesting properties. One of such properties is the natural…

Machine Learning · Computer Science 2022-12-12 Billy Byiringiro , Tommaso Salvatori , Thomas Lukasiewicz

Drug discovery using deep learning has attracted a lot of attention of late as it has obvious advantages like higher efficiency, less manual guessing and faster process time. In this paper, we present a novel neural network for generating…

Biomolecules · Quantitative Biology 2021-10-08 Abhinav Sagar

With the rapid increase of compound databases available in medicinal and material science, there is a growing need for learning representations of molecules in a semi-supervised manner. In this paper, we propose an unsupervised hierarchical…

Machine Learning · Statistics 2017-11-30 Hai Nguyen , Shin-ichi Maeda , Kenta Oono

Labeled sequence transduction is a task of transforming one sequence into another sequence that satisfies desiderata specified by a set of labels. In this paper we propose multi-space variational encoder-decoders, a new model for labeled…

Computation and Language · Computer Science 2019-10-08 Chunting Zhou , Graham Neubig

Machine Learning (ML) has the potential to accelerate discovery of new materials and shed light on useful properties of existing materials. A key difficulty when applying ML in Materials Science is that experimental datasets of material…

Accurate and efficient prediction of polymer properties is of great significance in polymer design. Conventionally, expensive and time-consuming experiments or simulations are required to evaluate polymer functions. Recently, Transformer…

Machine Learning · Computer Science 2023-04-27 Changwen Xu , Yuyang Wang , Amir Barati Farimani

Although machine learning has been successfully used to propose novel molecules that satisfy desired properties, it is still challenging to explore a large chemical space efficiently. In this paper, we present a conditional molecular design…

Machine Learning · Computer Science 2019-04-02 Seokho Kang , Kyunghyun Cho

Transformers are increasingly employed for graph data, demonstrating competitive performance in diverse tasks. To incorporate graph information into these models, it is essential to enhance node and edge features with positional encodings.…

Properties of molecules are indicative of their functions and thus are useful in many applications. With the advances of deep learning methods, computational approaches for predicting molecular properties are gaining increasing momentum.…

Quantitative Methods · Quantitative Biology 2021-07-07 Zhengyang Wang , Meng Liu , Youzhi Luo , Zhao Xu , Yaochen Xie , Limei Wang , Lei Cai , Qi Qi , Zhuoning Yuan , Tianbao Yang , Shuiwang Ji

Molecular "fingerprints" encoding structural information are the workhorse of cheminformatics and machine learning in drug discovery applications. However, fingerprint representations necessarily emphasize particular aspects of the…

Machine Learning · Statistics 2016-08-26 Steven Kearnes , Kevin McCloskey , Marc Berndl , Vijay Pande , Patrick Riley

Many important problems involving molecular property prediction from 3D structures have limited data, posing a generalization challenge for neural networks. In this paper, we describe a pre-training technique based on denoising that…

The limited extrapolative power of structure-based machine learning (ML) models is a critical bottleneck in chemical discovery, particularly for industrial R&D, where navigating uncharted chemical space to find next-generation materials or…

Supervised learning on molecules has incredible potential to be useful in chemistry, drug discovery, and materials science. Luckily, several promising and closely related neural network models invariant to molecular symmetries have already…

Machine Learning · Computer Science 2017-06-14 Justin Gilmer , Samuel S. Schoenholz , Patrick F. Riley , Oriol Vinyals , George E. Dahl

We propose a neural network weight encoding method for network property prediction that utilizes set-to-set and set-to-vector functions to efficiently encode neural network parameters. Our approach is capable of encoding neural networks in…

Machine Learning · Computer Science 2025-01-15 Bruno Andreis , Soro Bedionita , Philip H. S. Torr , Sung Ju Hwang

Machine learning for molecular property prediction has focused largely on pure compounds, even though many practical applications depend on mixtures with intermolecular interactions. Recent work has expanded the availability of mixture…

Machine Learning · Computer Science 2026-05-29 Roel J. Leenhouts , Nathan K. Morgan , William Green , Jan G. Rittig , Florence H. Vermeire

Recently supervised machine learning has been ascending in providing new predictive approaches for chemical, biological and materials sciences applications. In this Perspective we focus on the interplay of machine learning algorithm with…

Data-driven approaches such as deep learning can result in predictive models for material properties with exceptional accuracy and efficiency. However, in many applications, data is sparse, severely limiting their accuracy and…

Machine Learning · Computer Science 2025-10-29 Robert J Appleton , Brian C Barnes , Alejandro Strachan