English
Related papers

Related papers: Pre-training Transformers for Molecular Property P…

200 papers

Accurate and efficient prediction of polymer properties is of great significance in polymer design. Conventionally, expensive and time-consuming experiments or simulations are required to evaluate polymer functions. Recently, Transformer…

Machine Learning · Computer Science 2023-04-27 Changwen Xu , Yuyang Wang , Amir Barati Farimani

Recent progress in machine learning has sparked increased interest in utilizing this technology to predict the outcomes of chemical reactions. The ultimate aim of such endeavors is to develop a universal model that can predict products for…

Chemical Physics · Physics 2025-07-03 Daniel Julian , Jesús Pérez-Ríos

Artificial intelligence (AI) has been widely applied in drug discovery with a major task as molecular property prediction. Despite booming techniques in molecular representation learning, key elements underlying molecular property…

Quantitative Methods · Quantitative Biology 2023-09-06 Jianyuan Deng , Zhibo Yang , Hehe Wang , Iwao Ojima , Dimitris Samaras , Fusheng Wang

Molecular property prediction is crucial for drug discovery and materials science, yet existing approaches suffer from limited interpretability, poor cross-task generalization, and lack of chemical reasoning capabilities. Traditional…

Machine Learning · Computer Science 2025-10-20 Jiaxi Zhuang , Yaorui Shi , Jue Hou , Yunong He , Mingwei Ye , Mingjun Xu , Yuming Su , Linfeng Zhang , Ying Qian , Linfeng Zhang , Guolin Ke , Hengxing Cai

We propose a new model for making generalizable and diverse retrosynthetic reaction predictions. Given a target compound, the task is to predict the likely chemical reactants to produce the target. This generative task can be framed as a…

Machine Learning · Computer Science 2019-10-23 Benson Chen , Tianxiao Shen , Tommi S. Jaakkola , Regina Barzilay

Introduction: Computational modeling has rapidly advanced over the last decades, especially to predict molecular properties for chemistry, material science and drug design. Recently, machine learning techniques have emerged as a powerful…

In the intersection of molecular science and deep learning, tasks like virtual screening have driven the need for a high-throughput molecular representation generator on large chemical databases. However, as SMILES strings are the most…

Computational Engineering, Finance, and Science · Computer Science 2021-12-28 Wenhao Zhu , Ziyao Li , Lingsheng Cai , Guojie Song

Recent years have seen rapid development of descriptor generation based on representation learning of extremely diverse molecules, especially those that apply natural language processing (NLP) models to SMILES, a literal representation of…

Machine Learning · Computer Science 2024-02-20 Yasuhiro Yoshikai , Tadahaya Mizuno , Shumpei Nemoto , Hiroyuki Kusuhara

The simplified molecular-input line-entry system (SMILES) is the most popular representation of chemical compounds. Therefore, many SMILES-based molecular property prediction models have been developed. In particular, transformer-based…

Quantitative Methods · Quantitative Biology 2022-05-03 Ingoo Lee , Hojung Nam

How to effectively represent molecules is a long-standing challenge for molecular property prediction and drug discovery. This paper studies this problem and proposes to incorporate chemical domain knowledge, specifically related to…

Machine Learning · Computer Science 2023-05-04 Liang Zeng , Lanqing Li , Jian Li

The calculation of reactive properties is a challenging task in chemical reaction discovery. Machine learning (ML) methods play an important role in accelerating electronic structure predictions of activation energies and reaction…

Chemical Physics · Physics 2025-05-02 Joe Gilkes , Mark Storr , Reinhard J. Maurer , Scott Habershon

In the present paper we evaluated efficiency of the recent Transformer-CNN models to predict target properties based on the augmented stereochemical SMILES. We selected a well-known Cliff activity dataset as well as a Dipole moment dataset…

Quantitative Methods · Quantitative Biology 2020-10-08 Ruud van Deursen , Igor V. Tetko , Guillaume Godin

With access to large datasets, deep neural networks (DNN) have achieved human-level accuracy in image and speech recognition tasks. However, in chemistry, data is inherently small and fragmented. In this work, we develop an approach of…

Machine Learning · Statistics 2018-08-16 Garrett B. Goh , Charles Siegel , Abhinav Vishnu , Nathan O. Hodas

The use of machine learning in chemistry has become a common practice. At the same time, despite the success of modern machine learning methods, the lack of data limits their use. Using a transfer learning methodology can help solve this…

Machine Learning · Computer Science 2021-07-26 Kirill Karpov , Artem Mitrofanov , Vadim Korolev , Valery Tkachenko

Molecular property prediction is essential for drug discovery. In recent years, deep learning methods have been introduced to this area and achieved state-of-the-art performances. However, most of existing methods ignore the intrinsic…

Biomolecules · Quantitative Biology 2022-11-04 Yuancheng Sun , Yimeng Chen , Weizhi Ma , Wenhao Huang , Kang Liu , Zhiming Ma , Wei-Ying Ma , Yanyan Lan

Large-scale pre-training methodologies for chemical language models represent a breakthrough in cheminformatics. These methods excel in tasks such as property prediction and molecule generation by learning contextualized representations of…

Machine Learning · Computer Science 2025-07-18 Eduardo Soares , Victor Shirasuna , Emilio Vital Brazil , Renato Cerqueira , Dmitry Zubarev , Kristin Schmidt

Molecular property prediction has attracted substantial attention recently. Accurate prediction of drug properties relies heavily on effective molecular representations. The structures of chemical compounds are commonly represented as…

Machine Learning · Computer Science 2025-08-05 Anyin Zhao , Zuquan Chen , Zhengyu Fang , Xiaoge Zhang , Jing Li

SMILES is a linear representation of chemical structures which encodes the connection table, and the stereochemistry of a molecule as a line of text with a grammar structure denoting atoms, bonds, rings and chains, and this information can…

Machine Learning · Computer Science 2018-12-03 Arindam Paul , Dipendra Jha , Reda Al-Bahrani , Wei-keng Liao , Alok Choudhary , Ankit Agrawal

Understanding protein sequences is vital and urgent for biology, healthcare, and medicine. Labeling approaches are expensive yet time-consuming, while the amount of unlabeled data is increasing quite faster than that of the labeled data due…

Computation and Language · Computer Science 2021-11-01 Liang He , Shizhuo Zhang , Lijun Wu , Huanhuan Xia , Fusong Ju , He Zhang , Siyuan Liu , Yingce Xia , Jianwei Zhu , Pan Deng , Bin Shao , Tao Qin , Tie-Yan Liu

Predicting the chemical properties of compounds is crucial in discovering novel materials and drugs with specific desired characteristics. Recent significant advances in machine learning technologies have enabled automatic predictive…

Quantitative Methods · Quantitative Biology 2021-12-10 Yang Liu , Hisashi Kashima