English
Related papers

Related papers: MolE: a molecular foundation model for drug discov…

200 papers

Molecule representation learning is crucial for understanding and predicting molecular properties. However, conventional atom-centric models, which treat chemical bonds merely as pairwise interactions, often overlook complex bond-level…

Machine Learning · Computer Science 2026-03-03 Yunqing Liu , Yi Zhou , Wenqi Fan

Over the past six years, molecular transformer models have become key tools in drug discovery. Most existing models are pre-trained on large, unlabeled datasets such as ZINC or ChEMBL. However, the extent to which large-scale pre-training…

Machine Learning · Computer Science 2025-05-23 Afnan Sultan , Max Rausch-Dupont , Shahrukh Khan , Olga Kalinina , Dietrich Klakow , Andrea Volkamer

We apply a Transformer architecture, specifically BERT, to learn flexible and high quality molecular representations for drug discovery problems. We study the impact of using different combinations of self-supervised tasks for pre-training,…

Machine Learning · Computer Science 2020-11-30 Benedek Fabian , Thomas Edlich , Héléna Gaspar , Marwin Segler , Joshua Meyers , Marco Fiscato , Mohamed Ahmed

Molecule pretraining has quickly become the go-to schema to boost the performance of AI-based drug discovery. Naturally, molecules can be represented as 2D topological graphs or 3D geometric point clouds. Although most existing pertaining…

Machine Learning · Computer Science 2025-02-10 Shengchao Liu , Weitao Du , Zhiming Ma , Hongyu Guo , Jian Tang

In drug-discovery-related tasks such as virtual screening, machine learning is emerging as a promising way to predict molecular properties. Conventionally, molecular fingerprints (numerical representations of molecules) are calculated…

Machine Learning · Computer Science 2019-11-13 Shion Honda , Shoi Shi , Hiroki R. Ueda

Recent advancements in deep learning-based modeling of molecules promise to accelerate in silico drug discovery. A plethora of generative models is available, building molecules either atom-by-atom and bond-by-bond or fragment-by-fragment.…

Recent advances in language models have enabled framing molecule generation as sequence modeling. However, existing approaches often rely on single-objective reinforcement learning, limiting their applicability to real-world drug design,…

Machine Learning · Computer Science 2025-02-11 Diego Calanzone , Pierluca D'Oro , Pierre-Luc Bacon

Molecular deep learning models have achieved remarkable success in property prediction, but they often require large amounts of labeled data. The challenge is that, in real-world applications, labels are extremely scarce, as obtaining them…

Machine Learning · Computer Science 2025-07-21 Kevin Tirta Wijaya , Minghao Guo , Michael Sun , Hans-Peter Seidel , Wojciech Matusik , Vahid Babaei

In the field of chemical structure recognition, the task of converting molecular images into machine-readable data formats such as SMILES string stands as a significant challenge, primarily due to the varied drawing styles and conventions…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Yufan Chen , Ching Ting Leung , Yong Huang , Jianwei Sun , Hao Chen , Hanyu Gao

How to produce expressive molecular representations is a fundamental challenge in AI-driven drug discovery. Graph neural network (GNN) has emerged as a powerful technique for modeling molecular data. However, previous supervised approaches…

Machine Learning · Computer Science 2020-12-22 Pengyong Li , Jun Wang , Yixuan Qiao , Hao Chen , Yihuan Yu , Xiaojun Yao , Peng Gao , Guotong Xie , Sen Song

Designing de-novo molecules with desired property profiles requires efficient exploration of the vast chemical space ranging from $10^{23}$ to $10^{60}$ possible synthesizable candidates. While various deep generative models have been…

Machine Learning · Computer Science 2025-08-25 Kamran Chitsaz , Roshan Balaji , Quentin Fournier , Nirav Pravinbhai Bhatt , Sarath Chandar

Despite deep learning's success in chemistry, its impact is hindered by a lack of interpretability and an inability to resolve activity cliffs, where minor structural nuances trigger drastic property shifts. Current representation learning,…

Machine Learning · Computer Science 2026-03-26 Xiangsen Chen , Ruilong Wu , Yanyan Lan , Ting Ma , Yang Liu

Artificial intelligence and machine learning have shown great promise in their ability to accelerate novel materials discovery. As researchers and domain scientists seek to unify and consolidate chemical knowledge, the case for models with…

Molecular property prediction is essential for applications such as drug discovery and toxicity assessment. While Graph Neural Networks (GNNs) have shown promising results by modeling molecules as molecular graphs, their reliance on…

Machine Learning · Computer Science 2025-04-09 Tianyi Jiang , Zeyu Wang , Shanqing Yu , Qi Xuan

Models based on machine learning can enable accurate and fast molecular property predictions, which is of interest in drug discovery and material design. Various supervised machine learning models have demonstrated promising performance,…

Machine Learning · Computer Science 2022-12-15 Jerret Ross , Brian Belgodere , Vijil Chenthamarakshan , Inkit Padhi , Youssef Mroueh , Payel Das

This study introduces a systematic framework to compare the efficacy of Large Language Models (LLMs) for fine-tuning across various cheminformatics tasks. Employing a uniform training methodology, we assessed three well-known…

Machine Learning · Computer Science 2024-05-03 Lee Youngmin , Lang S. I. D. Andrew , Cai Duoduo , Wheat R. Stephen

The extraction of molecular structures and reaction data from scientific documents is challenging due to their varied, unstructured chemical formats and complex document layouts. To address this, we introduce MolMole, a vision-based deep…

Molecular representation learning is pivotal for various molecular property prediction tasks related to drug discovery. Robust and accurate benchmarks are essential for refining and validating current methods. Existing molecular property…

Chemical Physics · Physics 2024-06-27 Shikun Feng , Jiaxin Zheng , Yinjun Jia , Yanwen Huang , Fengfeng Zhou , Wei-Ying Ma , Yanyan Lan

Molecular property prediction is a crucial foundation for drug discovery. In recent years, pre-trained deep learning models have been widely applied to this task. Some approaches that incorporate prior biological domain knowledge into the…

Machine Learning · Computer Science 2024-08-20 Tianyu Zhang , Yuxiang Ren , Chengbin Hou , Hairong Lv , Xuegong Zhang

Understanding molecules is key to understanding organisms and driving advances in drug discovery, requiring interdisciplinary knowledge across chemistry and biology. Although large molecular language models have achieved notable success in…

Machine Learning · Computer Science 2025-10-03 Dongki Kim , Wonbin Lee , Sung Ju Hwang