English
Related papers

Related papers: SELFormer: Molecular Representation Learning via S…

200 papers

Text-based foundation models have become an important part of scientific discovery, with molecular foundation models accelerating advancements in material science and molecular design.However, existing models are constrained by…

Machine Learning · Computer Science 2026-01-29 Alexius Wadell , Anoushka Bhutani , Venkatasubramanian Viswanathan

The ability to design molecules while preserving similarity to a target molecule and/or property is crucial for various applications in drug discovery, chemical design, and biology. We introduce in this paper an efficient training-free…

Machine Learning · Computer Science 2025-11-18 Jiri Navratil , Jarret Ross , Payel Das , Youssef Mroueh , Samuel C Hoffman , Vijil Chenthamarakshan , Brian Belgodere

With the prospect of automating a number of chemical tasks with high fidelity, chemical language processing models are emerging at a rapid speed. Here, we present a cloud-based real-time platform that allows users to virtually screen…

Effective representation of molecules is a crucial factor affecting the performance of artificial intelligence models. This study introduces a flexible, fragment-based, multiscale molecular representation framework called t-SMILES…

Machine Learning · Computer Science 2024-05-22 Juan-Ni Wu , Tong Wang , Yue Chen , Li-Juan Tang , Hai-Long Wu , Ru-Qin Yu

In deep learning for drug discovery, chemical data are often represented as simplified molecular-input line-entry system (SMILES) sequences which allow for straightforward implementation of natural language processing methodologies, one…

Machine Learning · Computer Science 2023-10-05 Kathryn E. Kirchoff , Travis Maxfield , Alexander Tropsha , Shawn M. Gomez

Artificial Intelligence predicts drug properties by encoding drug molecules, aiding in the rapid screening of candidates. Different molecular representations, such as SMILES and molecule graphs, contain complementary information for…

Machine Learning · Computer Science 2024-06-27 Muzhen Cai , Sendong Zhao , Haochun Wang , Yanrui Du , Zewen Qiang , Bing Qin , Ting Liu

The development of large language models and multi-modal models has enabled the appealing idea of generating novel molecules from text descriptions. Generative modeling would shift the paradigm from relying on large-scale chemical screening…

Machine Learning · Computer Science 2025-08-25 Yifan Deng , Spencer S. Ericksen , Anthony Gitter

The application of large language models (LLMs) to chemistry is frequently hampered by a "tokenization bottleneck", where tokenizers tuned on general-domain text tend to fragment chemical representations such as SMILES into semantically…

Computation and Language · Computer Science 2025-11-19 Prathamesh Kalamkar , Ned Letcher , Meissane Chami , Sahger Lad , Shayan Mohanty , Prasanna Pendse

Recent advances in self-supervised deep learning have improved our ability to quantify cellular morphological changes in high-throughput microscopy screens, a process known as morphological profiling. However, most current methods only…

Machine Learning · Computer Science 2026-05-18 Yemin Yu , Emre Hayir , Neil Tenenholtz , Lester Mackey , Ying Wei , David Alvarez-Melis , Ava P. Amini , Alex X. Lu

Language models for molecular design have scaled to hundreds of millions of parameters, yet how they learn chemical grammar is poorly understood. We train SMolLM, a 53K-parameter weight-shared transformer, to generate novel SMILES with 95%…

Machine Learning · Computer Science 2026-05-29 Akhil Jindal , Harang Ju

In the scope of drug discovery, the molecular design aims to identify novel compounds from the chemical space where the potential drug-like molecules are estimated to be in the order of 10^60 - 10^100. Since this search task is…

Machine Learning · Computer Science 2022-10-25 Wenlu Wang , Ye Wang , Honggang Zhao , Simone Sciabola

Retrosynthesis prediction is fundamental to drug discovery and chemical synthesis, requiring the identification of reactants that can produce a target molecule. Current template-free methods struggle to capture the structural invariance…

Machine Learning · Computer Science 2025-10-21 Jiaxi Zhuang , Yu Zhang , Aimin Zhou , Ying Qian

Language models are revolutionizing the biochemistry domain, assisting scientists in drug design and chemical synthesis with high efficiency. Yet current approaches struggle between small language models prone to hallucination and limited…

Machine Learning · Computer Science 2026-02-02 Hao Li , He Cao , Shenyao Peng , Zijing Liu , Bin Feng , Yu Wang , Zhiyuan Yan , Yonghong Tian , Yu Li , Li Yuan

We show that large language model (LLMs) can be transformed via supervised fine-tuning (SFT) of engineered prompts into SmileyLlama for exploring the chemical space of drug molecules. We benchmark SmileyLlama against pre-trained LLMs and…

Molecule representation learning (MRL) methods aim to embed molecules into a real vector space. However, existing SMILES-based (Simplified Molecular-Input Line-Entry System) or GNN-based (Graph Neural Networks) MRL methods either take…

Machine Learning · Computer Science 2021-09-23 Hongwei Wang , Weijiang Li , Xiaomeng Jin , Kyunghyun Cho , Heng Ji , Jiawei Han , Martin D. Burke

Despite their ability to understand chemical knowledge, large language models (LLMs) remain limited in their capacity to propose novel molecules with desired functions (e.g., drug-like properties). In addition, the molecules that LLMs…

Molecular property prediction is a fundamental task in computational chemistry with critical applications in drug discovery and materials science. While recent works have explored Large Language Models (LLMs) for this task, they primarily…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Deepan Adak , Yogesh Singh Rawat , Shruti Vyas

Language modeling has seen impressive progress over the last years, mainly prompted by the invention of the Transformer architecture, sparking a revolution in many fields of machine learning, with breakthroughs in chemistry and biology. In…

Machine Learning · Computer Science 2023-10-11 Andres M Bran , Philippe Schwaller

Optical Chemical Structure Recognition (OCSR) plays a pivotal role in modern chemical informatics, enabling the automated conversion of chemical structure images from scientific literature, patents, and educational materials into…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Wenrui Zhang , Xinggang Wang , Bin Feng , Wenyu Liu

Recently, the impressive performance of large language models (LLMs) on a wide range of tasks has attracted an increasing number of attempts to apply LLMs in drug discovery. However, molecule optimization, a critical task in the drug…

Quantitative Methods · Quantitative Biology 2024-01-22 Geyan Ye , Xibao Cai , Houtim Lai , Xing Wang , Junhong Huang , Longyue Wang , Wei Liu , Xiangxiang Zeng