English
Related papers

Related papers: mCLM: A Modular Chemical Language Model that Gener…

200 papers

General-purpose large language models (LLMs) that rely on in-context learning do not reliably deliver the scientific understanding and performance required for drug discovery tasks. Simply increasing model size or introducing reasoning…

Accurate molecular property prediction is a critical challenge with wide-ranging applications in chemistry, materials science, and drug discovery. Molecular representation methods, including fingerprints and graph neural networks (GNNs),…

Machine Learning · Computer Science 2025-08-13 Jiaxin Ju , Yizhen Zheng , Huan Yee Koh , Can Wang , Shirui Pan

Understanding molecules is key to understanding organisms and driving advances in drug discovery, requiring interdisciplinary knowledge across chemistry and biology. Although large molecular language models have achieved notable success in…

Machine Learning · Computer Science 2025-10-03 Dongki Kim , Wonbin Lee , Sung Ju Hwang

Large Language Models (LLMs) have the potential to accelerate small molecule drug design due to their ability to reason about information from diverse sources and formats. However, their practical utility remains unclear due to the lack of…

Applications of machine learning in chemistry are often limited by the scarcity and expense of labeled data, restricting traditional supervised methods. In this work, we introduce a framework for molecular reasoning using general-purpose…

Designing de-novo molecules with desired property profiles requires efficient exploration of the vast chemical space ranging from $10^{23}$ to $10^{60}$ possible synthesizable candidates. While various deep generative models have been…

Machine Learning · Computer Science 2025-08-25 Kamran Chitsaz , Roshan Balaji , Quentin Fournier , Nirav Pravinbhai Bhatt , Sarath Chandar

Large Language Models (LLMs) with strong abilities in natural language processing tasks have emerged and have been applied in various kinds of areas such as science, finance and software engineering. However, the capability of LLMs to…

Computation and Language · Computer Science 2023-12-29 Taicheng Guo , Kehan Guo , Bozhao Nan , Zhenwen Liang , Zhichun Guo , Nitesh V. Chawla , Olaf Wiest , Xiangliang Zhang

In the real world, a molecule is a 3D geometric structure. Compared to 1D SMILES sequences and 2D molecular graphs, 3D molecules represent the most informative molecular modality. Despite the rapid progress of autoregressive-based language…

Computational Engineering, Finance, and Science · Computer Science 2025-08-15 Lei Jiang , Shuzhou Sun , Biqing Qi , Yuchen Fu , Xiaohua Xu , Yuqiang Li , Dongzhan Zhou , Tianfan Fu

Chemical language models (CLMs) have emerged as promising competitors to popular classical machine learning models for molecular property prediction (MPP) tasks. However, an increasing number of studies have reported inconsistent and…

Machine Learning · Computer Science 2026-03-17 Mohammad Mostafanejad , Paul Saxe , T. Daniel Crawford

Large Language Models (LLMs) have emerged as a transformative power in enhancing natural language comprehension, representing a significant stride toward artificial general intelligence. The application of LLMs extends beyond conventional…

Large Language Models (LLMs) have significantly transformed our daily life and established a new paradigm in natural language processing (NLP). However, the predominant pretraining of LLMs on extensive web-based texts remains insufficient…

Chemical Physics · Physics 2024-12-31 Yang Han , Ziping Wan , Lu Chen , Kai Yu , Xin Chen

Most current molecular language models transfer the masked language model or image-text generation model from natural language processing to molecular field. However, molecules are not solely characterized by atom/bond symbols; they…

Emerging Technologies · Computer Science 2024-11-26 Yifan Wu , Min Zeng , Yang Li , Yang Zhang , Min Li

Recent advancements in large language models (LLMs) have demonstrated strong potential for enabling domain-specific intelligence. In this work, we present our vision for building an AI-powered chemical brain, which frames chemical…

Artificial Intelligence · Computer Science 2026-01-12 Weichen Dai , Yezeng Chen , Zijie Dai , Yubo Liu , Zhijie Huang , Yixuan Pan , Baiyang Song , Chengli Zhong , Xinhe Li , Zeyu Wang , Zhuoying Feng , Yi Zhou

Molecule generation requires satisfying multiple chemical and biological constraints while searching a large and structured chemical space. This makes it a non-binary problem, where effective models must identify non-obvious solutions under…

Computation and Language · Computer Science 2026-04-21 Wen Tao , Yiwei Wang , Peng Zhou , Bryan Hooi , Wanlong Fang , Tianle Zhang , Xiao Luo , Yuansheng Liu , Alvin Chan

Large Language Models (LLMs) represent a class of deep learning models adept at understanding natural language and generating coherent responses to various prompts or queries. These models far exceed the complexity of conventional neural…

Machine Learning · Computer Science 2024-12-05 Minghao Shao , Abdul Basit , Ramesh Karri , Muhammad Shafique

Large language models (LLMs) have large potential for molecular optimization, as they can gather external chemistry tools and enable collaborative interactions to iteratively refine molecular candidates. However, this potential remains…

Artificial Intelligence · Computer Science 2025-05-28 Hyomin Kim , Yunhui Jang , Sungsoo Ahn

The application of large language models (LLMs) to chemistry is frequently hampered by a "tokenization bottleneck", where tokenizers tuned on general-domain text tend to fragment chemical representations such as SMILES into semantically…

Computation and Language · Computer Science 2025-11-19 Prathamesh Kalamkar , Ned Letcher , Meissane Chami , Sahger Lad , Shayan Mohanty , Prasanna Pendse

Large Language Models (LLMs) have shown growing potential in molecular sciences, but they often produce chemically inaccurate descriptions and struggle to recognize or justify potential errors. This raises important concerns about their…

Chemical Physics · Physics 2025-10-29 Yuyang Wu , Jinhui Ye , Shuhao Zhang , Lu Dai , Yonatan Bisk , Olexandr Isayev

Recently, Large Language Models (LLMs) have showcased remarkable capabilities in natural language understanding. While demonstrating proficiency in everyday conversations and question-answering situations, these models frequently struggle…

Computation and Language · Computer Science 2023-08-28 Chaoyi Wu , Weixiong Lin , Xiaoman Zhang , Ya Zhang , Yanfeng Wang , Weidi Xie