English
Related papers

Related papers: Language models in molecular discovery

200 papers

Large language models (LLMs) have demonstrated broad utility across molecular domains, spanning drug discovery and materials design. Analyzing LLMs' latent representations is crucial for elucidating their underlying mechanisms, improving…

Machine Learning · Computer Science 2026-02-03 Zhuoran Li , Xu Sun , Wanyu Lin , Jiannong Cao

The development of automated experimental facilities and the digitization of experimental data have introduced numerous opportunities to radically advance chemical laboratories. As many laboratory tasks involve predicting and understanding…

Protein language models (PLMs) have shown promise in improving the understanding of protein sequences, contributing to advances in areas such as function prediction and protein engineering. However, training these models from scratch…

Machine Learning · Computer Science 2024-12-19 Shivasankaran Vanaja Pandi , Bharath Ramsundar

Since the advent of machine learning, interpretability has remained a persistent challenge, becoming increasingly urgent as generative models support high-stakes applications in drug and material discovery. Recent advances in large language…

Machine Learning · Computer Science 2025-12-10 Jaron Cohen , Alexander G. Hasson , Sara Tanovic

Natural language processing models have emerged that can generate usable software and automate a number of programming tasks with high fidelity. These tools have yet to have an impact on the chemistry community. Yet, our initial testing…

Statistical Mechanics · Physics 2023-01-11 Glen M. Hocky , Andrew D. White

Generative artificial intelligence attracts significant attention, especially with the introduction of large language models. Its capabilities are being exploited to solve various software engineering tasks. Thanks to their ability to…

Software Engineering · Computer Science 2026-02-06 Lukas Radosky , Ivan Polasek

Modeling structure and behavior of software systems plays a crucial role, in various areas of software engineering. As with other software engineering artifacts, software models are subject to evolution. Supporting modelers in evolving…

Software Engineering · Computer Science 2023-12-20 Christof Tinnes , Thomas Fuchß , Uwe Hohenstein , Sven Apel

AI for drug discovery has been a research hotspot in recent years, and SMILES-based language models has been increasingly applied in drug molecular design. However, no work has explored whether and how language models understand the…

Machine Learning · Computer Science 2024-01-17 Xiuyuan Hu , Guoqing Liu , Yang Zhao , Hao Zhang

Text-based representations of chemicals and proteins can be thought of as unstructured languages codified by humans to describe domain-specific knowledge. Advances in natural language processing (NLP) methodologies in the processing of…

Biomolecules · Quantitative Biology 2020-02-17 Hakime Öztürk , Arzucan Özgür , Philippe Schwaller , Teodoro Laino , Elif Ozkirimli

Can we leverage LLMs to model the process of discovering novel language model (LM) architectures? Inspired by real research, we propose a multi-agent LLM approach that simulates the conventional stages of research, from ideation and…

Artificial Intelligence · Computer Science 2025-06-26 Junyan Cheng , Peter Clark , Kyle Richardson

Discovery of novel and promising materials is a critical challenge in the field of chemistry and material science, traditionally approached through methodologies ranging from trial-and-error to machine learning-driven inverse design. Recent…

Machine Learning · Computer Science 2024-12-13 Dong Hyeon Mok , Seoin Back

Generative chemical language models (CLMs) have demonstrated strong capabilities in molecular design, yet their impact in drug discovery remains limited by the absence of reliable reward signals and the lack of interpretability in their…

Machine Learning · Computer Science 2025-07-15 Lu Zhu , Emmanuel Noutahi

We present a perspective on molecular machine learning (ML) in the field of chemical process engineering. Recently, molecular ML has demonstrated great potential in (i) providing highly accurate predictions for properties of pure components…

Chemical Physics · Physics 2025-09-01 Jan G. Rittig , Manuel Dahmen , Martin Grohe , Philippe Schwaller , Alexander Mitsos

With the development of computer-assisted techniques, research communities including biochemistry and deep learning have been devoted into the drug discovery field for over a decade. Various applications of deep learning have drawn great…

Machine Learning · Computer Science 2023-03-07 Wenhao Hu , Yingying Liu , Xuanyu Chen , Wenhao Chai , Hangyue Chen , Hongwei Wang , Gaoang Wang

Molecular property prediction has gained significant attention due to its transformative potential in multiple scientific disciplines. Conventionally, a molecule graph can be represented either as a graph-structured data or a SMILES text.…

Machine Learning · Computer Science 2023-07-17 Chen Qian , Huayi Tang , Zhirui Yang , Hong Liang , Yong Liu

Language models (LMs) are sentence-completion engines trained on massive corpora. LMs have emerged as a significant breakthrough in natural-language processing, providing capabilities that go far beyond sentence completion including…

Artificial Intelligence · Computer Science 2021-10-26 Robert E. Wray , III , James R. Kirk , John E. Laird

Recent advancements in deep learning, particularly large language models (LLMs), made a significant impact on how researchers study microbiome and metagenomics data. Microbial protein and genomic sequences, like natural languages, form a…

Quantitative Methods · Quantitative Biology 2024-09-18 Binghao Yan , Yunbi Nam , Lingyao Li , Rebecca A. Deek , Hongzhe Li , Siyuan Ma

The capabilities of AI for biomedicine span a wide spectrum, from the atomic level, where it solves partial differential equations for quantum systems, to the molecular level, predicting chemical or protein structures, and further extending…

Computation and Language · Computer Science 2024-03-26 Zhenyu Bi , Sajib Acharjee Dip , Daniel Hajialigol , Sindhura Kommu , Hanwen Liu , Meng Lu , Xuan Wang

In this review, we highlight recent developments in the application of machine learning for molecular modeling and simulation. After giving a brief overview of the foundations, components, and workflow of a typical supervised learning…

Data Analysis, Statistics and Probability · Physics 2019-02-21 Mojtaba Haghighatlari , Johannes Hachmann

Large Language Models (LLMs) have seen rapid advancements in recent years, with models like ChatGPT and DeepSeek, showcasing their remarkable capabilities across diverse domains. While substantial research has been conducted on LLMs in…

Machine Learning · Computer Science 2026-03-31 Licheng Zhang , Bach Le , Naveed Akhtar , Siew-Kei Lam , Tuan Ngo