English
Related papers

Related papers: Training a Scientific Reasoning Model for Chemistr…

200 papers

The ability to reason beyond established knowledge allows Organic Chemists to solve synthetic problems and to invent novel transformations. Here, we propose a model which mimics chemical reasoning and formalises reaction prediction as…

Artificial Intelligence · Computer Science 2017-12-27 Marwin H. S. Segler , Mark P. Waller

Chain of thought prompting successfully improves the reasoning capabilities of large language models, achieving state of the art results on a range of datasets. However, these reasoning capabilities only appear to emerge in models with a…

Computation and Language · Computer Science 2023-06-02 Lucie Charlotte Magister , Jonathan Mallinson , Jakub Adamek , Eric Malmi , Aliaksei Severyn

We present MiMo-7B, a large language model born for reasoning tasks, with optimization across both pre-training and post-training stages. During pre-training, we enhance the data preprocessing pipeline and employ a three-stage data mixing…

Current benchmarks for evaluating the chemical reasoning capabilities of Large Language Models (LLMs) are limited by oversimplified tasks, lack of process-level evaluation, and misalignment with expert-level chemistry skills. To address…

The capabilities and limitations of Large Language Models have been sketched out in great detail in recent years, providing an intriguing yet conflicting picture. On the one hand, LLMs demonstrate a general ability to solve problems. On the…

While automated chemical tools excel at specific tasks, they have struggled to capture the strategic thinking that characterizes expert chemical reasoning. Here we demonstrate that large language models (LLMs) can serve as powerful tools…

Artificial Intelligence · Computer Science 2025-07-25 Andres M Bran , Theo A Neukomm , Daniel P Armstrong , Zlatko Jončev , Philippe Schwaller

Advancements in artificial intelligence for molecular science are necessitating a paradigm shift from purely data-driven predictions to knowledge-guided computational reasoning. Existing molecular models are predominantly proprietary,…

Machine Learning · Computer Science 2026-03-16 Pengfei Liu , Shuang Ge , Jun Tao , Zhixiang Ren

Reasoning is a key component of language understanding in Large Language Models. While Chain-of-Thought prompting enhances performance via explicit intermediate steps, it suffers from sufficient token overhead and a fixed reasoning…

Computation and Language · Computer Science 2025-11-18 Xinyuan Wang , Dongjie Wang , Wangyang Ying , Haoyue Bai , Nanxu Gong , Sixun Dong , Kunpeng Liu , Yanjie Fu

In recent years, large pre-trained language models (LLMs) have demonstrated the ability to follow instructions and perform novel tasks from a few examples. The possibility to parameterise an LLM through such in-context examples widens their…

Machine Learning · Computer Science 2023-05-10 Imanol Schlag , Sainbayar Sukhbaatar , Asli Celikyilmaz , Wen-tau Yih , Jason Weston , Jürgen Schmidhuber , Xian Li

Enhancing reasoning capabilities remains a central focus in the LLM reasearch community. A promising direction involves requiring models to simulate code execution step-by-step to derive outputs for given inputs. However, as code is often…

Computation and Language · Computer Science 2025-07-15 Keqin Bao , Nuo Chen , Xiaoyuan Li , Binyuan Hui , Bowen Yu , Fuli Feng , Xiangnan He , Dayiheng Liu

Predicting enzymatic reactions is crucial for applications in biocatalysis, metabolic engineering, and drug discovery, yet it remains a complex and resource-intensive task. Large Language Models (LLMs) have recently demonstrated remarkable…

Artificial Intelligence · Computer Science 2025-05-12 Lorenzo Di Fruscia , Jana Marie Weber

Reasoning is a fundamental aspect of human intelligence that plays a crucial role in activities such as problem solving, decision making, and critical thinking. In recent years, large language models (LLMs) have made significant progress in…

Computation and Language · Computer Science 2023-05-29 Jie Huang , Kevin Chen-Chuan Chang

Chain of thought finetuning (cot-finetuning) aims to endow small language models (SLM) with reasoning ability to improve their performance towards specific tasks by allowing them to imitate the reasoning procedure of large language models…

Computation and Language · Computer Science 2025-08-08 Xiaoshu Chen , Sihang Zhou , Ke Liang , Xinwang Liu

While Vision-Language Models (VLMs) have demonstrated significant potential in chemical visual understanding, current models are predominantly optimized for direct visual question-answering tasks. This paradigm often results in "black-box"…

Computation and Language · Computer Science 2026-04-09 Xuanle Zhao , Xinyuan Cai , Xiang Cheng , Xiuyi Chen , Bo Xu

Large language models (LLMs) are beginning to reshape how chemists plan and run reactions in organic synthesis. Trained on millions of reported transformations, these text-based models can propose synthetic routes, forecast reaction…

Artificial Intelligence · Computer Science 2025-08-08 Kartar Kumar Lohana Tharwani , Rajesh Kumar , Sumita , Numan Ahmed , Yong Tang

While large language models (LLMs) with Chain-of-Thought (CoT) reasoning excel in mathematics and coding, their potential for systematic reasoning in chemistry, a domain demanding rigorous structural analysis for real-world tasks like drug…

Artificial Intelligence · Computer Science 2026-01-08 Hao Li , He Cao , Bin Feng , Yanjun Shao , Xiangru Tang , Zhiyuan Yan , Li Yuan , Yonghong Tian , Yu Li

Large reasoning models (LRMs) tackle complex reasoning problems by following long chain-of-thoughts (Long CoT) that incorporate reflection, backtracking, and self-validation. However, the training techniques and data requirements to elicit…

In the field of chemical engineering, traditional data-processing and prediction methods face significant challenges. Machine-learning and large-language models (LLMs) also have their respective limitations. This paper explores the…

Machine Learning · Computer Science 2025-02-19 Tianhang Zhou , Yingchun Niu , Xingying Lan , Chunming Xu

The recent trend towards utilisation of reasoning models has improved the performance of Large Language Models (LLMs) across many tasks which involve logical steps. One linguistic task that could benefit from this framing is idiomaticity…

Computation and Language · Computer Science 2025-08-20 Dylan Phelps , Rodrigo Wilkens , Edward Gow-Smith , Thomas Pickard , Maggie Mi , Aline Villavicencio

Large Language Models (LLMs) have shown remarkable performance in various natural language processing tasks but face challenges in mathematical reasoning, where complex problem-solving requires both linguistic understanding and mathematical…

Computation and Language · Computer Science 2025-03-20 Shuguang Chen , Guang Lin