English
Related papers

Related papers: Teaching Language Models Mechanistic Explainabilit…

200 papers

Multimodal scientific reasoning remains a significant challenge for large language models (LLMs), particularly in chemistry, where problem-solving relies on symbolic diagrams, molecular structures, and structured visual data. Here, we…

Computation and Language · Computer Science 2025-12-18 Yiming Cui , Xin Yao , Yuxuan Qin , Xin Li , Shijin Wang , Guoping Hu

Machine-learning potentials (MLPs) for atomistic simulations are a promising alternative to conventional classical potentials. Current approaches rely on descriptors of the local atomic environment with dimensions that increase…

Materials Science · Physics 2017-12-05 Nongnuch Artrith , Alexander Urban , Gerbrand Ceder

Advances in machine reading comprehension (MRC) rely heavily on the collection of large scale human-annotated examples in the form of (question, paragraph, answer) triples. In contrast, humans are typically able to generalize with only a…

Computation and Language · Computer Science 2020-10-15 Qinyuan Ye , Xiao Huang , Elizabeth Boschee , Xiang Ren

A central concern of molecular dynamics simulations are the potential energy surfaces that govern atomic interactions. These hypersurfaces define the potential energy of the system, and have generally been calculated using either predefined…

Computational Physics · Physics 2019-07-05 Emir Kocer , Jeremy K. Mason , Hakan Erturk

Mechanistic interpretability aims to explain neural model behaviour by reverse-engineering learned computational structure into human-understandable components. Without a formal framework, however, mechanistic explanations cannot be…

Machine Learning · Computer Science 2026-05-12 Ward Gauderis , Thomas Dooms , Steven T. Holmer , Kola Ayonrinde , Geraint A. Wiggins

Mechanistic interpretability seeks to understand the neural mechanisms that enable specific behaviors in Large Language Models (LLMs) by leveraging causality-based methods. While these approaches have identified neural circuits that copy…

Computation and Language · Computer Science 2023-08-29 Vedant Palit , Rohan Pandey , Aryaman Arora , Paul Pu Liang

Large-scale pre-training methodologies for chemical language models represent a breakthrough in cheminformatics. These methods excel in tasks such as property prediction and molecule generation by learning contextualized representations of…

Machine Learning · Computer Science 2025-07-18 Eduardo Soares , Victor Shirasuna , Emilio Vital Brazil , Renato Cerqueira , Dmitry Zubarev , Kristin Schmidt

Retrosynthesis planning, essential in organic synthesis and drug discovery, has greatly benefited from recent AI-driven advancements. Nevertheless, existing methods frequently face limitations in both applicability and explainability.…

Computational Engineering, Finance, and Science · Computer Science 2025-07-24 Situo Zhang , Hanqi Li , Lu Chen , Zihan Zhao , Xuanze Lin , Zichen Zhu , Bo Chen , Xin Chen , Kai Yu

Chemical databases store information in text representations, and the SMILES format is a universal standard used in many cheminformatics software. Encoded in each SMILES string is structural information that can be used to predict complex…

Machine Learning · Statistics 2018-08-16 Garrett B. Goh , Nathan O. Hodas , Charles Siegel , Abhinav Vishnu

Continual Learning trains models on a stream of data, with the aim of learning new information without forgetting previous knowledge. Given the dynamic nature of such environments, explaining the predictions of these models can be…

Machine Learning · Computer Science 2023-06-21 Andrea Cossu , Francesco Spinnato , Riccardo Guidotti , Davide Bacciu

Modern machine learning models are opaque, and as a result there is a burgeoning academic subfield on methods that explain these models' behavior. However, what is the precise goal of providing such explanations, and how can we demonstrate…

Machine Learning · Computer Science 2022-12-01 Patrick Fernandes , Marcos Treviso , Danish Pruthi , André F. T. Martins , Graham Neubig

Chemical reaction networks (CRNs) formally model chemistry in a well-mixed solution. CRNs are widely used to describe information processing occurring in natural cellular regulatory networks, and with upcoming advances in synthetic biology,…

Computational Complexity · Computer Science 2013-04-17 David Doty

Chemical kinetic mechanisms can be represented by sets of elementary reactions that are easily translated into mathematical terms using physicochemical relationships. The schematic representation of reactions captures the interactions…

Optimization and Control · Mathematics 2019-02-12 Farshad Harirchi , Doohyun Kim , Omar A. Khalil , Sijia Liu , Paolo Elvati , Angela Violi , Alfred O. Hero

Robotic systems are more present in our society everyday. In human-robot environments, it is crucial that end-users may correctly understand their robotic team-partners, in order to collaboratively complete a task. To increase action…

Artificial Intelligence · Computer Science 2021-09-03 Francisco Cruz , Richard Dazeley , Peter Vamplew , Ithan Moreira

Organic reaction, the foundation of modern chemical industry, is crucial for new material development and drug discovery. However, deciphering reaction mechanisms and modeling multi-molecular relationships remain formidable challenges due…

Chemical Physics · Physics 2025-08-13 Lirong Wu , Junjie Wang , Zhifeng Gao , Xiaohong Ji , Rong Zhu , Xinyu Li , Linfeng Zhang , Guolin Ke , Weinan E

Identifying the chemical structure from a graphical representation, or image, of a molecule is a challenging pattern recognition task that would greatly benefit drug development. Yet, existing methods for chemical structure recognition do…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Martijn Oldenhof , Edward De Brouwer , Adam Arany , Yves Moreau

The main target of retrosynthesis is to recursively decompose desired molecules into available building blocks. Existing template-based retrosynthesis methods follow a template selection stereotype and suffer from limited training…

Chemical Physics · Physics 2022-12-26 Chaochao Yan , Peilin Zhao , Chan Lu , Yang Yu , Junzhou Huang

Reaction automata are a formal model that has been introduced to investigate the computing powers of interactive behaviors of biochemical reactions([14]). Reaction automata are language acceptors with multiset rewriting mechanism whose…

Formal Languages and Automata Theory · Computer Science 2012-01-17 Fumiya Okubo , Satoshi Kobayashi , Takashi Yokomori

Despite their ability to understand chemical knowledge, large language models (LLMs) remain limited in their capacity to propose novel molecules with desired functions (e.g., drug-like properties). In addition, the molecules that LLMs…

Developing accurate models for chemical reactors is often challenging due to the complexity of reaction kinetics and process dynamics. Traditional approaches require retraining models for each new system, limiting generalizability and…

Computational Engineering, Finance, and Science · Computer Science 2025-05-29 Zihao Wang , Zhe Wu