English
Related papers

Related papers: Teaching Language Models Mechanistic Explainabilit…

200 papers

Language-guided human motion synthesis has been a challenging task due to the inherent complexity and diversity of human behaviors. Previous methods face limitations in generalization to novel actions, often resulting in unrealistic or…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Yuanhao Zhai , Mingzhen Huang , Tianyu Luan , Lu Dong , Ifeoma Nwogu , Siwei Lyu , David Doermann , Junsong Yuan

Reaction systems are a formal model that has been introduced to investigate the interactive behaviors of biochemical reactions. Based on the formal framework of reaction systems, we propose new computing models called reaction automata that…

Formal Languages and Automata Theory · Computer Science 2011-11-29 Fumiya Okubo , Satoshi Kobayashi , Takashi Yokomori

We seek to automate the design of molecules based on specific chemical properties. Our primary contributions are a simpler method for generating SMILES strings guaranteed to be chemically valid, using a combination of a new context-free…

Machine Learning · Computer Science 2018-11-29 Egor Kraev

Deep learning models for anticipating the products of organic reactions have found many use cases, including validating retrosynthetic pathways and constraining synthesis-based molecular design tools. Despite compelling performance on…

Machine Learning · Computer Science 2025-01-14 John Bradshaw , Anji Zhang , Babak Mahjour , David E. Graff , Marwin H. S. Segler , Connor W. Coley

In drug-discovery-related tasks such as virtual screening, machine learning is emerging as a promising way to predict molecular properties. Conventionally, molecular fingerprints (numerical representations of molecules) are calculated…

Machine Learning · Computer Science 2019-11-13 Shion Honda , Shoi Shi , Hiroki R. Ueda

The success of language models, especially transformer-based architectures, has trickled into other domains giving rise to "scientific language models" that operate on small molecules, proteins or polymers. In chemistry, language models…

Chemical Physics · Physics 2024-10-22 Nikita Janakarajan , Tim Erdmann , Sarath Swaminathan , Teodoro Laino , Jannis Born

Machine learning accelerates molecular property prediction, yet state-of-the-art Large Language Models and Graph Neural Networks operate as black boxes. In drug discovery, where safety is critical, this opacity risks masking false…

Machine Learning · Computer Science 2026-03-03 Oscar Rivera , Ziqing Wang , Matthieu Dagommer , Abhishek Pandey , Kaize Ding

While showing impressive performance on various kinds of learning tasks, it is yet unclear whether deep learning models have the ability to robustly tackle reasoning tasks. than by learning the underlying reasoning process that is actually…

Machine Learning · Computer Science 2022-10-06 Andrea Valenti , Davide Bacciu , Antonio Vergari

Given a natural language instruction and an input scene, our goal is to train a model to output a manipulation program that can be executed by the robot. Prior approaches for this task possess one of the following limitations: (i) rely on…

Large Language Models can develop reasoning capabilities through online fine-tuning with rule-based rewards. However, recent studies reveal a critical constraint: reinforcement learning succeeds only when the base model already assigns…

Artificial intelligence is reshaping scientific exploration, but most methods automate procedural tasks without engaging in scientific reasoning, limiting autonomy in discovery. We introduce Materials Agents for Simulation and Theory in…

Chemical toxicity prediction using machine learning is important in drug development to reduce repeated animal and human testing, thus saving cost and time. It is highly recommended that the predictions of computational toxicology models…

Quantitative Methods · Quantitative Biology 2020-09-28 Kar Wai Lim , Bhanushee Sharma , Payel Das , Vijil Chenthamarakshan , Jonathan S. Dordick

Mathematical reasoning in large language models (LMs) has garnered significant attention in recent work, but there is a limited understanding of how these models process and store information related to arithmetic tasks within their…

Computation and Language · Computer Science 2023-10-23 Alessandro Stolfo , Yonatan Belinkov , Mrinmaya Sachan

We discover a robust self-supervised strategy tailored towards molecular representations for generative masked language models through a series of tailored, in-depth ablations. Using this pre-training strategy, we train BARTSmiles, a…

We use prompt engineering to guide ChatGPT in the automation of text mining of metal-organic frameworks (MOFs) synthesis conditions from diverse formats and styles of the scientific literature. This effectively mitigates ChatGPT's tendency…

Information Retrieval · Computer Science 2023-10-04 Zhiling Zheng , Oufan Zhang , Christian Borgs , Jennifer T. Chayes , Omar M. Yaghi

Computational studies of chemical reactions in complex environments such as proteins, nanostructures, or on surfaces require accurate and efficient atomistic models applicable to the nanometer scale. In general, an accurate parametrization…

Chemical Physics · Physics 2020-02-18 Christoph Brunken , Markus Reiher

Providing explainable molecular property predictions is critical for many scientific domains, such as drug discovery and material science. Though transformer-based language models have shown great potential in accurate molecular property…

Machine Learning · Computer Science 2026-01-14 Zhenzhong Wang , Zehui Lin , Wanyu Lin , Ming Yang , Minggang Zeng , Kay Chen Tan

Catalytic nanoparticles restructure dynamically under reaction conditions, so their working morphology and activity are governed by temperature, pressure, and gas composition. However, converting experimentally specified environments into…

Materials Science · Physics 2026-05-26 Sanyang Ye , Rui Qi , Beien Zhu , Yi Gao

Multimodal Large Language Models (MLLMs) excel at recognizing individual visual elements and reasoning over simple linear diagrams. However, when faced with complex topological structures involving branching paths, converging flows, and…

Artificial Intelligence · Computer Science 2026-04-24 Qiang Xu , Shengyuan Bai , Yu Wang , He Cao , Leqing Chen , Yuanyuan Liu , Bin Feng , Zijing Liu , Yu Li

While Large Language Models (LLMs) have revolutionized scientific text processing, they exhibit a significant capability gap when interpreting chemical reaction diagrams. We identify two fundamental bottlenecks restricting current systems:…

Artificial Intelligence · Computer Science 2026-05-19 Mingyang Rao , Kehua Feng , Zhihui Zhu , Jiangzhen Fu , Hao Yu , Keyan Ding , Huajun Chen