English

Improving Molecular Property Prediction in Small Language Models Using Graph-based Tools

Artificial Intelligence 2026-07-14 v1 Machine Learning

Abstract

Small language models (SLMs) have shown promise for zero-shot molecular property prediction from SMILES strings, yet they often suffer from structural blindness because sequence representations under-specify key graph-topological cues. We propose a modular Context-Augmented Prompting framework that enables agentic tool use at inference time: a trained GNN expert model provides a predictive hint with confidence, and a GNN extracts an instance-specific explanatory subgraph (e.g., a subgraph SMILES and an accompanying explanatory paragraph). We evaluate three commonly used SLMs on MUTAG and Tox21 under five prompting configurations ranging from SMILES-only to using all available tools at hand. Across two datasets, enriching prompts with graph-derived context yields substantial accuracy gains, often exceeding 25% relative improvement and up to 74% on Tox21. We further validate the functional relevance of the extracted motifs via a necessity-based edge-drop intervention. Despite the observed gains, a persistent gap remains to specialized GNN models, highlighting both the value and limits of text-conditioned reasoning for molecular structure.

Cite

@article{arxiv.2607.13115,
  title  = {Improving Molecular Property Prediction in Small Language Models Using Graph-based Tools},
  author = {Konstantinos Bougiatiotis and Dimitrios Kelesis and Georgios Paliouras},
  journal= {arXiv preprint arXiv:2607.13115},
  year   = {2026}
}

Comments

Presented at the 2nd Causal Neuro-symbolic Artificial Intelligence (Causal NeSy): Toward Agentic LLMs with Neuro-Symbolic and Graph Based Reasoning Workshop @ ESWC2026