English

Notation-level confounding: When inconsistent molecular notations mislead chemical language models

Quantitative Methods 2026-02-13 v5

Abstract

Chemical language models (CLMs) are increasingly used for molecular design and property prediction. Because these models learn from textual encodings of molecules, differences in how such encodings are generated may affect their behavior. In cheminformatics, the term canonical SMILES implies a single standardized notation, yet different toolkits define distinct canonicalization rules, yielding multiple canonical strings for the same molecule. To examine how this variability arises and why it matters, we surveyed 264 CLM papers in PubMed and found that about half did not specify their canonicalization procedure, limiting transparency and reproducibility. Using a molecular translation framework, we show that when multiple valid notations are mixed or left undocumented, inconsistent notations distort latent representations and, in some benchmarks, can spuriously inflate predictive accuracy, a phenomenon we term notation-level confounding. These findings demonstrate how subtle differences in SMILES generation can mislead CLMs and highlight the importance of explicitly reporting preprocessing tools and settings.

Keywords

Cite

@article{arxiv.2505.07139,
  title  = {Notation-level confounding: When inconsistent molecular notations mislead chemical language models},
  author = {Yosuke Kikuchi and Yasuhiro Yoshikai and Shumpei Nemoto and Ayako Furuhama and Takashi Yamada and Hiroyuki Kusuhara and Tadahaya Mizuno},
  journal= {arXiv preprint arXiv:2505.07139},
  year   = {2026}
}

Comments

11 + 10 pages, 5 + 7 figures, 1 + 4 tables, Tadahaya Mizuno is the correspondent author

R2 v1 2026-06-28T23:28:54.854Z