English

MolSight: Molecular Property Prediction with Images

Computer Vision and Pattern Recognition 2026-05-12 v1 Computation and Language

Abstract

Every molecule ever synthesised can be drawn as a 2D skeletal diagram, yet in modern property prediction this universally available representation has received less focus in favour of molecular graphs, 3D conformers, or billion-parameter language models, each imposing its own computational and data-engineering overhead. We present MolSight\textbf{MolSight}, the first systematic large-scale study of vision-based Molecular Property Prediction (MPP). Using 10 vision architectures, 7 pre-training strategies, and 2M2\,M molecule images, we evaluate performance across 10 downstream tasks spanning physical-property regression, drug-discovery classification, and quantum-chemistry prediction. To account for the wide variation in structural complexity across pre-training molecules, we further propose a chemistry-informed curriculum\textbf{chemistry-informed curriculum}: five structural complexity descriptors partition the corpus into five tiers of increasing chemical difficulty, consistently outperforming non-curriculum baselines. We show that a single rendered bond-line image, processed by a vision encoder, is sufficient for competitive molecular property prediction, i.e. chemical insight from sight alone\textit{chemical insight from sight alone}. The best curriculum-trained configuration achieves the top result on 5 of 10\textbf{5 of 10} benchmarks and top two on all 10\textbf{all 10}, at \textbf{\textit{80×\times lower}} FLOPs than the nearest multi-modal competitor.

Keywords

Cite

@article{arxiv.2605.10157,
  title  = {MolSight: Molecular Property Prediction with Images},
  author = {Aaditya Baranwal and Akshaj Gupta and Shruti Vyas and Yogesh S Rawat},
  journal= {arXiv preprint arXiv:2605.10157},
  year   = {2026}
}