English

Innovator-VL: A Multimodal Large Language Model for Scientific Discovery

Computer Vision and Pattern Recognition 2026-01-28 v1 Artificial Intelligence

Abstract

We present Innovator-VL, a scientific multimodal large language model designed to advance understanding and reasoning across diverse scientific domains while maintaining excellent performance on general vision tasks. Contrary to the trend of relying on massive domain-specific pretraining and opaque pipelines, our work demonstrates that principled training design and transparent methodology can yield strong scientific intelligence with substantially reduced data requirements. (i) First, we provide a fully transparent, end-to-end reproducible training pipeline, covering data collection, cleaning, preprocessing, supervised fine-tuning, reinforcement learning, and evaluation, along with detailed optimization recipes. This facilitates systematic extension by the community. (ii) Second, Innovator-VL exhibits remarkable data efficiency, achieving competitive performance on various scientific tasks using fewer than five million curated samples without large-scale pretraining. These results highlight that effective reasoning can be achieved through principled data selection rather than indiscriminate scaling. (iii) Third, Innovator-VL demonstrates strong generalization, achieving competitive performance on general vision, multimodal reasoning, and scientific benchmarks. This indicates that scientific alignment can be integrated into a unified model without compromising general-purpose capabilities. Our practices suggest that efficient, reproducible, and high-performing scientific multimodal models can be built even without large-scale data, providing a practical foundation for future research.

Keywords

Cite

@article{arxiv.2601.19325,
  title  = {Innovator-VL: A Multimodal Large Language Model for Scientific Discovery},
  author = {Zichen Wen and Boxue Yang and Shuang Chen and Yaojie Zhang and Yuhang Han and Junlong Ke and Cong Wang and Yicheng Fu and Jiawang Zhao and Jiangchao Yao and Xi Fang and Zhen Wang and Henxing Cai and Lin Yao and Zhifeng Gao and Yanhui Hong and Nang Yuan and Yixuan Li and Guojiang Zhao and Haoyi Tao and Nan Wang and Han Lyu and Guolin Ke and Ning Liao and Xiaoxing Wang and Kai Chen and Zhiyu Li and Feiyu Xiong and Sihan Hu and Kun Chen and Yanfeng Wang and Weinan E and Linfeng Zhang and Linfeng Zhang},
  journal= {arXiv preprint arXiv:2601.19325},
  year   = {2026}
}

Comments

Innovator-VL tech report

R2 v1 2026-07-01T09:21:50.697Z