English

Vision-G1: Towards General Vision Language Reasoning with Multi-Domain Data Curation

Computer Vision and Pattern Recognition 2025-08-19 v1 Computation and Language

Abstract

Despite their success, current training pipelines for reasoning VLMs focus on a limited range of tasks, such as mathematical and logical reasoning. As a result, these models face difficulties in generalizing their reasoning capabilities to a wide range of domains, primarily due to the scarcity of readily available and verifiable reward data beyond these narrowly defined areas. Moreover, integrating data from multiple domains is challenging, as the compatibility between domain-specific datasets remains uncertain. To address these limitations, we build a comprehensive RL-ready visual reasoning dataset from 46 data sources across 8 dimensions, covering a wide range of tasks such as infographic, mathematical, spatial, cross-image, graphic user interface, medical, common sense and general science. We propose an influence function based data selection and difficulty based filtering strategy to identify high-quality training samples from this dataset. Subsequently, we train the VLM, referred to as Vision-G1, using multi-round RL with a data curriculum to iteratively improve its visual reasoning capabilities. Our model achieves state-of-the-art performance across various visual reasoning benchmarks, outperforming similar-sized VLMs and even proprietary models like GPT-4o and Gemini-1.5 Flash. The model, code and dataset are publicly available at https://github.com/yuh-zha/Vision-G1.

Keywords

Cite

@article{arxiv.2508.12680,
  title  = {Vision-G1: Towards General Vision Language Reasoning with Multi-Domain Data Curation},
  author = {Yuheng Zha and Kun Zhou and Yujia Wu and Yushu Wang and Jie Feng and Zhi Xu and Shibo Hao and Zhengzhong Liu and Eric P. Xing and Zhiting Hu},
  journal= {arXiv preprint arXiv:2508.12680},
  year   = {2025}
}
R2 v1 2026-07-01T04:54:20.794Z