English

JSynFlow: Japanese Synthesised Flowchart Visual Question Answering Dataset built with Large Language Models

Computer Vision and Pattern Recognition 2026-02-06 v2 Artificial Intelligence

Abstract

Vision and language models (VLMs) are expected to analyse complex documents, such as those containing flowcharts, through a question-answering (QA) interface. The ability to recognise and interpret these flowcharts is in high demand, as they provide valuable insights unavailable in text-only explanations. However, developing VLMs with precise flowchart understanding requires large-scale datasets of flowchart images and corresponding text, the creation of which is highly time-consuming. To address this challenge, we introduce JSynFlow, a synthesised visual QA dataset for Japanese flowcharts, generated using large language models (LLMs). Our dataset comprises task descriptions for various business occupations, the corresponding flowchart images rendered from domain-specific language (DSL) code, and related QA pairs. This paper details the dataset's synthesis procedure and demonstrates that fine-tuning with JSynFlow significantly improves VLM performance on flowchart-based QA tasks. Our dataset is publicly available at https://huggingface.co/datasets/jri-advtechlab/jsynflow.

Keywords

Cite

@article{arxiv.2602.04142,
  title  = {JSynFlow: Japanese Synthesised Flowchart Visual Question Answering Dataset built with Large Language Models},
  author = {Hiroshi Sasaki},
  journal= {arXiv preprint arXiv:2602.04142},
  year   = {2026}
}

Comments

7 pages, 1 figure

R2 v1 2026-07-01T09:35:16.299Z