MotionAtlas: Detailed Region Captioning for Motion-Centric Videos
Abstract
We propose MotionAtlas, a system for detailed captioning of motion-centric videos, comprising (1) a dedicated human-annotated benchmark, (2) a scalable, high-quality pipeline to construct training samples, and (3) a family of powerful Video-MLLMs. Unlike conventional global motion captioning datasets, we focus on region-aware motion captioning: given a video and a spatiotemporal mask, the model generates precise descriptions of motion within the target region, thereby alleviating visual clutter and motion entanglement and enabling reliable, quantifiable evaluation. Concretely, we first build MotionAtlas-Bench, a comprehensive benchmark comprising 2,073 multiple-choice questions, meticulously annotated for a curated set of high-quality, motion-centric videos, to evaluate fine-grained motion understanding of the objects in question. Second, we design a rigorous and scalable data pipeline that leverages self-bootstrap refinement to suppress fine-grained hallucinations, yielding 159k high-quality motion captioning data. Third, we design a tailored training data composition strategy, which achieves consistent and substantial performance gains across diverse baseline Video-MLLMs, including Molmo2 and Qwen3-VL. For instance, MotionAtlas-4B surpasses Qwen3-VL-4B by an average of 5.2 percentage points across general motion benchmarks. The benchmark, dataset, and code have been released.
Keywords
Cite
@article{arxiv.2606.29531,
title = {MotionAtlas: Detailed Region Captioning for Motion-Centric Videos},
author = {Weisong Liu and Haochen Wang and Kuan Gao and Yuhao Wang and Yikang Zhou and Zhongwei Ren and Jacky Mai and Anna Wang and Yanwei Li and Jason Li and Zhaoxiang Zhang},
journal= {arXiv preprint arXiv:2606.29531},
year = {2026}
}
Comments
Accepted to ECCV 2026. Project page: https://kagura-0001.github.io/projects/MotionAtlas