English

POVQA: Preference-Optimized Video Question Answering with Rationales for Data Efficiency

Computer Vision and Pattern Recognition 2026-04-01 v3 Multimedia

Abstract

Long-video multimodal question answering requires structured reasoning over visual evidence and dialogue, but Large Vision-Language Models (LVLMs) are constrained by context-window and compute limits. We propose POVQA, which compresses each second into a temporally pooled image (1 fps pooled images) to maintain dense temporal coverage under a fixed token budget. We then train Qwen2.5-VL-7B with supervised fine-tuning (SFT) on rationale+answer targets, and optionally apply Direct Preference Optimization (DPO) for preference alignment. We introduce ReasonVQA as a pilot diagnostic dataset with 12 movies and 239 human-annotated QA+rationale triplets for controlled analysis of long-context multimodal reasoning under compression. On ReasonVQA, SFT improves the best pooled-only baseline from 0.212 to 0.550 F1, showing that pooled evidence plus rationale supervision provides the main performance gains in this setting. In zero-shot transfer, POVQA also reaches 64.7\% on TVQA after SFT+DPO. These results are preliminary: ReasonVQA is small, pooling can lose fine-grained temporal order, and DPO effects are not uniformly positive across settings. Code, dataset, and additional qualitative evaluations are available at \href{https://povqa.github.io}{https://povqa.github.io}.

Keywords

Cite

@article{arxiv.2510.01009,
  title  = {POVQA: Preference-Optimized Video Question Answering with Rationales for Data Efficiency},
  author = {Ashim Dahal and Ankit Ghimire and Saydul Akbar Murad and Nick Rahimi},
  journal= {arXiv preprint arXiv:2510.01009},
  year   = {2026}
}

Comments

Accepted in MAR at CVPR Workshop (Proceedings Track)

R2 v1 2026-07-01T06:10:55.945Z