English

Continuous Perception Matters: Diagnosing Temporal Integration Failures in Multimodal Models

Computer Vision and Pattern Recognition 2025-12-02 v2

Abstract

Continuous perception, the ability to integrate visual observations over time in a continuous stream fashion, is essential for robust real-world understanding, yet remains largely untested in current multimodal models. We introduce CP-Bench, a minimal and fully controlled benchmark designed to isolate this capability using an extremely simple task: counting identical cubes in a synthetic scene while the camera moves and only reveals subsets of objects at any moment. Despite the simplicity of the setting, we find that state-of-the-art open-source and commercial models, including Qwen-3-VL, InternVL3, GPT-5, and Gemini-3-Pro, fail dramatically. A static-camera control variant confirms that the failure arises not from object recognition but from an inability to accumulate evidence across time. Further experiments show that neither higher sampling FPS, perception- or spatial-enhanced models, nor finetuning with additional videos leads to meaningful cross-temporal generalization. Our results reveal a fundamental limitation in modern multimodal architectures and training paradigms. CP-Bench provides a simple yet powerful diagnostic tool and establishes a clean testbed for developing models capable of genuine time-consistent visual reasoning.

Keywords

Cite

@article{arxiv.2408.07867,
  title  = {Continuous Perception Matters: Diagnosing Temporal Integration Failures in Multimodal Models},
  author = {Zeyu Wang and Zhenzhen Weng and Serena Yeung-Levy},
  journal= {arXiv preprint arXiv:2408.07867},
  year   = {2025}
}
R2 v1 2026-06-28T18:13:19.989Z