English

Em-Garde: A Propose-Match Framework for Proactive Streaming Video Understanding

Computer Vision and Pattern Recognition 2026-03-20 v1 Artificial Intelligence

Abstract

Recent advances in Streaming Video Understanding has enabled a new interaction paradigm where models respond proactively to user queries. Current proactive VideoLLMs rely on per-frame triggering decision making, which suffers from an efficiency-accuracy dilemma. We propose Em-Garde, a novel framework that decouples semantic understanding from streaming perception. At query time, the Instruction-Guided Proposal Parser transforms user queries into structured, perceptually grounded visual proposals; during streaming, a Lightweight Proposal Matching Module performs efficient embedding-based matching to trigger responses. Experiments on StreamingBench and OVO-Bench demonstrate consistent improvements over prior models in proactive response accuracy and efficiency, validating an effective solution for proactive video understanding under strict computational constraints.

Keywords

Cite

@article{arxiv.2603.19054,
  title  = {Em-Garde: A Propose-Match Framework for Proactive Streaming Video Understanding},
  author = {Yikai Zheng and Xin Ding and Yifan Yang and Shiqi Jiang and Hao Wu and Qianxi Zhang and Weijun Wang and Ting Cao and Yunxin Liu},
  journal= {arXiv preprint arXiv:2603.19054},
  year   = {2026}
}
R2 v1 2026-07-01T11:28:24.127Z