English

CREST: Curvature-Regulated Event-Centric Sampling for Efficient Long-Video Understanding

Computer Vision and Pattern Recognition 2026-05-26 v2

Abstract

Selecting informative frames from long videos is a combinatorial problem that existing methods address either through efficient heuristics without explicit modeling of query-conditioned temporal structure, or through multi stage retrieval pipelines with substantial preprocessing cost. We propose \textbf{CREST}, a training-free frame selection method grounded in the temporal geometry of query--frame relevance. CREST is based on the observation that relevance over time exhibits structured local variation: sharp curvature around salient events and flatter regions in redundant segments. By using local curvature to guide selection, CREST allocates a fixed frame budget more effectively across brief decisive events and slowly evolving evidence. Under a fixed backbone and frame budget, CREST achieves higher accuracy than AKS, a lightweight relevance--coverage baseline, on LongVideoBench and VideoMME, while retaining 93--95\% of the accuracy of MIRA, a stronger multi-stage retrieval pipeline, at only 3--4\% of its preprocessing cost.\footnote{Code and implementation details are included in the supplementary material and will be released publicly upon acceptance.} On TempRel, our diagnostic benchmark for temporal frame selection, CREST achieves a 6.88\% relative improvement over AKS. Pairwise LLM-as-a-judge evaluation further shows that CREST-selected frames yield more coherent frame-conditioned descriptions, with win rates of 60.58\% and 54.50\% on the two benchmarks. These results show that local temporal geometry provides a simple and efficient basis for long-video frame selection.

Keywords

Cite

@article{arxiv.2605.09223,
  title  = {CREST: Curvature-Regulated Event-Centric Sampling for Efficient Long-Video Understanding},
  author = {Mehrajul Abadin Miraj and Abdul Mohaimen Al Radi and Shariful Islam Rayhan and Md. Tanvir Alam and Ismat Rahman and Yu Tian and Md Mosaddek Khan},
  journal= {arXiv preprint arXiv:2605.09223},
  year   = {2026}
}
R2 v1 2026-07-01T13:00:59.320Z