English

Meaning over Motion: A Semantic-First Approach to 360{\deg} Viewport Prediction

Multimedia 2026-01-12 v1

Abstract

Ultra-high-resolution 360-degree video streaming is severely constrained by the massive bandwidth required to deliver immersive experiences. Current viewport prediction techniques predominately rely on kinematics or low-level visual saliency, treating users as passive physical objects governed by inertia. This theoretical limitation leads to the "Saccade Trap" -- a critical failure mode where predictors fail to anticipate rapid, meaning-driven shifts in attention, causing rebuffering stalls exactly when user engagement is highest. To resolve this, we propose Semantically-Adaptive Conformal Tiling with Associative Lookahead, a novel framework that integrates cognitive intent into network control. Unlike "one-size-fits-all" approaches, our method utilizes an architectural inversion strategy: heavy semantic reasoning is offloaded to the server to generate lightweight association graphs, which guide a low-latency client-side controller. We construct a personalized Multi-Modal Prediction Set that dynamically tightens safety margins during stable fixation to maximize efficiency, while simultaneously pre-fetching non-adjacent tiles containing semantically linked objects (Associative Lookahead). This mechanism effectively converts the "calm" of fixation into a preparation phase for the next interaction. Trace-driven evaluation on the 360-AV-HM dataset demonstrates that this approach successfully mitigates the Saccade Trap, reducing stall duration by \ge 20% and lowering effective bandwidth consumption by \ge 18% compared to state-of-the-art trajectory-based baselines.

Keywords

Cite

@article{arxiv.2601.05416,
  title  = {Meaning over Motion: A Semantic-First Approach to 360{\deg} Viewport Prediction},
  author = {Arman Nik Khah and Arvin Bahreini and Ravi Prakash},
  journal= {arXiv preprint arXiv:2601.05416},
  year   = {2026}
}

Comments

10 pages, 5 figures