English

Video Compression with Hierarchical Temporal Neural Representation

Computer Vision and Pattern Recognition 2026-01-27 v1

Abstract

Video compression has recently benefited from implicit neural representations (INRs), which model videos as continuous functions. INRs offer compact storage and flexible reconstruction, providing a promising alternative to traditional codecs. However, most existing INR-based methods treat the temporal dimension as an independent input, limiting their ability to capture complex temporal dependencies. To address this, we propose a Hierarchical Temporal Neural Representation for Videos, TeNeRV. TeNeRV integrates short- and long-term dependencies through two key components. First, an Inter-Frame Feature Fusion (IFF) module aggregates features from adjacent frames, enforcing local temporal coherence and capturing fine-grained motion. Second, a GoP-Adaptive Modulation (GAM) mechanism partitions videos into Groups-of-Pictures and learns group-specific priors. The mechanism modulates network parameters, enabling adaptive representations across different GoPs. Extensive experiments demonstrate that TeNeRV consistently outperforms existing INR-based methods in rate-distortion performance, validating the effectiveness of our proposed approach.

Keywords

Cite

@article{arxiv.2601.17743,
  title  = {Video Compression with Hierarchical Temporal Neural Representation},
  author = {Jun Zhu and Xinfeng Zhang and Lv Tang and Junhao Jiang and Gai Zhang and Jia Wang},
  journal= {arXiv preprint arXiv:2601.17743},
  year   = {2026}
}
R2 v1 2026-07-01T09:19:01.269Z