English

Compressed-Domain-Aware Online Video Super-Resolution

Computer Vision and Pattern Recognition 2026-03-10 v1 Artificial Intelligence

Abstract

In bandwidth-limited online video streaming, videos are usually downsampled and compressed. Although recent online video super-resolution (online VSR) approaches achieve promising results, they are still compute-intensive and fall short of real-time processing at higher resolutions, due to complex motion estimation for alignment and redundant processing of consecutive frames. To address these issues, we propose a compressed-domain-aware network (CDA-VSR) for online VSR, which utilizes compressed-domain information, including motion vectors, residual maps, and frame types to balance quality and efficiency. Specifically, we propose a motion-vector-guided deformable alignment module that uses motion vectors for coarse warping and learns only local residual offsets for fine-tuned adjustments, thereby maintaining accuracy while reducing computation. Then, we utilize a residual map gated fusion module to derive spatial weights from residual maps, suppressing mismatched regions and emphasizing reliable details. Further, we design a frame-type-aware reconstruction module for adaptive compute allocation across frame types, balancing accuracy and efficiency. On the REDS4 dataset, our CDA-VSR surpasses the state-of-the-art method TMP, with a maximum PSNR improvement of 0.13 dB while delivering more than double the inference speed. The code will be released at https://github.com/sspBIT/CDA-VSR.

Keywords

Cite

@article{arxiv.2603.07694,
  title  = {Compressed-Domain-Aware Online Video Super-Resolution},
  author = {Yuhang Wang and Hai Li and Shujuan Hou and Zhetao Dong and Xiaoyao Yang},
  journal= {arXiv preprint arXiv:2603.07694},
  year   = {2026}
}

Comments

Accepted to CVPR 2026

R2 v1 2026-07-01T11:09:15.231Z