English

Improved Encoding for Overfitted Video Codecs

Image and Video Processing 2025-03-27 v2

Abstract

Overfitted neural video codecs offer a decoding complexity orders of magnitude smaller than their autoencoder counterparts. Yet, this low complexity comes at the cost of limited compression efficiency, in part due to their difficulty capturing accurate motion information. This paper proposes to guide motion information learning with an optical flow estimator. A joint rate-distortion optimization is also introduced to improve rate distribution across the different frames. These contributions maintain a low decoding complexity of 1300 multiplications per pixel while offering compression performance close to the conventional codec HEVC and outperforming other overfitted codecs. This work is made open-source at https://orange-opensource.github.io/Cool-Chic/

Keywords

Cite

@article{arxiv.2501.16976,
  title  = {Improved Encoding for Overfitted Video Codecs},
  author = {Thomas Leguay and Théo Ladune and Pierrick Philippe and Olivier Deforges},
  journal= {arXiv preprint arXiv:2501.16976},
  year   = {2025}
}