English

Extending Neural P-frame Codecs for B-frame Coding

Image and Video Processing 2021-08-06 v2 Computer Vision and Pattern Recognition Machine Learning

Abstract

While most neural video codecs address P-frame coding (predicting each frame from past ones), in this paper we address B-frame compression (predicting frames using both past and future reference frames). Our B-frame solution is based on the existing P-frame methods. As a result, B-frame coding capability can easily be added to an existing neural codec. The basic idea of our B-frame coding method is to interpolate the two reference frames to generate a single reference frame and then use it together with an existing P-frame codec to encode the input B-frame. Our studies show that the interpolated frame is a much better reference for the P-frame codec compared to using the previous frame as is usually done. Our results show that using the proposed method with an existing P-frame codec can lead to 28.5%saving in bit-rate on the UVG dataset compared to the P-frame codec while generating the same video quality.

Keywords

Cite

@article{arxiv.2104.00531,
  title  = {Extending Neural P-frame Codecs for B-frame Coding},
  author = {Reza Pourreza and Taco S Cohen},
  journal= {arXiv preprint arXiv:2104.00531},
  year   = {2021}
}

Comments

ICCV 2021

R2 v1 2026-06-24T00:46:39.493Z