English
Related papers

Related papers: Improved Encoding for Overfitted Video Codecs

200 papers

Video captioning is an advanced multi-modal task which aims to describe a video clip using a natural language sentence. The encoder-decoder framework is the most popular paradigm for this task in recent years. However, there exist some…

Computer Vision and Pattern Recognition · Computer Science 2021-02-15 Haoran Chen , Jianmin Li , Xiaolin Hu

Conventional video compression approaches use the predictive coding architecture and encode the corresponding motion information and residual information. In this paper, taking advantage of both classical architecture in the conventional…

Image and Video Processing · Electrical Eng. & Systems 2019-04-09 Guo Lu , Wanli Ouyang , Dong Xu , Xiaoyun Zhang , Chunlei Cai , Zhiyong Gao

A main goal in developing video-compression algorithms is to enhance human-perceived visual quality while maintaining file size. But modern video-analysis efforts such as detection and recognition, which are integral to video surveillance…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Mikhail Dremin , Konstantin Kozhemyakov , Ivan Molodetskikh , Malakhov Kirill , Artur Sagitov , Dmitriy Vatolin

Well-trained generative neural networks (GNN) are very efficient at compressing visual information for static images in their learned parameters but not as efficient as inter- and intra-prediction for most video content. However, for…

Image and Video Processing · Electrical Eng. & Systems 2020-10-07 Jonah Probell

In video compression, coding efficiency is improved by reusing pixels from previously decoded frames via motion and residual compensation. We define two levels of hierarchical redundancy in video frames: 1) first-order: redundancy in pixel…

Image and Video Processing · Electrical Eng. & Systems 2022-09-21 Reza Pourreza , Hoang Le , Amir Said , Guillaume Sautiere , Auke Wiggers

Stereoscopic video conferencing is still challenging due to the need to compress stereo RGB-D video in real-time. Though hardware implementations of standard video codecs such as H.264 / AVC and HEVC are widely available, they are not…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Yueyu Hu , Onur G. Guleryuz , Philip A. Chou , Danhang Tang , Jonathan Taylor , Rus Maxham , Yao Wang

The integration of advanced video codecs into the streaming pipeline is growing in response to the increasing demand for high quality video content. However, the significant computational demand for advanced codecs like Versatile Video…

Multimedia · Computer Science 2023-12-14 Yiqun Liu , Hadi Amirpour , Mohsen Abdoli , Christian Timmerer , Thomas Guionnet

While learned video codecs have demonstrated great promise, they have yet to achieve sufficient efficiency for practical deployment. In this work, we propose several novel ideas for learned video compression which allow for improved…

Image and Video Processing · Electrical Eng. & Systems 2021-10-06 Oren Rippel , Alexander G. Anderson , Kedar Tatwawadi , Sanjay Nair , Craig Lytle , Lubomir Bourdev

Traditional video compression technologies have been developed over decades in pursuit of higher coding efficiency. Efficient temporal information representation plays a key role in video coding. Thus, in this paper, we propose to exploit…

Image and Video Processing · Electrical Eng. & Systems 2019-12-16 Haojie Liu , Han shen , Lichao Huang , Ming Lu , Tong Chen , Zhan Ma

To provide users with more realistic visual experiences, videos are developing in the trends of Ultra High Definition (UHD), High Frame Rate (HFR), High Dynamic Range (HDR), Wide Color Gammut (WCG) and high clarity. However, the data amount…

Multimedia · Computer Science 2022-11-17 Yun Zhang , Linwei Zhu , Gangyi Jiang , Sam Kwong , C. -C. Jay Kuo

We propose a new approach to the problem of optimizing autoencoders for lossy image compression. New media formats, changing hardware technology, as well as diverse requirements and content types create a need for compression algorithms…

Machine Learning · Statistics 2017-03-02 Lucas Theis , Wenzhe Shi , Andrew Cunningham , Ferenc Huszár

We propose a method to compress full-resolution video sequences with implicit neural representations. Each frame is represented as a neural network that maps coordinate positions to pixel values. We use a separate implicit network to…

Machine Learning · Computer Science 2021-12-22 Yunfan Zhang , Ties van Rozendaal , Johann Brehmer , Markus Nagel , Taco Cohen

By 2022, we expect video traffic to reach 82% of the total internet traffic. Undoubtedly, the abundance of video-driven applications will likely lead internet video traffic percentage to a further increase in the near future, enabled by…

Multimedia · Computer Science 2021-05-19 Gangadharan Esakki , Andreas Panayides , Venkatesh Jatla , Marios Pattichis

As an increasing amount of image and video content will be analyzed by machines, there is demand for a new codec paradigm that is capable of compressing visual input primarily for the purpose of computer vision inference, while secondarily…

Image and Video Processing · Electrical Eng. & Systems 2023-01-12 Ezgi Ozyilkan , Mateen Ulhaq , Hyomin Choi , Fabien Racape

The ever-growing multimedia traffic has underscored the importance of effective multimedia codecs. Among them, the up-to-date lossy video coding standard, Versatile Video Coding (VVC), has been attracting attentions of video coding…

Image and Video Processing · Electrical Eng. & Systems 2022-05-10 Tiesong Zhao , Yuhang Huang , Weize Feng , Yiwen Xu , Sam Kwong

End-to-end image and video compression using auto-encoders (AE) offers new appealing perspectives in terms of rate-distortion gains and applications. While most complex models are on par with the latest compression standard like VVC/H.266…

Image and Video Processing · Electrical Eng. & Systems 2023-10-05 Franck Galpin , Muhammet Balcilar , Frédéric Lefebvre , Fabien Racapé , Pierre Hellier

Neural video compression (NVC) technologies have advanced rapidly in recent years, yielding state-of-the-art schemes such as DCVC-RT that offer superior compression efficiency to H.266/VVC and real-time encoding/decoding capabilities.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Hui Xiang , Yifan Bian , Li Li , Jingran Wu , Xianguo Zhang , Dong Liu

Recent advances in learned image codecs have been extended from human perception toward machine perception. However, progressive image compression with fine granular scalability (FGS)-which enables decoding a single bitstream at multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Jungwoo Kim , Jun-Hyuk Kim , Jong-Seok Lee

In recent years, there has been rapid development in learned image compression techniques that prioritize ratedistortion-perceptual compression, preserving fine details even at lower bit-rates. However, current learning-based image…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Peirong Ning , Wei Jiang , Ronggang Wang

Compression for machines is an emerging field, where inputs are encoded while optimizing the performance of downstream automated analysis. In scalable coding for humans and machines, the compressed representation used for machines is…

Image and Video Processing · Electrical Eng. & Systems 2023-05-19 Alon Harell , Yalda Foroutan , Ivan V. Bajic