English
Related papers

Related papers: A Rate-Quality Model for Learned Video Coding

200 papers

The emerging Learned Compression (LC) replaces the traditional codec modules with Deep Neural Networks (DNN), which are trained end-to-end for rate-distortion performance. This approach is considered as the future of image/video…

Image and Video Processing · Electrical Eng. & Systems 2024-07-08 Farhad Pakdaman , Moncef Gabbouj

Adaptive video streaming is a key enabler for optimising the delivery of offline encoded video content. The research focus to date has been on optimisation, based solely on rate-quality curves. This paper adds an additional dimension, the…

Image and Video Processing · Electrical Eng. & Systems 2024-02-13 Angeliki Katsenou , Xinyi Wang , Daniel Schien , David Bull

While the BD-rate performance of recent learned video codec models in both low-delay and random-access modes exceed that of respective modes of traditional codecs on average over common benchmarks, the performance improvements for…

Image and Video Processing · Electrical Eng. & Systems 2025-10-13 Ahmet Bilican , M. Akın Yılmaz , A. Murat Tekalp

In this paper, we propose a learning-based method to compose a video-story from a group of video clips that describe an activity or experience. We learn the coherence between video clips from real videos via the Recurrent Neural Network…

Computer Vision and Pattern Recognition · Computer Science 2018-02-01 Guangyu Zhong , Yi-Hsuan Tsai , Sifei Liu , Zhixun Su , Ming-Hsuan Yang

With the growing demand for video applications, many advanced learned video compression methods have been developed, outperforming traditional methods in terms of objective quality metrics such as PSNR. Existing methods primarily focus on…

Image and Video Processing · Electrical Eng. & Systems 2023-10-10 Meng Li , Yibo Shi , Jing Wang , Yunqi Huang

In this paper, a mode selection network (ModeNet) is proposed to enhance deep learning-based video compression. Inspired by traditional video coding, ModeNet purpose is to enable competition among several coding modes. The proposed ModeNet…

Neural and Evolutionary Computing · Computer Science 2020-08-03 Théo Ladune , Pierrick Philippe , Wassim Hamidouche , Lu Zhang , Olivier Déforges

We propose a lightweight learned video codec with 900 multiplications per decoded pixel and 800 parameters overall. To the best of our knowledge, this is one of the neural video codecs with the lowest decoding complexity. It is built upon…

Image and Video Processing · Electrical Eng. & Systems 2025-01-28 Thomas Leguay , Théo Ladune , Pierrick Philippe , Olivier Déforges

Neural networks (NN) can improve standard video compression by pre- and post-processing the encoded video. For optimal NN training, the standard codec needs to be replaced with a codec proxy that can provide derivatives of estimated…

Image and Video Processing · Electrical Eng. & Systems 2023-01-25 Amir Said , Manish Kumar Singh , Reza Pourreza

Quality assessment of videos is crucial for many computer graphics applications, including video games, virtual reality, and augmented reality, where visual performance has a significant impact on user experience. When test videos cannot be…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Sipeng Yang , Jiayu Ji , Qingchuan Zhu , Zhiyao Yang , Xiaogang Jin

Recent deep-learning-based video compression methods brought coding gains over conventional codecs such as AVC and HEVC. However, learning-based codecs generally require considerable computation time and model complexity. In this paper, we…

Image and Video Processing · Electrical Eng. & Systems 2023-03-22 Hochang Rhee , Seyun Kim , Nam Ik Cho

Video content has experienced a surge in popularity, asserting its dominance over internet traffic and Internet of Things (IoT) networks. Video compression has long been regarded as the primary means of efficiently managing the substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Parham Zilouchian Moghaddam , Mehdi Modarressi , Mohammad Amin Sadeghi

Common state-of-the-art video codecs are optimized to deliver a low bitrate by providing a certain quality for the final human observer, which is achieved by rate-distortion optimization (RDO). But, with the steady improvement of neural…

Image and Video Processing · Electrical Eng. & Systems 2022-03-14 Kristian Fischer , Fabian Brand , Christian Herglotz , André Kaup

The exponential growth of video traffic has placed increasing demands on bandwidth and storage infrastructure, particularly for content delivery networks (CDNs) and edge devices. While traditional video codecs like H.264 and HEVC achieve…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Manikanta Kotthapalli , Banafsheh Rekabdar

No-reference video quality assessment (NR-VQA) for user generated content (UGC) is crucial for understanding and improving visual experience. Unlike video recognition tasks, VQA tasks are sensitive to changes in input resolution. Since…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Junjie Ke , Tianhao Zhang , Yilin Wang , Peyman Milanfar , Feng Yang

Traditional parametric coding of speech facilitates low rate but provides poor reconstruction quality because of the inadequacy of the model used. We describe how a WaveNet generative speech model can be used to generate high quality speech…

Audio and Speech Processing · Electrical Eng. & Systems 2017-12-05 W. Bastiaan Kleijn , Felicia S. C. Lim , Alejandro Luebs , Jan Skoglund , Florian Stimberg , Quan Wang , Thomas C. Walters

Adaptive streaming of segmented video over HTTP typically relies on a predefined set of bitrate-resolution pairs, known as a bitrate ladder. However, fixed ladders often overlook variations in content and decoding complexities, leading to…

Image and Video Processing · Electrical Eng. & Systems 2026-03-17 Reza Farahani , Zoha Azimi , Vignesh V Menon , Hermann Hellwagner , Radu Prodan , Schahram Dustdar , Christian Timmerer

Among the various means to evaluate the quality of video streams, No-Reference (NR) methods have low computation and may be executed on thin clients. Thus, NR algorithms would be perfect candidates in cases of real-time quality assessment,…

Multimedia · Computer Science 2016-04-28 Maria Torres Vega , Decebal Constantin Mocanu , Antonio Liotta

In rate-distortion optimization, the encoder settings are determined by maximizing a reconstruction quality measure subject to a constraint on the bit rate. One of the main challenges of this approach is to define a quality measure that can…

Image and Video Processing · Electrical Eng. & Systems 2021-08-11 Qi Liu , Hui Yuan , Raouf Hamzaoui , Honglei Su , Junhui Hou , Huan Yang

Newly developed HTTP-based video streaming technologies enable flexible rate-adaptation under varying channel conditions. Accurately predicting the users' Quality of Experience (QoE) for rate-adaptive HTTP video streams is thus critical to…

Learned image compression codecs have recently achieved impressive compression performances surpassing the most efficient image coding architectures. However, most approaches are trained to minimize rate and distortion which often leads to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Daniele Mari , Simone Milani