English
Related papers

Related papers: Parameter-Efficient Instance-Adaptive Neural Video…

200 papers

Well-trained generative neural networks (GNN) are very efficient at compressing visual information for static images in their learned parameters but not as efficient as inter- and intra-prediction for most video content. However, for…

Image and Video Processing · Electrical Eng. & Systems 2020-10-07 Jonah Probell

With the growing demand for video applications, many advanced learned video compression methods have been developed, outperforming traditional methods in terms of objective quality metrics such as PSNR. Existing methods primarily focus on…

Image and Video Processing · Electrical Eng. & Systems 2023-10-10 Meng Li , Yibo Shi , Jing Wang , Yunqi Huang

By 2022, we expect video traffic to reach 82% of the total internet traffic. Undoubtedly, the abundance of video-driven applications will likely lead internet video traffic percentage to a further increase in the near future, enabled by…

Multimedia · Computer Science 2021-05-19 Gangadharan Esakki , Andreas Panayides , Venkatesh Jatla , Marios Pattichis

Deep learning has shown great potential in image and video compression tasks. However, it brings bit savings at the cost of significant increases in coding complexity, which limits its potential for implementation within practical…

Image and Video Processing · Electrical Eng. & Systems 2021-05-28 Luka Murn , Saverio Blasi , Alan F. Smeaton , Noel E. O'Connor , Marta Mrak

Learned image compression allows achieving state-of-the-art accuracy and compression ratios, but their relatively slow runtime performance limits their usage. While previous attempts on optimizing learned image codecs focused more on the…

Image and Video Processing · Electrical Eng. & Systems 2022-08-04 Fangzheng Lin , Heming Sun , Jiro Katto

Recently, deep generative models have greatly advanced the progress of face video coding towards promising rate-distortion performance and diverse application functionalities. Beyond traditional hybrid video coding paradigms, Generative…

Image and Video Processing · Electrical Eng. & Systems 2024-10-14 Bolin Chen , Shanzhi Yin , Zihan Zhang , Jie Chen , Ru-Ling Liao , Lingyu Zhu , Shiqi Wang , Yan Ye

Neural image coding represents now the state-of-the-art image compression approach. However, a lot of work is still to be done in the video domain. In this work, we propose an end-to-end learned video codec that introduces several…

Image and Video Processing · Electrical Eng. & Systems 2021-12-17 Nannan Zou , Honglei Zhang , Francesco Cricri , Ramin G. Youvalari , Hamed R. Tavakoli , Jani Lainema , Emre Aksu , Miska Hannuksela , Esa Rahtu

With the increasing complexity of video data and the need for more efficient long-term temporal understanding, existing long-term video understanding methods often fail to accurately capture and analyze extended video sequences. These…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Sosuke Yamao , Natsuki Miyahara , Yuki Harazono , Shun Takeuchi

In computer vision, it has achieved great transfer learning performance via adapting large-scale pretrained vision models (e.g., vision transformers) to downstream tasks. Common approaches for model adaptation either update all model…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Xuehai He , Chunyuan Li , Pengchuan Zhang , Jianwei Yang , Xin Eric Wang

Large-scale pre-trained transformers have demonstrated remarkable success in various computer vision tasks. However, it is still highly challenging to fully fine-tune these models for downstream tasks due to their high computational and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Zhao Song , Ke Yang , Naiyang Guan , Junjie Zhu , Peng Qiao , Qingyong Hu

Recent years have witnessed an increasing interest in end-to-end learned video compression. Most previous works explore temporal redundancy by detecting and compressing a motion map to warp the reference frame towards the target frame. Yet,…

Image and Video Processing · Electrical Eng. & Systems 2022-11-21 Ren Yang , Radu Timofte , Luc Van Gool

Implicit neural representation (INR) methods for video compression have recently achieved visual quality and compression ratios that are competitive with traditional pipelines. However, due to the need for per-sample network training, the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Matthew Gwilliam , Roy Zhang , Namitha Padmanabhan , Hongyang Du , Abhinav Shrivastava

Deep video compression has made significant progress in recent years, achieving rate-distortion performance that surpasses that of traditional video compression methods. However, rate control schemes tailored for deep video compression have…

Multimedia · Computer Science 2025-05-09 Bowen Gu , Hao Chen , Ming Lu , Jie Yao , Zhan Ma

Recently, learned video compression (LVC) has shown superior performance under low-delay configuration. However, the performance of learned bi-directional video compression (LBVC) still lags behind traditional bi-directional coding. The…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Yongqi Zhai , Luyang Tang , Wei Jiang , Jiayu Yang , Ronggang Wang

Video-to-video translation aims to generate video frames of a target domain from an input video. Despite its usefulness, the existing networks require enormous computations, necessitating their model compression for wide use. While there…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Chaeyeon Chung , Yeojeong Park , Seunghwan Choi , Munkhsoyol Ganbat , Jaegul Choo

Large Vision-Language Models (VLMs) have been extended to understand both images and videos. Visual token compression is leveraged to reduce the considerable token length of visual inputs. To meet the needs of different tasks, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Chenyu Yang , Xuan Dong , Xizhou Zhu , Weijie Su , Jiahao Wang , Hao Tian , Zhe Chen , Wenhai Wang , Lewei Lu , Jifeng Dai

Contemporary lossy image and video coding standards rely on transform coding, the process through which pixels are mapped to an alternative representation to facilitate efficient data compression. Despite impressive performance of…

Image and Video Processing · Electrical Eng. & Systems 2023-02-21 Lyndon R. Duong , Bohan Li , Cheng Chen , Jingning Han

Digital media is ubiquitous and produced in ever-growing quantities. This necessitates a constant evolution of compression techniques, especially for video, in order to maintain efficient storage and transmission. In this work, we aim at…

Image and Video Processing · Electrical Eng. & Systems 2020-04-29 Jan P. Klopp , Liang-Gee Chen , Shao-Yi Chien

Most neural compression models are trained on large datasets of images or videos in order to generalize to unseen data. Such generalization typically requires large and expressive architectures with a high decoding complexity. Here we…

Image and Video Processing · Electrical Eng. & Systems 2023-12-06 Hyunjik Kim , Matthias Bauer , Lucas Theis , Jonathan Richard Schwarz , Emilien Dupont

IoT devices are increasingly the source of data for machine learning (ML) applications running on edge servers. Data transmissions from devices to servers are often over local wireless networks whose bandwidth is not just limited but, more…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-26 Ruiqi Wang , Hanyang Liu , Jiaming Qiu , Moran Xu , Roch Guerin , Chenyang Lu