English
Related papers

Related papers: Implicit-explicit Integrated Representations for M…

200 papers

Videos typically record the streaming and continuous visual data as discrete consecutive frames. Since the storage cost is expensive for videos of high fidelity, most of them are stored in a relatively low resolution and frame rate. Recent…

Image and Video Processing · Electrical Eng. & Systems 2022-06-10 Zeyuan Chen , Yinbo Chen , Jingwen Liu , Xingqian Xu , Vidit Goel , Zhangyang Wang , Humphrey Shi , Xiaolong Wang

We introduce a modality-agnostic neural compression algorithm based on a functional view of data and parameterised as an Implicit Neural Representation (INR). Bridging the gap between latent coding and sparsity, we obtain compact latent…

Machine Learning · Statistics 2023-04-10 Jonathan Richard Schwarz , Jihoon Tack , Yee Whye Teh , Jaeho Lee , Jinwoo Shin

The demand for compact cameras capable of recording high-speed scenes with high resolution is steadily increasing. However, achieving such capabilities often entails high bandwidth requirements, resulting in bulky, heavy systems unsuitable…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Zhihong Zhang , Runzhao Yang , Jinli Suo , Yuxiao Cheng , Qionghai Dai

Recent works have demonstrated the viability of utilizing over-fitted implicit neural representations (INRs) as alternatives to autoencoder-based models for neural video compression. Among these INR-based video codecs, Neural Video…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Ho Man Kwan , Tianhao Peng , Ge Gao , Fan Zhang , Mike Nilsson , Andrew Gower , David Bull

Displaying high-quality images on edge devices, such as augmented reality devices, is essential for enhancing the user experience. However, these devices often face power consumption and computing resource limitations, making it challenging…

Image and Video Processing · Electrical Eng. & Systems 2024-06-10 Xiang Liu , Jiahong Chen , Bin Chen , Zimo Liu , Baoyi An , Shu-Tao Xia , Zhi Wang

In an era where the exponential growth of image data driven by the Internet of Things (IoT) is outpacing traditional storage solutions, this work explores and advances the potential of Implicit Neural Representation (INR) as a…

Image and Video Processing · Electrical Eng. & Systems 2024-09-23 Sai Sanjeet , Seyyedali Hosseinalipour , Jinjun Xiong , Masahiro Fujita , Bibhu Datta Sahoo

We present a perceptually-driven video compression framework integrating implicit neural representations (INRs) and pre-trained video diffusion models to address the extremely low bitrate regime (<0.05 bpp). Our approach exploits the…

Image and Video Processing · Electrical Eng. & Systems 2026-04-10 Eren Çetin , Lucas Relic , Yuanyi Xue , Markus Gross , Christopher Schroers , Roberto Azevedo

Implicit Neural Representations (INRs) offer exceptional fidelity for video compression by learning per-video optimized functions, but their adoption is crippled by impractically slow encoding times. Existing attempts to accelerate INR…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Vikram Rangarajan , Shishira Maiya , Max Ehrlich , Abhinav Shrivastava

High-resolution (HR) videos play a crucial role in many computer vision applications. Although existing video restoration (VR) methods can significantly enhance video quality by exploiting temporal information across video frames, they are…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Mary Aiyetigbo , Wanqi Yuan , Feng Luo , Nianyi Li

Implicit Neural Representations (INR) have recently shown to be powerful tool for high-quality video compression. However, existing works are limiting as they do not explicitly exploit the temporal redundancy in videos, leading to a long…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Shishira R Maiya , Sharath Girish , Max Ehrlich , Hanyu Wang , Kwot Sin Lee , Patrick Poirson , Pengxiang Wu , Chen Wang , Abhinav Shrivastava

Video compression aims to reconstruct seamless frames by encoding the motion and residual information from existing frames. Previous neural video compression methods necessitate distinct codecs for three types of frames (I-frame, P-frame…

Image and Video Processing · Electrical Eng. & Systems 2024-06-04 Meiqin Liu , Chenming Xu , Yukai Gu , Chao Yao , Yao Zhao

Implicit Neural Representations (INRs) have demonstrated significant potential in video compression by representing videos as neural networks. However, as the number of frames increases, the memory consumption for training and inference…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Jia Wang , Xinfeng Zhang , Gai Zhang , Jun Zhu , Lv Tang , Li Zhang

While recent neural codecs achieve strong performance at low bitrates when optimized for perceptual quality, their effectiveness deteriorates significantly under ultra-low bitrate conditions. To mitigate this, generative compression methods…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Chuqin Zhou , Xiaoyue Ling , Yunuo Chen , Jincheng Dai , Guo Lu , Wenjun Zhang

Positional encodings are employed to capture the high frequency information of the encoded signals in implicit neural representation (INR). In this paper, we propose a novel positional encoding method which improves the reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Bharath Bhushan Damodaran , Francois Schnitzler , Anne Lambert , Pierre Hellier

Despite the abundant availability and content richness for video data, its high-dimensionality poses challenges for video research. Recent advancements have explored the implicit representation for videos using neural networks,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Hao Chen , Saining Xie , Ser-Nam Lim , Abhinav Shrivastava

We propose a novel neural representation for videos (NeRV) which encodes videos in neural networks. Unlike conventional representations that treat videos as frame sequences, we represent videos as neural networks taking frame index as…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Hao Chen , Bo He , Hanyu Wang , Yixuan Ren , Ser-Nam Lim , Abhinav Shrivastava

Implicit neural representation (INR) methods for video compression have recently achieved visual quality and compression ratios that are competitive with traditional pipelines. However, due to the need for per-sample network training, the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Matthew Gwilliam , Roy Zhang , Namitha Padmanabhan , Hongyang Du , Abhinav Shrivastava

Implicit Neural Video Representation (INVR) has emerged as a novel approach for video representation and compression, using learnable grids and neural networks. Existing methods focus on developing new grid structures efficient for latent…

Image and Video Processing · Electrical Eng. & Systems 2026-04-09 Yiyang Li , Yanbo Gao , Shuai Li , Zhenyu Du , Jinglin Zhang , Hui Yuan , Mao Ye , Xingyu Gao

This paper presents a novel scheme to efficiently compress Light Detection and Ranging~(LiDAR) point clouds, enabling high-precision 3D scene archives, and such archives pave the way for a detailed understanding of the corresponding 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Akihiro Kuwabara , Sorachi Kato , Toshiaki Koike-Akino , Takuya Fujihashi

Almost all digital videos are coded into compact representations before being transmitted. Such compact representations need to be decoded back to pixels before being displayed to humans and - as usual - before being enhanced/analyzed by…

Image and Video Processing · Electrical Eng. & Systems 2023-11-03 Xihua Sheng , Li Li , Dong Liu , Houqiang Li