English
Related papers

Related papers: Boosting Neural Representations for Videos with a …

200 papers

Data augmentation is a ubiquitous technique for improving image classification when labeled data is scarce. Constraining the model predictions to be invariant to diverse data augmentations effectively injects the desired representational…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Yuliang Zou , Jinwoo Choi , Qitong Wang , Jia-Bin Huang

Implicit Neural Representations (INRs) have emerged and shown their benefits over discrete representations in recent years. However, fitting an INR to the given observations usually requires optimization with gradient descent from scratch,…

Machine Learning · Computer Science 2022-08-08 Yinbo Chen , Xiaolong Wang

Implicit Neural Representations (INRs) employ neural networks to approximate discrete data as continuous functions. In the context of video data, such models can be utilized to transform the coordinates of pixel locations along with frame…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Weronika Smolak-Dyżewska , Dawid Malarz , Kornel Howil , Jan Kaczmarczyk , Marcin Mazur , Przemysław Spurek

In video super-resolution, it is common to use a frame-wise alignment to support the propagation of information over time. The role of alignment is well-studied for low-level enhancement in video, but existing works overlook a critical step…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Kai Xu , Ziwei Yu , Xin Wang , Michael Bi Mi , Angela Yao

Infrared and visible light image fusion aims to combine the strengths of both modalities to generate images that are rich in information and fulfill visual or computational requirements. This paper proposes an image fusion method based on…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Shuchen Sun , Ligen Shi , Chang Liu , Lina Wu , Jun Qiu

Generalizable implicit neural representation (INR) enables a single continuous function, i.e., a coordinate-based neural network, to represent multiple data instances by modulating its weights or intermediate features using latent codes.…

Machine Learning · Computer Science 2023-10-13 Doyup Lee , Chiheon Kim , Minsu Cho , Wook-Shin Han

Neural Representations for Videos (NeRV) encode entire video sequences within neural network parameters, offering an alternative paradigm to conventional video codecs. However, the convolutional decoder of NeRV remains computationally…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Tamer Shanableh

Implicit neural representations (INRs) have demonstrated strong capabilities in various medical imaging tasks, such as denoising, registration, and segmentation, by representing images as continuous functions, allowing complex details to be…

Image and Video Processing · Electrical Eng. & Systems 2025-03-31 Younès Moussaoui , Diana Mateus , Nasrin Taheri , Saïd Moussaoui , Thomas Carlier , Simon Stute

There has been a growing trend in compressing and transmitting videos from terminals for machine vision tasks. Nevertheless, most video coding optimization method focus on minimizing distortion according to human perceptual metrics,…

Multimedia · Computer Science 2025-12-18 Fei Zhao , Mengxi Guo , Shijie Zhao , Junlin Li , Li Zhang , Xiaodong Xie

Physical motions are inherently continuous, and higher camera frame rates typically contribute to improved smoothness and temporal coherence. For the first time, we explore continuous representations of human motion sequences, featuring the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Chenghao Xu , Guangtao Lyu , Qi Liu , Jiexi Yan , Muli Yang , Cheng Deng

Implicit neural representations (INR) have gained significant popularity for signal and image representation for many end-tasks, such as superresolution, 3D modeling, and more. Most INR architectures rely on sinusoidal positional encoding,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Rajhans Singh , Ankita Shukla , Pavan Turaga

Recent advances in implicit neural representations (INRs) have shown significant promise in modeling visual signals for various low-vision tasks including image super-resolution (ISR). INR-based ISR methods typically learn continuous…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yuxuan Jiang , Ho Man Kwan , Tianhao Peng , Ge Gao , Fan Zhang , Xiaoqing Zhu , Joel Sole , David Bull

Dynamic magnetic resonance imaging (dMRI) captures temporally-resolved anatomy but is often challenged by limited sampling and motion-induced artifacts. Conventional motion-compensated reconstructions typically rely on pre-estimated optical…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Baoqing Li , Yuanyuan Liu , Congcong Liu , Qingyong Zhu , Jing Cheng , Yihang Zhou , Hao Chen , Zhuo-Xu Cui , Dong Liang

Implicit Neural Representations (INRs) have emerged as a transformative paradigm in signal processing and computer vision, excelling in tasks from image reconstruction to 3D shape modeling. Yet their effectiveness is fundamentally limited…

Machine Learning · Computer Science 2025-09-30 Sipeng Chen , Yan Zhang , Shibo Li

Modern visual generative models acquire rich visual knowledge through large-scale training, yet existing visual representations (such as pixels, latents, or tokens) remain external to the model and cannot directly exploit this knowledge for…

Machine Learning · Computer Science 2026-05-25 Zongyu Guo , Jiajun He , Zhaoyang Jia , Xiaoyi Zhang , Jiahao Li , Xiao Li , Bin Li , José Miguel Hernández-Lobato , Yan Lu

Perceptual studies demonstrate that conditional diffusion models excel at reconstructing video content aligned with human visual perception. Building on this insight, we propose a video compression framework that leverages conditional…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Fangqiu Yi , Jingyu Xu , Jiawei Shao , Chi Zhang , Xuelong Li

Implicit Neural Representation for Videos (NeRV) has introduced a novel paradigm for video representation and compression, outperforming traditional codecs. As model size grows, however, slow encoding and decoding speed and high memory…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Inseo Lee , Youngyoon Choi , Joonseok Lee

Coded Aperture Snapshot Spectral Imaging (CASSI) reconstruction aims to recover the 3D spatial-spectral signal from 2D measurement. Existing methods for reconstructing Hyperspectral Image (HSI) typically involve learning mappings from a 2D…

Image and Video Processing · Electrical Eng. & Systems 2025-03-19 Huan Chen , Wangcai Zhao , Tingfa Xu , Shiyun Zhou , Peifu Liu , Jianan Li

Parallel imaging is a widely-used technique to accelerate magnetic resonance imaging (MRI). However, current methods still perform poorly in reconstructing artifact-free MRI images from highly undersampled k-space data. Recently, implicit…

Image and Video Processing · Electrical Eng. & Systems 2022-10-20 Ruimin Feng , Qing Wu , Yuyao Zhang , Hongjiang Wei

Recent denoising algorithms based on the "blind-spot" strategy show impressive blind image denoising performances, without utilizing any external dataset. While the methods excel in recovering highly contaminated images, we observe that…

Image and Video Processing · Electrical Eng. & Systems 2022-04-07 Chaewon Kim , Jaeho Lee , Jinwoo Shin