English
Related papers

Related papers: Frequency-aware Neural Representation for Videos

200 papers

Representing a signal as a continuous function parameterized by neural network (a.k.a. Implicit Neural Representations, INRs) has attracted increasing attention in recent years. Neural Processes (NPs), which model the distributions over…

Machine Learning · Computer Science 2023-02-22 Zongyu Guo , Cuiling Lan , Zhizheng Zhang , Yan Lu , Zhibo Chen

We propose neural network layers that explicitly combine frequency and image feature representations and show that they can be used as a versatile building block for reconstruction from frequency space data. Our work is motivated by the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Nalini M. Singh , Juan Eugenio Iglesias , Elfar Adalsteinsson , Adrian V. Dalca , Polina Golland

Existing periodic activation-based implicit neural representation (INR) networks, such as SIREN and FINER, suffer from hidden feature redundancy, where neurons within a layer capture overlapping frequency components due to the use of a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Mohammed Alsakabi , Wael Mobeirek , John M. Dolan , Ozan K. Tonguz

Adaptive bitrate (ABR) using conventional codecs cannot further modify the bitrate once a decision has been made, exhibiting limited adaptation capability. This may result in either overly conservative or overly aggressive bitrate…

Image and Video Processing · Electrical Eng. & Systems 2024-06-06 Mufan Liu , Le Yang , Yiling Xu , Ye-kui Wang , Jenq-Neng Hwang

Implicit neural representations (INRs) are a rapidly growing research field, which provides alternative ways to represent multimedia signals. Recent applications of INRs include image super-resolution, compression of high-dimensional…

Implicit neural representations have emerged as a powerful tool in learning 3D geometry, offering unparalleled advantages over conventional representations like mesh-based methods. A common type of INR implicitly encodes a shape's boundary…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Shen Fan , Przemyslaw Musialski

Ultrasound is widely used in clinical care, yet standard deep learning methods often struggle with full video analysis due to non-standardized acquisition and operator bias. We offer a new perspective on ultrasound video analysis through…

Image and Video Processing · Electrical Eng. & Systems 2025-07-30 Julia Wolleb , Florentin Bieder , Paul Friedrich , Hemant D. Tagare , Xenophon Papademetris

Neural radiance fields (NeRFs) have achieved impressive view synthesis results by learning an implicit volumetric representation from multi-view images. To project the implicit representation into an image, NeRF employs volume rendering…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Y. Wang , J. Xu , Y. Zeng , Y. Gong

Implicit Neural Representations (INRs) have emerged in the last few years as a powerful tool to encode continuously a variety of different signals like images, videos, audio and 3D shapes. When applied to 3D shapes, INRs allow to overcome…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Luca De Luigi , Adriano Cardace , Riccardo Spezialetti , Pierluigi Zama Ramirez , Samuele Salti , Luigi Di Stefano

Applications of Implicit Neural Representations (INRs) have emerged as a promising deep learning approach for compactly representing large volumetric datasets. These models can act as surrogates for volume data, enabling efficient storage…

Machine Learning · Computer Science 2026-01-27 Shanu Saklani , Tushar M. Athawale , Nairita Pal , David Pugmire , Christopher R. Johnson , Soumya Dutta

Recent work on Neural Radiance Fields (NeRF) showed how neural networks can be used to encode complex 3D environments that can be rendered photorealistically from novel viewpoints. Rendering these images is very computationally demanding…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Stephan J. Garbin , Marek Kowalski , Matthew Johnson , Jamie Shotton , Julien Valentin

The many variations of Implicit Neural Representations (INRs), where a neural network is trained as a continuous representation of a signal, have tremendous practical utility for downstream tasks including novel view synthesis, video…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Namitha Padmanabhan , Matthew Gwilliam , Pulkit Kumar , Shishira R Maiya , Max Ehrlich , Abhinav Shrivastava

High-fidelity reconstruction of head avatars from monocular videos is highly desirable for virtual human applications, but it remains a challenge in the fields of computer graphics and computer vision. In this paper, we propose a two-phase…

Graphics · Computer Science 2025-03-31 Pilseo Park , Ze Zhang , Michel Sarkis , Ning Bi , Xiaoming Liu , Yiying Tong

Implicit neural representations have emerged as a promising paradigm for video compression, with recent methods achieving competitive performance on natural video. However, screen content video -- common in remote desktop, online education,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Ruohan Shi , Jiaoyan Zhao , Haogang Feng

Implicit neural representation (INR) has proven to be accurate and efficient in various domains. In this work, we explore how different neural networks can be designed as a new texture INR, which operates in a continuous manner rather than…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Albert Kwok , Zheyuan Hu , Dounia Hammou

4D reconstruction and rendering of human activities is critical for immersive VR/AR experience.Recent advances still fail to recover fine geometry and texture results with the level of detail present in the input images from sparse…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Xin Suo , Yuheng Jiang , Pei Lin , Yingliang Zhang , Kaiwen Guo , Minye Wu , Lan Xu

Neural rendering can be used to reconstruct implicit representations of shapes without 3D supervision. However, current neural surface reconstruction methods have difficulty learning high-frequency geometry details, so the reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Yiqun Wang , Ivan Skorokhodov , Peter Wonka

Implicit Neural Representations (INR) use multilayer perceptrons to represent high-frequency functions in low-dimensional problem domains. Recently these representations achieved state-of-the-art results on tasks related to complex 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Nuri Benbarka , Timon Höfer , Hamd ul-moqeet Riaz , Andreas Zell

Implicit Neural Representations (INRs) encode discrete signals continuously while addressing spectral bias through activation functions (AFs). Previous approaches mitigate this bias by employing complex AFs, which often incur significant…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Wenyong Zhou , Boyu Li , Jiachen Ren , Taiqiang Wu , Zhilin Ai , Zhengwu Liu , Ngai Wong

Ultrafast ultrasound imaging enables visualization of rapid physiological dynamics by acquiring data at exceptionally high frame rates. However, this speed often comes at the cost of spatial resolution and image quality due to unfocused…

Image and Video Processing · Electrical Eng. & Systems 2025-10-08 Rémi Delaunay , Christoph Hennersperger , Stefan Wörz