English
Related papers

Related papers: Grids Often Outperform Implicit Neural Representat…

200 papers

We quantify the upper bound on the size of the implicit neural representation (INR) model from a digital perspective. The upper bound of the model size increases exponentially as the required bit-precision increases. To this end, we present…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Woo Kyoung Han , Byeonghun Lee , Hyunmin Cho , Sunghoon Im , Kyong Hwan Jin

The goal of this thesis is to improve our understanding of the internal mechanisms by which deep artificial neural networks create meaningful representations and are able to generalize. We focus on the challenge of characterizing the…

Machine Learning · Computer Science 2025-10-29 Diego Doimo

Implicit neural representation (INR) methods for video compression have recently achieved visual quality and compression ratios that are competitive with traditional pipelines. However, due to the need for per-sample network training, the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Matthew Gwilliam , Roy Zhang , Namitha Padmanabhan , Hongyang Du , Abhinav Shrivastava

Large-scale dense mapping is vital in robotics, digital twins, and virtual reality. Recently, implicit neural mapping has shown remarkable reconstruction quality. However, incremental large-scale mapping with implicit neural representations…

Robotics · Computer Science 2024-04-10 Jianheng Liu , Haoyao Chen

Shape priors learned from data are commonly used to reconstruct 3D objects from partial or noisy data. Yet no such shape priors are available for indoor scenes, since typical 3D autoencoders cannot handle their scale, complexity, or…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Chiyu Max Jiang , Avneesh Sud , Ameesh Makadia , Jingwei Huang , Matthias Nießner , Thomas Funkhouser

We investigate the learning of implicit neural representation (INR) using an overparameterized multilayer perceptron (MLP) via a novel nonparametric teaching perspective. The latter offers an efficient example selection framework for…

Machine Learning · Computer Science 2024-05-20 Chen Zhang , Steven Tin Sui Luo , Jason Chun Lok Li , Yik-Chung Wu , Ngai Wong

Implicit Neural Representations (INRs) have emerged as a powerful tool for geometric representation, yet their suitability for physics-based simulation remains underexplored. While metrics like Hausdorff distance quantify surface…

Computational Engineering, Finance, and Science · Computer Science 2026-02-03 Samundra Karki , Adarsh Krishnamurthy , Baskar Ganapathysubramanian

We use interval reachability analysis to obtain robustness guarantees for implicit neural networks (INNs). INNs are a class of implicit learning models that use implicit equations as layers and have been shown to exhibit several notable…

Machine Learning · Computer Science 2022-04-04 Alexander Davydov , Saber Jafarpour , Matthew Abate , Francesco Bullo , Samuel Coogan

Implicit Neural Representations (INRs) encode discrete signals continuously while addressing spectral bias through activation functions (AFs). Previous approaches mitigate this bias by employing complex AFs, which often incur significant…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Wenyong Zhou , Boyu Li , Jiachen Ren , Taiqiang Wu , Zhilin Ai , Zhengwu Liu , Ngai Wong

Self-supervised learning methods like masked autoencoders (MAE) have shown significant promise in learning robust feature representations, particularly in image reconstruction-based pretraining task. However, their performance is often…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Sua Lee , Joonhun Lee , Myungjoo Kang

The analysis of neural representation has become an integral part of research aiming to better understand the inner workings of neural networks. While there are many different approaches to investigate neural representations, an important…

Machine Learning · Computer Science 2026-04-23 Rickmer Schulte , David Rügamer

Implicit Neural Representations (INRs) leverage neural networks to map coordinates to corresponding signals, enabling continuous and compact representations. This paradigm has driven significant advances in various vision tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Sukhun Ko , Seokhyun Youn , Dahyeon Kye , Kyle Min , Chanho Eom , Jihyong Oh

Implicit Neural Representations (INRs) are widely used for modeling continuous 2D images, enabling high-fidelity reconstruction, super-resolution, and compression. Architectures such as SIREN, WIRE, and FINER demonstrate their ability to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Weronika Jakubowska , Mikołaj Zieliński , Rafał Tobiasz , Krzysztof Byrski , Maciej Zięba , Dominik Belter , Przemysław Spurek

Neural implicit representations, which encode a surface as the level set of a neural network applied to spatial coordinates, have proven to be remarkably effective for optimizing, compressing, and generating 3D geometry. Although these…

Computer Vision and Pattern Recognition · Computer Science 2022-06-27 Nicholas Sharp , Alec Jacobson

Implicit neural representations (INR) have been recently adopted in various applications ranging from computer vision tasks to physics simulations by solving partial differential equations. Among existing INR-based works, multi-layer…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Rui Gao , Rajeev K. Jaiman

Motivated by the growing theoretical understanding of neural networks that employ the Rectified Linear Unit (ReLU) as their activation function, we revisit the use of ReLU activation functions for learning implicit neural representations…

Image and Video Processing · Electrical Eng. & Systems 2024-08-05 Joseph Shenouda , Yamin Zhou , Robert D. Nowak

Implicit neural representations have emerged as a powerful paradigm to represent signals such as images and sounds. This approach aims to utilize neural networks to parameterize the implicit function of the signal. However, when…

Machine Learning · Computer Science 2024-09-04 Jiaming Zhao , Wenbo Qiao , Peng Zhang , Hui Gao

Recent work in Information Retrieval (IR) using Deep Learning models has yielded state of the art results on a variety of IR tasks. Deep neural networks (DNN) are capable of learning ideal representations of data during the training…

Information Retrieval · Computer Science 2016-06-27 Daniel Cohen , Qingyao Ai , W. Bruce Croft

Linear recurrent neural networks enable powerful long-range sequence modeling with constant memory usage and time-per-token during inference. These architectures hold promise for streaming applications at the edge, but deployment in…

Machine Learning · Computer Science 2025-08-14 Alessandro Pierro , Steven Abreu , Jonathan Timcheck , Philipp Stratmann , Andreas Wild , Sumit Bam Shrestha

Neural fields, which represent signals as a function parameterized by a neural network, are a promising alternative to traditional discrete vector or grid-based representations. Compared to discrete representations, neural representations…

Machine Learning · Computer Science 2023-09-14 Jeffrey Gu , Kuan-Chieh Wang , Serena Yeung