English
Related papers

Related papers: Understanding NTK Variance in Implicit Neural Repr…

200 papers

Kernel ridge regression is well-known to achieve minimax optimal rates in low-dimensional settings. However, its behavior in high dimensions is much less understood. Recent work establishes consistency for kernel regression under certain…

Statistics Theory · Mathematics 2021-04-12 Konstantin Donhauser , Mingqi Wu , Fanny Yang

Neural fields, also known as implicit neural representations (INRs), offer a powerful framework for modeling continuous geometry, but their effectiveness in high-dimensional scientific settings is limited by slow convergence and scaling…

Machine Learning · Computer Science 2026-04-23 Sophia Zorek , Kushal Vyas , Yuhao Liu , David Lenz , Tom Peterka , Guha Balakrishnan

Implicit Neural Representations (INRs) have revolutionized signal representation by leveraging neural networks to provide continuous and smooth representations of complex data. However, existing INRs face limitations in capturing…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Amirhossein Kazerouni , Reza Azad , Alireza Hosseini , Dorit Merhof , Ulas Bagci

$\textit{Implicit neural representations}$ (INRs) aim to learn a $\textit{continuous function}$ (i.e., a neural network) to represent an image, where the input and output of the function are pixel coordinates and RGB/Gray values,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Ke Liu , Feng Liu , Haishuai Wang , Ning Ma , Jiajun Bu , Bo Han

Implicit Neural Representations (INRs) are increasingly recognized as a versatile data modality for representing discretized signals, offering benefits such as infinite query resolution and reduced storage requirements. Existing signal…

Machine Learning · Computer Science 2025-03-26 Dhananjaya Jayasundara , Sudarshan Rajagopalan , Yasiru Ranasinghe , Trac D. Tran , Vishal M. Patel

Implicit Neural Networks (INRs) have emerged as powerful representations to encode all forms of data, including images, videos, audios, and scenes. With video, many INRs for video have been proposed for the compression task, and recent…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Shishira R Maiya , Anubhav Gupta , Matthew Gwilliam , Max Ehrlich , Abhinav Shrivastava

Despite variations in architecture and pretraining strategies, recent studies indicate that large-scale AI models often converge toward similar internal representations that also align with neural activity. We propose that scale-invariance,…

Neurons and Cognition · Quantitative Biology 2025-06-17 Junjie Yu , Wenxiao Ma , Jianyu Zhang , Haotian Deng , Zihan Deng , Yi Guo , Quanying Liu

Reconstructing continuous environmental fields from sparse and irregular observations remains a central challenge in environmental modelling and biodiversity informatics. Many ecological datasets are heterogeneous in space and time, making…

Machine Learning · Computer Science 2026-04-21 Agnieszka Pregowska , Hazem M. Kalaji

Previous work has cast doubt on the general framework of uniform convergence and its ability to explain generalization in neural networks. By considering a specific dataset, it was observed that a neural network completely misclassifies a…

Machine Learning · Computer Science 2021-09-01 Gregor Bachmann , Seyed-Mohsen Moosavi-Dezfooli , Thomas Hofmann

Clinical routine and retrospective cohorts commonly include multi-parametric Magnetic Resonance Imaging; however, they are mostly acquired in different anisotropic 2D views due to signal-to-noise-ratio and scan-time constraints. Thus…

The training dynamics and generalization properties of neural networks (NN) can be precisely characterized in function space via the neural tangent kernel (NTK). Structural changes to the NTK during training reflect feature learning and…

Machine Learning · Statistics 2022-02-11 Haozhe Shan , Blake Bordelon

While Multimodal Large Language Models (MLLMs) have achieved remarkable success across diverse tasks, their practical deployment is severely hindered by hallucination issues, which become particularly acute during Reinforcement Learning…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Miao Pan , Wangjie Gan , Jintao Chen , Wenqi Zhang , Bing Sun , Jianwei Yin , Xuhong Zhang

Recent progress in computational photography has shown that we can acquire near-infrared (NIR) information in addition to the normal visible (RGB) band, with only slight modifications to standard digital cameras. Due to the proximity of the…

Computer Vision and Pattern Recognition · Computer Science 2014-06-25 Neda Salamati , Diane Larlus , Gabriela Csurka , Sabine Süsstrunk

Implicit Neural Representations (INRs) leverage neural networks to map coordinates to corresponding signals, enabling continuous and compact representations. This paradigm has driven significant advances in various vision tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Sukhun Ko , Seokhyun Youn , Dahyeon Kye , Kyle Min , Chanho Eom , Jihyong Oh

Traditional hyperspectral unmixing methods neglect the underlying variability of spectral signatures often observed in typical hyperspectral images (HI), propagating these missmodeling errors throughout the whole unmixing process. Attempts…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Tales Imbiriba , Ricardo Augusto Borsoi , José Carlos Moreira Bermudez

Implicit neural representations (INRs) encode signals in neural network weights as a memory-efficient representation, decoupling sampling resolution from the associated resource costs. Current INR image classification methods are…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Joost Luijmes , Alexander Gielisse , Roman Knyazhitskiy , Jan van Gemert

Implicit Neural Representations (INRs) have emerged as a powerful tool for geometric representation, yet their suitability for physics-based simulation remains underexplored. While metrics like Hausdorff distance quantify surface…

Computational Engineering, Finance, and Science · Computer Science 2026-02-03 Samundra Karki , Adarsh Krishnamurthy , Baskar Ganapathysubramanian

Existing periodic activation-based implicit neural representation (INR) networks, such as SIREN and FINER, suffer from hidden feature redundancy, where neurons within a layer capture overlapping frequency components due to the use of a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Mohammed Alsakabi , Wael Mobeirek , John M. Dolan , Ozan K. Tonguz

The design of a neural image compression network is governed by how well the entropy model matches the true distribution of the latent code. Apart from the model capacity, this ability is indirectly under the effect of how close the relaxed…

Image and Video Processing · Electrical Eng. & Systems 2023-09-21 Ali Zafari , Atefeh Khoshkhahtinat , Piyush Mehta , Mohammad Saeed Ebrahimi Saadabadi , Mohammad Akyash , Nasser M. Nasrabadi

Implicit Neural Representations (INRs) encoding continuous multi-media data via multi-layer perceptrons has shown undebatable promise in various computer vision tasks. Despite many successful applications, editing and processing an INR…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Dejia Xu , Peihao Wang , Yifan Jiang , Zhiwen Fan , Zhangyang Wang