English
Related papers

Related papers: NTK-Guided Implicit Neural Teaching

200 papers

Recent neural implicit representations (NIRs) have achieved great success in the tasks of 3D reconstruction and novel view synthesis. However, they require the images of a scene from different camera views to be available for one-time…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Mengqi Guo , Chen Li , Hanlin Chen , Gim Hee Lee

Implicit neural representations (INRs) such as NeRF and SIREN encode a signal in neural network parameters and show excellent results for signal reconstruction. Using INRs for downstream tasks, such as classification, is however not…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Alexander Gielisse , Jan van Gemert

Implicit Neural Representation (INR) has gained increasing popularity as a data representation method, serving as a prerequisite for innovative generation models. Unlike gradient-based methods, which exhibit lower efficiency in inference,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Shuyi Zhang , Ke Liu , Jingjun Gu , Xiaoxu Cai , Zhihua Wang , Jiajun Bu , Haishuai Wang

Implicit Neural Representations (INRs) are a novel paradigm for signal representation that have attracted considerable interest for image compression. INRs offer unprecedented advantages in signal resolution and memory efficiency, enabling…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Marcos V. Conde , Andy Bigos , Radu Timofte

Implicit neural representations (INR) has found successful applications across diverse domains. To employ INR in real-life, it is important to speed up training. In the field of INR for video applications, the state-of-the-art approach…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Seungjun Shin , Suji Kim , Dokwan Oh

The Neural Tangent Kernel (NTK) characterizes the behavior of infinitely-wide neural networks trained under least squares loss by gradient descent. Recent works also report that NTK regression can outperform finitely-wide neural networks…

Machine Learning · Computer Science 2021-12-09 Amir Zandieh , Insu Han , Haim Avron , Neta Shoham , Chaewon Kim , Jinwoo Shin

The approximation and convergence properties of implicit neural representations (INRs) are known to be highly sensitive to parameter initialization strategies. While several data-driven initialization methods demonstrate significant…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Kushal Vyas , Alper Kayabasi , Daniel Kim , Vishwanath Saragadam , Ashok Veeraraghavan , Guha Balakrishnan

Implicit neural representations (INRs) have demonstrated success in a variety of applications, including inverse problems and neural rendering. An INR is typically trained to capture one signal of interest, resulting in learned neural…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Kushal Vyas , Ahmed Imtiaz Humayun , Aniket Dashpute , Richard G. Baraniuk , Ashok Veeraraghavan , Guha Balakrishnan

Implicit Neural Representations (INRs) based on vanilla Multi-Layer Perceptrons (MLPs) are widely believed to be incapable of representing high-frequency content. This has directed research efforts towards architectural interventions, such…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Julian McGinnis , Florian A. Hölzl , Suprosanna Shit , Florentin Bieder , Paul Friedrich , Mark Mühlau , Björn Menze , Daniel Rueckert , Benedikt Wiestler

When learning new tasks in a sequential manner, deep neural networks tend to forget tasks that they previously learned, a phenomenon called catastrophic forgetting. Class incremental learning methods aim to address this problem by keeping a…

Machine Learning · Computer Science 2022-06-20 Jinlin Xiang , Eli Shlizerman

Neural fields, also known as implicit neural representations (INRs), offer a powerful framework for modeling continuous geometry, but their effectiveness in high-dimensional scientific settings is limited by slow convergence and scaling…

Machine Learning · Computer Science 2026-04-23 Sophia Zorek , Kushal Vyas , Yuhao Liu , David Lenz , Tom Peterka , Guha Balakrishnan

Implicit Neural Representations (INRs) are a versatile and powerful tool for encoding various forms of data, including images, videos, sound, and 3D shapes. A critical factor in the success of INRs is the initialization of the network,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Chamin Hewa Koneputugodage , Yizhak Ben-Shabat , Sameera Ramasinghe , Stephen Gould

We present a novel approach for super-resolution that utilizes implicit neural representation (INR) to effectively reconstruct and enhance low-resolution videos and images. By leveraging the capacity of neural networks to implicitly encode…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Mary Aiyetigbo , Wanqi Yuan , Feng Luo , Nianyi Li

Computed Tomography (CT) is pivotal in industrial quality control and medical diagnostics. Sparse-view CT, offering reduced ionizing radiation, faces challenges due to its under-sampled nature, leading to ill-posed reconstruction problems.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Jiayang Shi , Junyi Zhu , Daniel M. Pelt , K. Joost Batenburg , Matthew B. Blaschko

Implicit Neural Representations (INRs) have revolutionized continuous signal modeling, yet they struggle to recover fine-grained details within finite training budgets. While empirical techniques, such as positional encoding (PE),…

Machine Learning · Computer Science 2026-02-03 Jianqiao Zheng , Hemanth Saratchandran , Simon Lucey

Physics-informed neural networks (PINNs) are demonstrating remarkable promise in integrating physical models with gappy and noisy observational data, but they still struggle in cases where the target functions to be approximated exhibit…

Machine Learning · Computer Science 2021-06-16 Sifan Wang , Hanwen Wang , Paris Perdikaris

Implicit neural representations (INRs) have arisen as useful methods for representing signals on Euclidean domains. By parameterizing an image as a multilayer perceptron (MLP) on Euclidean space, INRs effectively represent signals in a way…

Signal Processing · Electrical Eng. & Systems 2023-10-03 T. Mitchell Roddenberry , Vishwanath Saragadam , Maarten V. de Hoop , Richard G. Baraniuk

While deep learning has achieved remarkable success across a wide range of applications, its theoretical understanding of representation learning remains limited. Deep neural kernels provide a principled framework to interpret…

Machine Learning · Computer Science 2025-11-11 Yong-Ming Tian , Shuang Liang , Shao-Qun Zhang , Feng-Lei Fan

Implicit Neural Representations (INRs) have garnered significant attention for their ability to model complex signals in various domains. Recently, INR-based frameworks have shown promise in neural video compression by embedding video…

Image and Video Processing · Electrical Eng. & Systems 2025-07-25 Taiga Hayami , Kakeru Koizumi , Hiroshi Watanabe

Implicit Neural Representations (INRs) are a learning-based approach to accelerate Magnetic Resonance Imaging (MRI) acquisitions, particularly in scan-specific settings when only data from the under-sampled scan itself are available.…

Image and Video Processing · Electrical Eng. & Systems 2024-12-11 Yamin Arefeen , Brett Levac , Zach Stoebner , Jonathan Tamir