English
Related papers

Related papers: SL$^{2}$A-INR: Single-Layer Learnable Activation f…

200 papers

Implicit neural representations (INRs) have demonstrated success in a variety of applications, including inverse problems and neural rendering. An INR is typically trained to capture one signal of interest, resulting in learned neural…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Kushal Vyas , Ahmed Imtiaz Humayun , Aniket Dashpute , Richard G. Baraniuk , Ashok Veeraraghavan , Guha Balakrishnan

Representing visual signals by coordinate-based deep fully-connected networks has been shown advantageous in fitting complex details and solving inverse problems than discrete grid-based representation. However, acquiring such a continuous…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Peihao Wang , Zhiwen Fan , Tianlong Chen , Zhangyang Wang

In many recent works, multi-layer perceptions (MLPs) have been shown to be suitable for modeling complex spatially-varying functions including images and 3D scenes. Although the MLPs are able to represent complex scenes with unprecedented…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Animesh Karnewar , Tobias Ritschel , Oliver Wang , Niloy J. Mitra

Learning-to-learn (L2L), defined as progressively faster learning across similar tasks, is fundamental to both neuroscience and artificial intelligence. However, its neural basis remains elusive, as most studies emphasize neural population…

Neural and Evolutionary Computing · Computer Science 2025-09-29 Yingchao Yu , Yaochu Jin , Kuangrong Hao , Yuchen Xiao , Yuping Yan , Hengjie Yu , Zeqi Zheng , Wenxuan Pan

Implicit Neural Representations (INRs) have emerged as a powerful framework for modeling continuous signals. The spectral bias of ReLU-based networks is a well-established limitation, restricting their ability to capture fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Alireza Morsali , MohammadJavad Vaez , Mohammadhossein Soltani , Amirhossein Kazerouni , Babak Taati , Morteza Mohammad-Noori

The scope of research in the domain of activation functions remains limited and centered around improving the ease of optimization or generalization quality of neural networks (NNs). However, to develop a deeper understanding of deep…

Machine Learning · Computer Science 2020-12-10 Mohit Goyal , Rajan Goyal , Brejesh Lall

Deep neural networks, particularly those employing Rectified Linear Units (ReLU), are often perceived as complex, high-dimensional, non-linear systems. This complexity poses a significant challenge to understanding their internal learning…

Machine Learning · Computer Science 2025-11-11 Longqing Ye

Implicit Neural Representations (INRs) have revolutionized signal representation by leveraging neural networks to provide continuous and smooth representations of complex data. However, existing INRs face limitations in capturing…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Amirhossein Kazerouni , Reza Azad , Alireza Hosseini , Dorit Merhof , Ulas Bagci

Implicit Neural Representations (INRs) are nowadays used to represent multimedia signals across various real-life applications, including image super-resolution, image compression, or 3D rendering. Existing methods that leverage INRs are…

Machine Learning · Computer Science 2023-06-21 Filip Szatkowski , Karol J. Piczak , Przemysław Spurek , Jacek Tabor , Tomasz Trzciński

Recent studies have shown remarkable progress in GANs based on implicit neural representation (INR) - an MLP that produces an RGB value given its (x, y) coordinate. They represent an image as a continuous version of the underlying 2D signal…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Namwoo Lee , Hyunsu Kim , Gayoung Lee , Sungjoo Yoo , Yunjey Choi

Deep learning based fusion methods have been achieving promising performance in image fusion tasks. This is attributed to the network architecture that plays a very important role in the fusion process. However, in general, it is hard to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Hui Li , Tianyang Xu , Xiao-Jun Wu , Jiwen Lu , Josef Kittler

The many variations of Implicit Neural Representations (INRs), where a neural network is trained as a continuous representation of a signal, have tremendous practical utility for downstream tasks including novel view synthesis, video…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Namitha Padmanabhan , Matthew Gwilliam , Pulkit Kumar , Shishira R Maiya , Max Ehrlich , Abhinav Shrivastava

Implicit Neural Representation (INR) has recently attracted considerable attention for storing various types of signals in continuous forms. The existing INR networks require lengthy training processes and high-performance computational…

Many autonomous robotic applications require object-level understanding when deployed. Actively reconstructing objects of interest, i.e. objects with specific semantic meanings, is therefore relevant for a robot to perform downstream tasks…

Robotics · Computer Science 2024-03-19 Liren Jin , Haofei Kuang , Yue Pan , Cyrill Stachniss , Marija Popović

Implicit neural representation (INR) characterizes the attributes of a signal as a function of corresponding coordinates which emerges as a sharp weapon for solving inverse problems. However, the capacity of INR is limited by the spectral…

Image and Video Processing · Electrical Eng. & Systems 2022-11-16 Shaowen Xie , Hao Zhu , Zhen Liu , Qi Zhang , You Zhou , Xun Cao , Zhan Ma

In recent years, deep neural networks (DNNs) achieved unprecedented performance in many low-level vision tasks. However, state-of-the-art results are typically achieved by very deep networks, which can reach tens of layers with tens of…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Idan Kligvasser , Tamar Rott Shaham , Tomer Michaeli

The recent work Local Implicit Image Function (LIIF) and subsequent Implicit Neural Representation (INR) based works have achieved remarkable success in Arbitrary-Scale Super-Resolution (ASSR) by using MLP to decode Low-Resolution (LR)…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Zongyao He , Zhi Jin

Multi-Layer Perceptrons (MLPs) make powerful functional representations for sampling and reconstruction problems involving low-dimensional signals like images,shapes and light fields. Recent works have significantly improved their ability…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Ishit Mehta , Michaël Gharbi , Connelly Barnes , Eli Shechtman , Ravi Ramamoorthi , Manmohan Chandraker

Existing periodic activation-based implicit neural representation (INR) networks, such as SIREN and FINER, suffer from hidden feature redundancy, where neurons within a layer capture overlapping frequency components due to the use of a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Mohammed Alsakabi , Wael Mobeirek , John M. Dolan , Ozan K. Tonguz

Implicit neural representations (INRs) have gained prominence as a powerful paradigm in scene reconstruction and computer graphics, demonstrating remarkable results. By utilizing neural networks to parameterize data through implicit…

Image and Video Processing · Electrical Eng. & Systems 2023-08-01 Amirali Molaei , Amirhossein Aminimehr , Armin Tavakoli , Amirhossein Kazerouni , Bobby Azad , Reza Azad , Dorit Merhof