English
Related papers

Related papers: SL$^{2}$A-INR: Single-Layer Learnable Activation f…

200 papers

Implicit Neural Representations (INRs) have emerged as a promising paradigm for video representation and compression. However, existing multi-scale INR generators often suffer from significant parameter redundancy by stacking independent…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Jia Wang , Jun Zhu , Xinfeng Zhang

Neural networks have greatly boosted performance in computer vision by learning powerful representations of input data. The drawback of end-to-end training for maximal overall performance are black-box models whose hidden representations…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Patrick Esser , Robin Rombach , Björn Ommer

Continual Learning in artificial neural networks suffers from interference and forgetting when different tasks are learned sequentially. This paper introduces the Active Long Term Memory Networks (A-LTM), a model of sequential multi-task…

Machine Learning · Computer Science 2016-06-09 Tommaso Furlanello , Jiaping Zhao , Andrew M. Saxe , Laurent Itti , Bosco S. Tjan

Implicit neural representation (INR) characterizes the attributes of a signal as a function of corresponding coordinates which emerges as a sharp weapon for solving inverse problems. However, the expressive power of INR is limited by the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Hao Zhu , Shaowen Xie , Zhen Liu , Fengyi Liu , Qi Zhang , You Zhou , Yi Lin , Zhan Ma , Xun Cao

High-dimensional, heterogeneous data with complex feature interactions pose significant challenges for traditional predictive modeling approaches. While Projection to Latent Structures (PLS) remains a popular technique, it struggles to…

Machine Learning · Computer Science 2025-10-21 Farwa Abbas , Hussain Ahmad , Claudia Szabo

Neural fields, also known as implicit neural representations (INRs), have shown a remarkable capability of representing, generating, and manipulating various data types, allowing for continuous data reconstruction at a low memory footprint.…

Image and Video Processing · Electrical Eng. & Systems 2024-02-29 Ahmed Ghorbel , Wassim Hamidouche , Luce Morin

In the area of explainable artificial intelligence, Symbolic Regression (SR) has emerged as a promising approach by discovering interpretable mathematical expressions that fit data. However, SR faces two main challenges: most methods are…

Machine Learning · Computer Science 2025-11-18 Hussein Rajabu , Lijun Qian , Xishuang Dong

Existing methods for spectral reconstruction usually learn a discrete mapping from RGB images to a number of spectral bands. However, this modeling strategy ignores the continuous nature of spectral signature. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2022-09-01 Ruikang Xu , Mingde Yao , Chang Chen , Lizhi Wang , Zhiwei Xiong

Independent Sign Language Recognition is a complex visual recognition problem that combines several challenging tasks of Computer Vision due to the necessity to exploit and fuse information from hand gestures, body features and facial…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Agelos Kratimenos , Georgios Pavlakos , Petros Maragos

Coordinate-based Multilayer Perceptron (MLP) networks, despite being capable of learning neural implicit representations, are not performant for internal image synthesis applications. Convolutional Neural Networks (CNNs) are typically used…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Mikolaj Czerkawski , Javier Cardona , Robert Atkinson , Craig Michie , Ivan Andonovic , Carmine Clemente , Christos Tachtatzis

Transformer models have established new benchmarks in natural language processing; however, their increasing depth results in substantial growth in parameter counts. While existing recurrent transformer methods address this issue by…

Computation and Language · Computer Science 2025-05-27 Anthony Nguyen , Wenjun Lin

Implicit Neural Representations (INRs) have emerged as a powerful alternative to traditional pixel-based formats by modeling images as continuous functions over spatial coordinates. A key challenge, however, lies in the spectral bias of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Sumit Kumar Dam , Mrityunjoy Gain , Eui-Nam Huh , Choong Seon Hong

Deep Learning in Image Registration (DLIR) methods have been tremendously successful in image registration due to their speed and ability to incorporate weak label supervision at training time. However, existing DLIR methods forego many of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Rohit Jena , Pratik Chaudhari , James C. Gee

We introduce a modality-agnostic neural compression algorithm based on a functional view of data and parameterised as an Implicit Neural Representation (INR). Bridging the gap between latent coding and sparsity, we obtain compact latent…

Machine Learning · Statistics 2023-04-10 Jonathan Richard Schwarz , Jihoon Tack , Yee Whye Teh , Jaeho Lee , Jinwoo Shin

Great successes have been achieved using deep learning techniques for image super-resolution (SR) with fixed scales. To increase its real world applicability, numerous models have also been proposed to restore SR images with arbitrary scale…

Image and Video Processing · Electrical Eng. & Systems 2022-09-28 Zhihong Pan , Baopu Li , Dongliang He , Wenhao Wu , Errui Ding

Implicit Neural Representations (INRs), as a versatile representation paradigm, have achieved success in various computer vision tasks. Due to the spectral bias of the vanilla multi-layer perceptrons (MLPs), existing methods focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Kexuan Shi , Hai Chen , Leheng Zhang , Shuhang Gu

More and more evidence has shown that strengthening layer interactions can enhance the representation power of a deep neural network, while self-attention excels at learning interdependencies by retrieving query-activated information.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Yanwen Fang , Yuxi Cai , Jintai Chen , Jingyu Zhao , Guangjian Tian , Guodong Li

Element-wise activation functions play a critical role in deep neural networks via affecting the expressivity power and the learning dynamics. Learning-based activation functions have recently gained increasing attention and success. We…

Machine Learning · Computer Science 2020-10-05 Dengsheng Chen , Jun Li , Kai Xu

Image super-resolution (SR) techniques have been developing rapidly, benefiting from the invention of deep networks and its successive breakthroughs. However, it is acknowledged that deep learning and deep neural networks are difficult to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Jinjin Gu , Chao Dong

An appropriate choice of the activation function (like ReLU, sigmoid or swish) plays an important role in the performance of (deep) multilayer perceptrons (MLP) for classification and regression learning. Prototype-based classification…

Machine Learning · Computer Science 2019-01-21 Thomas Villmann , John Ravichandran , Andrea Villmann , David Nebel , Marika Kaden