English
Related papers

Related papers: Multi-Head ReLU Implicit Neural Representation Net…

200 papers

A multi-layer perceptron (MLP) is a type of neural networks which has a long history of research and has been studied actively recently in computer vision and graphics fields. One of the well-known problems of an MLP is the capability of…

Graphics · Computer Science 2023-10-31 Shin Fujieda , Atsushi Yoshimura , Takahiro Harada

In this paper the Mechanical Neural Network(MNN) is introduced, a physical implementation of a multilayer perceptron(MLP) with ReLU activation functions, two input neurons, four hidden neurons and two output neurons. This physical model of…

Machine Learning · Computer Science 2023-11-09 Axel Schaffland

Coordinate-based Multilayer Perceptron (MLP) networks, despite being capable of learning neural implicit representations, are not performant for internal image synthesis applications. Convolutional Neural Networks (CNNs) are typically used…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Mikolaj Czerkawski , Javier Cardona , Robert Atkinson , Craig Michie , Ivan Andonovic , Carmine Clemente , Christos Tachtatzis

Implicit Neural Representations (INRs) are widely used to encode data as continuous functions, enabling the visualization of large-scale multivariate scientific simulation data with reduced memory usage. However, existing INR-based methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Hyunsoo Son , Jeonghyun Noh , Suemin Jeon , Chaoli Wang , Won-Ki Jeong

Implicit neural representations (INR) have gained significant popularity for signal and image representation for many end-tasks, such as superresolution, 3D modeling, and more. Most INR architectures rely on sinusoidal positional encoding,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Rajhans Singh , Ankita Shukla , Pavan Turaga

Implicit Neural Representation (INR) has been emerging in computer vision in recent years. It has been shown to be effective in parameterising continuous signals such as dense 3D models from discrete image data, e.g. the neural radius field…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Wentian Xu , Jianbo Jiao

Multi-Layer Perceptrons (MLPs) make powerful functional representations for sampling and reconstruction problems involving low-dimensional signals like images,shapes and light fields. Recent works have significantly improved their ability…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Ishit Mehta , Michaël Gharbi , Connelly Barnes , Eli Shechtman , Ravi Ramamoorthi , Manmohan Chandraker

Due to their weak inductive bias, Multi-Layer Perceptrons (MLPs) have subpar performance at low-compute levels compared to standard architectures such as convolution-based networks (CNN). Recent work, however, has shown that the performance…

Machine Learning · Computer Science 2024-10-15 Sean Wu , Jordan Hong , Keyu Bai , Gregor Bachmann

Implicit neural representations (INRs) encode signals in neural network weights as a memory-efficient representation, decoupling sampling resolution from the associated resource costs. Current INR image classification methods are…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Joost Luijmes , Alexander Gielisse , Roman Knyazhitskiy , Jan van Gemert

Recently Implicit Neural Representations (INRs) gained attention as a novel and effective representation for various data types. Thus far, prior work mostly focused on optimizing their reconstruction performance. This work investigates INRs…

Image and Video Processing · Electrical Eng. & Systems 2022-08-05 Yannick Strümpler , Janis Postels , Ren Yang , Luc van Gool , Federico Tombari

Implicit neural representations (INRs) mark a fundamental shift in signal modeling, moving from discrete sampled data to continuous functional representations. By parameterizing signals as neural networks, INRs provide a unified framework…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Dhananjaya Jayasundara , Vishal M. Patel

Deep neural networks are widely used in practical applications of AI, however, their inner structure and complexity made them generally not easily interpretable. Model transparency and interpretability are key requirements for multiple…

Machine Learning · Computer Science 2026-01-13 Luca Bergamin , Roberto Confalonieri , Fabio Aiolli

Modern deep learning architectures are ordinarily performed on high-performance computing facilities due to the large size of the input features and complexity of its model. This paper proposes traditional multilayer perceptrons (MLP) with…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-28 Bagus Tris Atmaja , Masato Akagi

Implicit Neural Representations (INR) use multilayer perceptrons to represent high-frequency functions in low-dimensional problem domains. Recently these representations achieved state-of-the-art results on tasks related to complex 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Nuri Benbarka , Timon Höfer , Hamd ul-moqeet Riaz , Andreas Zell

This paper studies a problem of learning surface mesh via implicit functions in an emerging field of deep learning surface reconstruction, where implicit functions are popularly implemented as multi-layer perceptrons (MLPs) with rectified…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Jiabao Lei , Kui Jia

Implicit neural representation (INR) has proven to be accurate and efficient in various domains. In this work, we explore how different neural networks can be designed as a new texture INR, which operates in a continuous manner rather than…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Albert Kwok , Zheyuan Hu , Dounia Hammou

Neural networks often operate in the overparameterized regime, in which there are far more parameters than training samples, allowing the training data to be fit perfectly. That is, training the network effectively learns an interpolating…

Machine Learning · Computer Science 2025-03-19 Suzanna Parkinson , Greg Ongie , Rebecca Willett

In this work we revisit the most fundamental building block in deep learning, the multi-layer perceptron (MLP), and study the limits of its performance on vision tasks. Empirical insights into MLPs are important for multiple reasons. (1)…

Machine Learning · Computer Science 2023-10-04 Gregor Bachmann , Sotiris Anagnostidis , Thomas Hofmann

Implicit Neural Representations (INRs) are powerful to parameterize continuous signals in computer vision. However, almost all INRs methods are limited to low-level tasks, e.g., image/video compression, super-resolution, and image…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Yiran Song , Qianyu Zhou , Lizhuang Ma

This paper introduces a novel neural network for efficiently solving Structured Inverse Eigenvalue Problems (SIEPs). The main contributions lie in two aspects: firstly, a unified framework is proposed that can handle various SIEPs…

Numerical Analysis · Mathematics 2024-07-01 Shuai Zhang , Xuelian Jiang , Hao Qian , Yingxiang Xu