English
Related papers

Related papers: Multi-Head ReLU Implicit Neural Representation Net…

200 papers

This paper investigates reduced complexity neural network (NN) based architectures for equalization over the two-dimension magnetic recording (TDMR) digital communication channel for data storage. We use realistic waveforms measured from a…

Signal Processing · Electrical Eng. & Systems 2022-10-11 Ahmed Aboutaleb , Nitin Nangare

Implicit neural representations (INRs) have gained prominence as a powerful paradigm in scene reconstruction and computer graphics, demonstrating remarkable results. By utilizing neural networks to parameterize data through implicit…

Image and Video Processing · Electrical Eng. & Systems 2023-08-01 Amirali Molaei , Amirhossein Aminimehr , Armin Tavakoli , Amirhossein Kazerouni , Bobby Azad , Reza Azad , Dorit Merhof

Implicit Neural Representations (INRs) have recently gained attention as a powerful approach for continuously representing signals such as images, videos, and 3D shapes using multilayer perceptrons (MLPs). However, MLPs are known to exhibit…

Machine Learning · Computer Science 2024-10-10 Adam Kania , Marko Mihajlovic , Sergey Prokudin , Jacek Tabor , Przemysław Spurek

Supervised Deep-Learning (DL)-based reconstruction algorithms have shown state-of-the-art results for highly-undersampled dynamic Magnetic Resonance Imaging (MRI) reconstruction. However, the requirement of excessive high-quality…

Image and Video Processing · Electrical Eng. & Systems 2025-11-11 Jie Feng , Ruimin Feng , Qing Wu , Zhiyong Zhang , Yuyao Zhang , Hongjiang Wei

This paper shows that a long chain of perceptrons (that is, a multilayer perceptron, or MLP, with many hidden layers of width one) can be a universal classifier. The classification procedure is not necessarily computationally efficient, but…

Neural and Evolutionary Computing · Computer Science 2017-07-11 Raul Rojas

Implicit neural representations (INRs) have emerged as a powerful paradigm for medical imaging via physics-informed unsupervised learning. Classical INRs optimize an entire network from scratch for each subject, leading to inefficient…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Qing Wu , Xuanyu Tian , Chenhe Du , Haonan Zhang , Xiao Wang , Le Lu , Yuyao Zhang

The definition of a Neural Network architecture is one of the most critical and challenging tasks to perform. In this paper, we propose ParallelMLPs. ParallelMLPs is a procedure to enable the training of several independent Multilayer…

Machine Learning · Computer Science 2022-06-20 Felipe Costa Farias , Teresa Bernarda Ludermir , Carmelo Jose Albanez Bastos-Filho

A possible path to the interpretability of neural networks is to (approximately) represent them in the regional format of piecewise linear functions, where regions of inputs are associated to linear functions computing the network outputs.…

Logic in Computer Science · Computer Science 2025-06-09 Sandro Preto , Marcelo Finger

Mixed-integer linear programming (MILP), a widely used modeling framework for combinatorial optimization, are central to many scientific and engineering applications, yet remains computationally challenging at scale. Recent advances in deep…

Artificial Intelligence · Computer Science 2026-01-09 Peixin Huang , Yaoxin Wu , Yining Ma , Cathy Wu , Wen Song , Wei Zhang

Implicit neural representations (INRs) have recently advanced numerous vision-related areas. INR performance depends strongly on the choice of the nonlinear activation function employed in its multilayer perceptron (MLP) network. A wide…

Computer Vision and Pattern Recognition · Computer Science 2023-01-13 Vishwanath Saragadam , Daniel LeJeune , Jasper Tan , Guha Balakrishnan , Ashok Veeraraghavan , Richard G. Baraniuk

We can compare the expressiveness of neural networks that use rectified linear units (ReLUs) by the number of linear regions, which reflect the number of pieces of the piecewise linear functions modeled by such networks. However,…

Machine Learning · Computer Science 2019-12-17 Thiago Serra , Srikumar Ramalingam

NeRF-based techniques fit wide and deep multi-layer perceptrons (MLPs) to a continuous radiance field that can be rendered from any unseen viewpoint. However, the lack of surface and normals definition and high rendering times limit their…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Stefano Esposito , Daniele Baieri , Stefan Zellmann , André Hinkenjann , Emanuele Rodolà

We introduce a new neural signal model designed for efficient high-resolution representation of large-scale signals. The key innovation in our multiscale implicit neural representation (MINER) is an internal representation via a Laplacian…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Vishwanath Saragadam , Jasper Tan , Guha Balakrishnan , Richard G. Baraniuk , Ashok Veeraraghavan

In this paper, a Lie group-based neural network method is proposed for solving initial value problems of non linear dynamics. Due to its single-layer structure (MLP), the approach is substantially cheaper than the multilayer perceptron…

Dynamical Systems · Mathematics 2022-03-10 Ying Wen , Temuer Chaolu

Implicit neural representations are a promising new avenue of representing general signals by learning a continuous function that, parameterized as a neural network, maps the domain of a signal to its codomain; the mapping from spatial…

Machine Learning · Computer Science 2021-11-09 Jaeho Lee , Jihoon Tack , Namhoon Lee , Jinwoo Shin

Multilayer perception (MLP) has permeated various disciplinary domains, ranging from bioinformatics to financial analytics, where their application has become an indispensable facet of contemporary scientific research endeavors. However,…

Artificial Intelligence · Computer Science 2024-07-15 Yanjie Li , Weijun Li , Lina Yu , Min Wu , Jinyi Liu , Wenqiang Li , Meilan Hao , Shu Wei , Yusong Deng , Liping Zhang , Xiaoli Dong , Hong Qin , Xin Ning , Yugui Zhang , Baoli Lu , Jian Xu , Shuang Li

For deep reinforcement learning (RL) from pixels, learning effective state representations is crucial for achieving high performance. However, in practice, limited experience and high-dimensional inputs prevent effective representation…

Machine Learning · Computer Science 2022-10-11 Tao Yu , Zhizheng Zhang , Cuiling Lan , Yan Lu , Zhibo Chen

In most existing learning systems, images are typically viewed as 2D pixel arrays. However, in another paradigm gaining popularity, a 2D image is represented as an implicit neural representation (INR) - an MLP that predicts an RGB pixel…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Ivan Skorokhodov , Savva Ignatyev , Mohamed Elhoseiny

Implicit representations are widely used for object reconstruction due to their efficiency and flexibility. In 2021, a novel structure named neural implicit map has been invented for incremental reconstruction. A neural implicit map…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Yijun Yuan , Andreas Nuechter

Recently, vision architectures based exclusively on multi-layer perceptrons (MLPs) have gained much attention in the computer vision community. MLP-like models achieve competitive performance on a single 2D image classification with less…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Shuo Chen , Tan Yu , Ping Li