English
Related papers

Related papers: Escaping Spectral Bias without Backpropagation: Fa…

200 papers

Implicit neural representation (INR) has emerged as a promising solution for encoding volumetric data, offering continuous representations and seamless compatibility with the volume rendering pipeline. However, optimizing an INR network…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Maizhe Yang , Kaiyuan Tang , Chaoli Wang

Despite classical statistical theory predicting severe overfitting, modern massively overparameterized neural networks still generalize well. This unexpected property is attributed to the network's so-called implicit bias, which describes…

Machine Learning · Computer Science 2025-03-14 Justin Sahs , Ryan Pyle , Fabio Anselmi , Ankit Patel

Extreme learning machine (ELM) is an extremely fast learning method and has a powerful performance for pattern recognition tasks proven by enormous researches and engineers. However, its good generalization ability is built on large numbers…

Machine Learning · Computer Science 2015-02-05 Wentao Zhu , Jun Miao , Laiyun Qing

Recurrent neural networks (RNN) have been successfully applied to various sequential decision-making tasks, natural language processing applications, and time-series predictions. Such networks are usually trained through back-propagation…

Machine Learning · Computer Science 2019-12-02 Julia El Zini , Yara Rizk , Mariette Awad

Implicit Neural Representation (INR) has been emerging in computer vision in recent years. It has been shown to be effective in parameterising continuous signals such as dense 3D models from discrete image data, e.g. the neural radius field…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Wentian Xu , Jianbo Jiao

Implicit neural representations (INRs) have emerged as a powerful tool for solving inverse problems in computer vision and computational imaging. INRs represent images as continuous domain functions realized by a neural network taking…

Image and Video Processing · Electrical Eng. & Systems 2025-06-12 Mahrokh Najaf , Gregory Ongie

Implicit neural representations (INRs) have emerged as a powerful paradigm for medical imaging via physics-informed unsupervised learning. Classical INRs optimize an entire network from scratch for each subject, leading to inefficient…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Qing Wu , Xuanyu Tian , Chenhe Du , Haonan Zhang , Xiao Wang , Le Lu , Yuyao Zhang

Encoding input coordinates with sinusoidal functions into multilayer perceptrons (MLPs) has proven effective for implicit neural representations (INRs) of low-dimensional signals, enabling the modeling of high-frequency details. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Diana Aldana , João Paulo Lima , Daniel Csillag , Daniel Perazzo , Haoan Feng , Luiz Velho , Tiago Novello

Restricted Boltzmann Machines (RBMs) are a class of generative neural network that are typically trained to maximize a log-likelihood objective function. We argue that likelihood-based training strategies may fail because the objective does…

Machine Learning · Statistics 2018-04-25 Charles K. Fisher , Aaron M. Smith , Jonathan R. Walsh

The tracking method based on the extreme learning machine (ELM) is efficient and effective. ELM randomly generates input weights and biases in the hidden layer, and then calculates and computes the output weights by reducing the iterative…

Machine Learning · Computer Science 2018-07-27 Jing Zhang , Huibing Wang , Yonggong Ren

In many computer vision applications, images are acquired with arbitrary or random rotations and translations, and in such setups, it is desirable to obtain semantic representations disentangled from the image orientation. Examples of such…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Sehyun Kwon , Joo Young Choi , Ernest K. Ryu

Extreme learning machine (ELM) as an emerging branch of shallow networks has shown its excellent generalization and fast learning speed. However, for blended data, the robustness of ELM is weak because its weights and biases of hidden nodes…

Machine Learning · Computer Science 2014-09-24 Bo Han , Bo He , Mengmeng Ma , Tingting Sun , Tianhong Yan , Amaury Lendasse

Implicit Neural Representation (INR) as a mighty representation paradigm has achieved success in various computer vision tasks recently. Due to the low-frequency bias issue of vanilla multi-layer perceptron (MLP), existing methods have…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Kexuan Shi , Xingyu Zhou , Shuhang Gu

Blind Image Restoration (BIR) methods have achieved remarkable success but falter when faced with Extreme Blind Image Restoration (EBIR), where inputs suffer from severe, compounded degradations beyond their training scope. Directly…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Hongeun Kim , Bryan Sangwoo Kim , Jong Chul Ye

Implicit neural representations (INRs) mark a fundamental shift in signal modeling, moving from discrete sampled data to continuous functional representations. By parameterizing signals as neural networks, INRs provide a unified framework…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Dhananjaya Jayasundara , Vishal M. Patel

In this paper, a learning-based approach is proposed for optimizing downlink beamforming in multiple-input multiple-output (MIMO) systems that employ continuous aperture arrays (CAPAs) at both the base station (BS) and the user. Beamforming…

Signal Processing · Electrical Eng. & Systems 2026-03-18 Shiyong Chen , Jia Guo , Shengqian Han

Physics-informed neural networks (PINN) face significant challenges from spectral bias, which impedes their ability to model high-frequency phenomena and limits extrapolation performance. To address this, we introduce xLSTM-PINN, a novel…

Machine Learning · Computer Science 2025-12-08 Ze Tao , Darui Zhao , Fujun Liu , Ke Xu , Xiangsheng Hu

Hyperspectral image (HSI) super-resolution without additional auxiliary image remains a constant challenge due to its high-dimensional spectral patterns, where learning an effective spatial and spectral representation is a fundamental…

Image and Video Processing · Electrical Eng. & Systems 2021-12-21 Kaiwei Zhang

We study the problem of invariant learning when the environment labels are unknown. We focus on the invariant representation notion when the Bayes optimal conditional label distribution is the same across different environments. Previous…

Machine Learning · Computer Science 2022-08-09 Aayush Mishra , Anqi Liu

Representing surfaces as zero level sets of neural networks recently emerged as a powerful modeling paradigm, named Implicit Neural Representations (INRs), serving numerous downstream applications in geometric deep learning and 3D vision.…

Machine Learning · Computer Science 2021-06-16 Yaron Lipman