English
Related papers

Related papers: Regularize implicit neural representation by itsel…

200 papers

Regularization plays a vital role in the context of deep learning by preventing deep neural networks from the danger of overfitting. This paper proposes a novel deep learning regularization method named as DL-Reg, which carefully reduces…

Machine Learning · Computer Science 2020-11-05 Maryam Dialameh , Ali Hamzeh , Hossein Rahmani

Advancements in parallel processing have lead to a surge in multilayer perceptrons' (MLP) applications and deep learning in the past decades. Recurrent Neural Networks (RNNs) give additional representational power to feedforward MLPs by…

Machine Learning · Statistics 2014-10-22 Saahil Ognawala , Justin Bayer

Deep Learning (DL) methods can reconstruct highly accelerated magnetic resonance imaging (MRI) scans, but they rely on application-specific large training datasets and often generalize poorly to out-of-distribution data. Self-supervised…

Image and Video Processing · Electrical Eng. & Systems 2026-04-24 Hongze Yu , Jeffrey A. Fessler , Yun Jiang

An image denoiser can be used for a wide range of restoration problems via the Plug-and-Play (PnP) architecture. In this paper, we propose a general framework to build an interpretable graph-based deep denoiser (GDD) by unrolling a solution…

Image and Video Processing · Electrical Eng. & Systems 2024-09-11 Seyed Alireza Hosseini , Tam Thuc Do , Gene Cheung , Yuichi Tanaka

Implicit Neural Representation (INR) has gained increasing popularity as a data representation method, serving as a prerequisite for innovative generation models. Unlike gradient-based methods, which exhibit lower efficiency in inference,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Shuyi Zhang , Ke Liu , Jingjun Gu , Xiaoxu Cai , Zhihua Wang , Jiajun Bu , Haishuai Wang

This paper addresses the problem of inverse rendering from photometric images. Existing approaches for this problem suffer from the effects of self-shadows, inter-reflections, and lack of constraints on the surface reflectance, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Jingzhi Bao , Guanying Chen , Shuguang Cui

Implicit Neural Representation (INR) as a mighty representation paradigm has achieved success in various computer vision tasks recently. Due to the low-frequency bias issue of vanilla multi-layer perceptron (MLP), existing methods have…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Kexuan Shi , Xingyu Zhou , Shuhang Gu

We show that typical implicit regularization assumptions for deep neural networks (for regression) do not hold for coordinate-MLPs, a family of MLPs that are now ubiquitous in computer vision for representing high-frequency signals. Lack of…

Machine Learning · Computer Science 2022-02-03 Sameera Ramasinghe , Lachlan MacDonald , Simon Lucey

Studies on generalization performance of machine learning algorithms under the scope of information theory suggest that compressed representations can guarantee good generalization, inspiring many compression-based regularization methods.…

Machine Learning · Computer Science 2019-10-16 Antoine Saporta , Yifu Chen , Michael Blot , Matthieu Cord

$\textit{Implicit neural representations}$ (INRs) aim to learn a $\textit{continuous function}$ (i.e., a neural network) to represent an image, where the input and output of the function are pixel coordinates and RGB/Gray values,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Ke Liu , Feng Liu , Haishuai Wang , Ning Ma , Jiajun Bu , Bo Han

The large capacity of neural networks enables them to learn complex functions. To avoid overfitting, networks however require a lot of training data that can be expensive and time-consuming to collect. A common practical approach to…

Machine Learning · Computer Science 2020-03-10 Majed El Helou , Frederike Dümbgen , Sabine Süsstrunk

In this paper, we propose to reformulate the blind image deblurring task to directly learn an inverse of the degradation model represented by a deep linear network. We introduce Deep Identity Learning (DIL), a novel learning strategy that…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Vamsidhar Saraswathula , Rama Krishna Gorthi

Recently, implicit neural representations (INRs) have attracted increasing attention for multi-dimensional data recovery. However, INRs simply map coordinates via a multi-layer perception (MLP) to corresponding values, ignoring the inherent…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Jiayi Li , Xile Zhao , Jianli Wang , Chao Wang , Min Wang

In this paper we present a generalized Deep Learning-based approach for solving ill-posed large-scale inverse problems occuring in medical image reconstruction. Recently, Deep Learning methods using iterative neural networks and cascaded…

Image and Video Processing · Electrical Eng. & Systems 2020-08-26 Andreas Kofler , Markus Haltmeier , Tobias Schaeffter , Marc Kachelrieß , Marc Dewey , Christian Wald , Christoph Kolbitsch

In many computer vision applications, images are acquired with arbitrary or random rotations and translations, and in such setups, it is desirable to obtain semantic representations disentangled from the image orientation. Examples of such…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Sehyun Kwon , Joo Young Choi , Ernest K. Ryu

Large-scale dense mapping is vital in robotics, digital twins, and virtual reality. Recently, implicit neural mapping has shown remarkable reconstruction quality. However, incremental large-scale mapping with implicit neural representations…

Robotics · Computer Science 2024-04-10 Jianheng Liu , Haoyao Chen

Graphons are general and powerful models for generating graphs of varying size. In this paper, we propose to directly model graphons using neural networks, obtaining Implicit Graphon Neural Representation (IGNR). Existing work in modeling…

Machine Learning · Computer Science 2023-04-03 Xinyue Xia , Gal Mishne , Yusu Wang

We study the implicit regularization of gradient descent towards structured sparsity via a novel neural reparameterization, which we call a diagonally grouped linear neural network. We show the following intriguing property of our…

Machine Learning · Statistics 2023-01-31 Jiangyuan Li , Thanh V. Nguyen , Chinmay Hegde , Raymond K. W. Wong

Implicit Neural Representation (INR), leveraging a neural network to transform coordinate input into corresponding attributes, has recently driven significant advances in several vision-related domains. However, the performance of INR is…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Moein Heidari , Reza Rezaeian , Reza Azad , Dorit Merhof , Hamid Soltanian-Zadeh , Ilker Hacihaliloglu

Intrinsic decomposition from a single image is a highly challenging task, due to its inherent ambiguity and the scarcity of training data. In contrast to traditional fully supervised learning approaches, in this paper we propose learning…

Computer Vision and Pattern Recognition · Computer Science 2018-02-07 Michael Janner , Jiajun Wu , Tejas D. Kulkarni , Ilker Yildirim , Joshua B. Tenenbaum