English
Related papers

Related papers: Ensuring Semantics in Weights of Implicit Neural R…

200 papers

Weight space learning is an emerging paradigm in the deep learning community. The primary goal of weight space learning is to extract informative features from a set of parameters using specially designed neural networks, often referred to…

Machine Learning · Computer Science 2025-03-13 Taesun Yeom , Jaeho Lee

Implicit neural representation (INR) has emerged as a promising solution for encoding volumetric data, offering continuous representations and seamless compatibility with the volume rendering pipeline. However, optimizing an INR network…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Maizhe Yang , Kaiyuan Tang , Chaoli Wang

Recent work in Deep Learning has re-imagined the representation of data as functions mapping from a coordinate space to an underlying continuous signal. When such functions are approximated by neural networks this introduces a compelling…

Machine Learning · Statistics 2022-08-09 Jonathan Richard Schwarz , Yee Whye Teh

We investigate the learning of implicit neural representation (INR) using an overparameterized multilayer perceptron (MLP) via a novel nonparametric teaching perspective. The latter offers an efficient example selection framework for…

Machine Learning · Computer Science 2024-05-20 Chen Zhang , Steven Tin Sui Luo , Jason Chun Lok Li , Yik-Chung Wu , Ngai Wong

Models for image representation learning are typically designed for either recognition or generation. Various forms of contrastive learning help models learn to convert images to embeddings that are useful for classification, detection, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Matthew Gwilliam , Xiao Wang , Xuefeng Hu , Zhenheng Yang

It is commonly believed that the hidden layers of deep neural networks (DNNs) attempt to extract informative features for learning tasks. In this paper, we formalize this intuition by showing that the features extracted by DNN coincide with…

Information Theory · Computer Science 2019-05-17 Shao-Lun Huang , Xiangxiang Xu , Lizhong Zheng , Gregory W. Wornell

In an era where the exponential growth of image data driven by the Internet of Things (IoT) is outpacing traditional storage solutions, this work explores and advances the potential of Implicit Neural Representation (INR) as a…

Image and Video Processing · Electrical Eng. & Systems 2024-09-23 Sai Sanjeet , Seyyedali Hosseinalipour , Jinjun Xiong , Masahiro Fujita , Bibhu Datta Sahoo

The goal of this work is to bring semantics into the tasks of text recognition and retrieval in natural images. Although text recognition and retrieval have received a lot of attention in recent years, previous works have focused on…

Computer Vision and Pattern Recognition · Computer Science 2015-09-22 Albert Gordo , Jon Almazan , Naila Murray , Florent Perronnin

Observing that for certain NLP tasks, such as semantic role prediction or thematic fit estimation, random embeddings perform as well as pretrained embeddings, we explore what settings allow for this and examine where most of the learning is…

Computation and Language · Computer Science 2022-10-25 Mughilan Muthupari , Samrat Halder , Asad Sayeed , Yuval Marton

Implicit neural representations (INRs) have emerged as a powerful tool for solving inverse problems in computer vision and computational imaging. INRs represent images as continuous domain functions realized by a neural network taking…

Image and Video Processing · Electrical Eng. & Systems 2025-06-12 Mahrokh Najaf , Gregory Ongie

Supervised Deep-Learning (DL)-based reconstruction algorithms have shown state-of-the-art results for highly-undersampled dynamic Magnetic Resonance Imaging (MRI) reconstruction. However, the requirement of excessive high-quality…

Image and Video Processing · Electrical Eng. & Systems 2025-11-11 Jie Feng , Ruimin Feng , Qing Wu , Zhiyong Zhang , Yuyao Zhang , Hongjiang Wei

We propose an algorithm for inexpensive gradient-based hyperparameter optimization that combines the implicit function theorem (IFT) with efficient inverse Hessian approximations. We present results about the relationship between the IFT…

Machine Learning · Computer Science 2019-11-11 Jonathan Lorraine , Paul Vicol , David Duvenaud

Implicit neural representations (INRs) have arisen as useful methods for representing signals on Euclidean domains. By parameterizing an image as a multilayer perceptron (MLP) on Euclidean space, INRs effectively represent signals in a way…

Signal Processing · Electrical Eng. & Systems 2023-10-03 T. Mitchell Roddenberry , Vishwanath Saragadam , Maarten V. de Hoop , Richard G. Baraniuk

In conventional formulations of multilayer feedforward neural networks, the individual layers are customarily defined by explicit functions. In this paper we demonstrate that defining individual layers in a neural network \emph{implicitly}…

Computer Vision and Pattern Recognition · Computer Science 2020-06-04 Qianggong Zhang , Yanyang Gu , Michalkiewicz Mateusz , Mahsa Baktashmotlagh , Anders Eriksson

Implicit neural representations (INRs), which leverage neural networks to represent signals by mapping coordinates to their corresponding attributes, have garnered significant attention. They are extensively utilized for image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Sheng Zheng , Chaoning Zhang , Dongshen Han , Fachrina Dewi Puspitasari , Xinhong Hao , Yang Yang , Heng Tao Shen

Wireless imaging has become a vital function in future integrated sensing and communication (ISAC) systems. However, traditional model-based and data-driven deep learning imaging methods face challenges related to multipath extraction,…

Information Theory · Computer Science 2026-02-13 Yixuan Huang , Jie Yang , Chao-Kai Wen , Shi Jin

Geometric shape features have been widely used as strong predictors for image classification. Nevertheless, most existing classifiers such as deep neural networks (DNNs) directly leverage the statistical correlations between these shape…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Tonmoy Hossain , Jing Ma , Jundong Li , Miaomiao Zhang

Implicit neural representations (INRs) have recently emerged as a promising alternative to classical discretized representations of signals. Nevertheless, despite their practical success, we still do not understand how INRs represent…

Machine Learning · Computer Science 2022-03-28 Gizem Yüce , Guillermo Ortiz-Jiménez , Beril Besbinar , Pascal Frossard

Implicit neural representation (INR) has proven to be accurate and efficient in various domains. In this work, we explore how different neural networks can be designed as a new texture INR, which operates in a continuous manner rather than…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Albert Kwok , Zheyuan Hu , Dounia Hammou

Implicit Neural Representations (INRs) are a novel paradigm for signal representation that have attracted considerable interest for image compression. INRs offer unprecedented advantages in signal resolution and memory efficiency, enabling…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Marcos V. Conde , Andy Bigos , Radu Timofte