English
Related papers

Related papers: Transformers as Meta-Learners for Implicit Neural …

200 papers

Implicit Neural Representation (INR) has been emerging in computer vision in recent years. It has been shown to be effective in parameterising continuous signals such as dense 3D models from discrete image data, e.g. the neural radius field…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Wentian Xu , Jianbo Jiao

Implicit neural representations (INRs) have gained prominence as a powerful paradigm in scene reconstruction and computer graphics, demonstrating remarkable results. By utilizing neural networks to parameterize data through implicit…

Image and Video Processing · Electrical Eng. & Systems 2023-08-01 Amirali Molaei , Amirhossein Aminimehr , Armin Tavakoli , Amirhossein Kazerouni , Bobby Azad , Reza Azad , Dorit Merhof

Materials discovery is crucial for making scientific advances in many domains. Collections of data from experiments and first-principle computations have spurred interest in applying machine learning methods to create predictive models…

Implicit Neural Representations (INRs) are a learning-based approach to accelerate Magnetic Resonance Imaging (MRI) acquisitions, particularly in scan-specific settings when only data from the under-sampled scan itself are available.…

Image and Video Processing · Electrical Eng. & Systems 2024-12-11 Yamin Arefeen , Brett Levac , Zach Stoebner , Jonathan Tamir

Recurrent neural networks (RNNs) are known to be difficult to train due to the gradient vanishing and exploding problems and thus difficult to learn long-term patterns and construct deep networks. To address these problems, this paper…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Shuai Li , Wanqing Li , Chris Cook , Yanbo Gao

Neural Metamorphosis (NeuMeta) is a recent paradigm for generating neural networks of varying width and depth. Based on Implicit Neural Representation (INR), NeuMeta learns a continuous weight manifold, enabling the direct generation of…

Neural and Evolutionary Computing · Computer Science 2025-10-15 Thomas Sommariva , Simone Calderara , Angelo Porrello

Generalizable implicit neural representation (INR) enables a single continuous function, i.e., a coordinate-based neural network, to represent multiple data instances by modulating its weights or intermediate features using latent codes.…

Machine Learning · Computer Science 2023-10-13 Doyup Lee , Chiheon Kim , Minsu Cho , Wook-Shin Han

Implicit neural representations (INRs) encode images as neural-network weights, making image classification a problem of weight-space classifiability. A natural geometric hypothesis is that classifier feedback should make image-specific…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Xinyi Guo , Mingyi He , Haobin Ding , Weiming Chen , Xinrui Chen , Jiawen Li , Di Zhang , Minxi Ouyang , Yizhi Wang , Xitong Ling

Implicit Neural Representations (INR) use multilayer perceptrons to represent high-frequency functions in low-dimensional problem domains. Recently these representations achieved state-of-the-art results on tasks related to complex 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Nuri Benbarka , Timon Höfer , Hamd ul-moqeet Riaz , Andreas Zell

Recurrent Neural Networks were, until recently, one of the best ways to capture the timely dependencies in sequences. However, with the introduction of the Transformer, it has been proven that an architecture with only attention-mechanisms…

Machine Learning · Computer Science 2021-08-19 Radostin Cholakov , Todor Kolev

The remarkable capability of Transformers to do reasoning and few-shot learning, without any fine-tuning, is widely conjectured to stem from their ability to implicitly simulate a multi-step algorithms -- such as gradient descent -- with…

Machine Learning · Computer Science 2024-10-14 Khashayar Gatmiry , Nikunj Saunshi , Sashank J. Reddi , Stefanie Jegelka , Sanjiv Kumar

Implicit neural representations (INRs) have emerged as a powerful tool for compressing large-scale volume data. This opens up new possibilities for in situ visualization. However, the efficient application of INRs to distributed data…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-23 Qi Wu , Joseph A. Insley , Victor A. Mateevitsi , Silvio Rizzi , Michael E. Papka , Kwan-Liu Ma

Transformers have shown a remarkable ability for in-context learning (ICL), making predictions based on contextual examples. However, while theoretical analyses have explored this prediction capability, the nature of the inferred context…

Machine Learning · Computer Science 2025-05-20 Fei Lu , Yue Yu

Applications of Implicit Neural Representations (INRs) have emerged as a promising deep learning approach for compactly representing large volumetric datasets. These models can act as surrogates for volume data, enabling efficient storage…

Machine Learning · Computer Science 2026-01-27 Shanu Saklani , Tushar M. Athawale , Nairita Pal , David Pugmire , Christopher R. Johnson , Soumya Dutta

X-ray Computed Tomography (CT) is widely used in clinical applications such as diagnosis and image-guided interventions. In this paper, we propose a new deep learning based model for CT image reconstruction with the backbone network…

Image and Video Processing · Electrical Eng. & Systems 2020-09-21 Haimiao Zhang , Baodong Liu , Hengyong Yu , Bin Dong

Hyperspectral image (HSI) super-resolution without additional auxiliary image remains a constant challenge due to its high-dimensional spectral patterns, where learning an effective spatial and spectral representation is a fundamental…

Image and Video Processing · Electrical Eng. & Systems 2021-12-21 Kaiwei Zhang

We present a novel approach for super-resolution that utilizes implicit neural representation (INR) to effectively reconstruct and enhance low-resolution videos and images. By leveraging the capacity of neural networks to implicitly encode…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Mary Aiyetigbo , Wanqi Yuan , Feng Luo , Nianyi Li

Graph Neural Networks (GNNs) are a framework for graph representation learning, where a model learns to generate low dimensional node embeddings that encapsulate structural and feature-related information. GNNs are usually trained in an…

Machine Learning · Computer Science 2020-12-15 Davide Buffelli , Fabio Vandin

To what extent is the success of deep visualization due to the training? Could we do deep visualization using untrained, random weight networks? To address this issue, we explore new and powerful generative models for three popular deep…

Computer Vision and Pattern Recognition · Computer Science 2016-06-17 Kun He , Yan Wang , John Hopcroft

Implicit Neural Representations (INRs) are a novel paradigm for signal representation that have attracted considerable interest for image compression. INRs offer unprecedented advantages in signal resolution and memory efficiency, enabling…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Marcos V. Conde , Andy Bigos , Radu Timofte