English
Related papers

Related papers: NOIR: Neural Operator mapping for Implicit Represe…

200 papers

While variational methods have been among the most powerful tools for solving linear inverse problems in imaging, deep (convolutional) neural networks have recently taken the lead in many challenging benchmarks. A remaining drawback of deep…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Tim Meinhardt , Michael Moeller , Caner Hazirbas , Daniel Cremers

Existing frameworks for image stitching often provide visually reasonable stitchings. However, they suffer from blurry artifacts and disparities in illumination, depth level, etc. Although the recent learning-based stitchings relax such…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Minsu Kim , Jaewon Lee , Byeonghun Lee , Sunghoon Im , Kyong Hwan Jin

For collecting high-quality high-resolution (HR) MR image, we propose a novel image reconstruction network named IREM, which is trained on multiple low-resolution (LR) MR images and achieve an arbitrary up-sampling rate for HR image…

Image and Video Processing · Electrical Eng. & Systems 2021-06-30 Qing Wu , Yuwei Li , Lan Xu , Ruiming Feng , Hongjiang Wei , Qing Yang , Boliang Yu , Xiaozhao Liu , Jingyi Yu , Yuyao Zhang

Representing surfaces as zero level sets of neural networks recently emerged as a powerful modeling paradigm, named Implicit Neural Representations (INRs), serving numerous downstream applications in geometric deep learning and 3D vision.…

Machine Learning · Computer Science 2021-06-16 Yaron Lipman

Recently Implicit Neural Representations (INRs) gained attention as a novel and effective representation for various data types. Thus far, prior work mostly focused on optimizing their reconstruction performance. This work investigates INRs…

Image and Video Processing · Electrical Eng. & Systems 2022-08-05 Yannick Strümpler , Janis Postels , Ren Yang , Luc van Gool , Federico Tombari

Recently, Implicit Neural Representations (INRs) parameterized by neural networks have emerged as a powerful and promising tool to represent different kinds of signals due to its continuous, differentiable properties, showing superiorities…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Wentao Yuan , Qingtian Zhu , Xiangyue Liu , Yikang Ding , Haotian Zhang , Chi Zhang

Continuous signal representations are naturally suited for inverse problems, such as magnetic resonance imaging (MRI) and computed tomography, because the measurements depend on an underlying physically continuous signal. While classical…

Signal Processing · Electrical Eng. & Systems 2026-02-26 Hongze Yu , Yun Jiang , Jeffrey A. Fessler

To make sense of their surroundings, intelligent systems must transform complex sensory inputs to structured codes that are reduced to task-relevant information such as object category. Biological agents achieve this in a largely autonomous…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Robin Weiler , Matthias Brucklacher , Cyriel M. A. Pennartz , Sander M. Bohté

Deep learning-based image processing is capable of creating highly appealing results. However, it is still widely considered as a "blackbox" transformation. In medical imaging, this lack of comprehensibility of the results is a sensitive…

Image and Video Processing · Electrical Eng. & Systems 2020-05-29 Bernhard Stimpel , Christopher Syben , Franziska Schirrmacher , Philipp Hoelter , Arnd Dörfler , Andreas Maier

Neural operators can learn nonlinear mappings between function spaces and offer a new simulation paradigm for real-time prediction of complex dynamics for realistic diverse applications as well as for system identification in science and…

Computational Physics · Physics 2022-03-23 Lu Lu , Xuhui Meng , Shengze Cai , Zhiping Mao , Somdatta Goswami , Zhongqiang Zhang , George Em Karniadakis

In many computer vision applications, images are acquired with arbitrary or random rotations and translations, and in such setups, it is desirable to obtain semantic representations disentangled from the image orientation. Examples of such…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Sehyun Kwon , Joo Young Choi , Ernest K. Ryu

We introduce a modality-agnostic neural compression algorithm based on a functional view of data and parameterised as an Implicit Neural Representation (INR). Bridging the gap between latent coding and sparsity, we obtain compact latent…

Machine Learning · Statistics 2023-04-10 Jonathan Richard Schwarz , Jihoon Tack , Yee Whye Teh , Jaeho Lee , Jinwoo Shin

Implicit neural representations (INRs) have recently advanced numerous vision-related areas. INR performance depends strongly on the choice of the nonlinear activation function employed in its multilayer perceptron (MLP) network. A wide…

Computer Vision and Pattern Recognition · Computer Science 2023-01-13 Vishwanath Saragadam , Daniel LeJeune , Jasper Tan , Guha Balakrishnan , Ashok Veeraraghavan , Richard G. Baraniuk

Image registration is essential for medical image applications where alignment of voxels across multiple images is needed for qualitative or quantitative analysis. With recent advancements in deep neural networks and parallel computing,…

Image and Video Processing · Electrical Eng. & Systems 2025-07-23 Yi Zhang , Yidong Zhao , Hui Xue , Peter Kellman , Stefan Klein , Qian Tao

Deep Learning has emerged as one of the most significant innovations in machine learning. However, a notable limitation of this field lies in the ``black box" decision-making processes, which have led to skepticism within groups like…

Machine Learning · Computer Science 2025-03-06 Shi Li

In Deep Image Prior (DIP), a Convolutional Neural Network (CNN) is fitted to map a latent space to a degraded (e.g. noisy) image but in the process learns to reconstruct the clean image. This phenomenon is attributed to CNN's internal…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Nimrod Shabtay , Eli Schwartz , Raja Giryes

A large class of inverse problems for PDEs are only well-defined as mappings from operators to functions. Existing operator learning frameworks map functions to functions and need to be modified to learn inverse maps from data. We propose a…

Machine Learning · Computer Science 2023-06-06 Roberto Molinaro , Yunan Yang , Björn Engquist , Siddhartha Mishra

Implicit neural representations (INR) suffer from worsening spectral bias, which results in overly smooth solutions to the inverse problem. To deal with this problem, we propose a universal framework for processing inverse problems called…

Machine Learning · Computer Science 2024-04-24 Yang Chen , Ruituo Wu , Yipeng Liu , Ce Zhu

Operator learning is a variant of machine learning that is designed to approximate maps between function spaces from data. The Fourier Neural Operator (FNO) is one of the main model architectures used for operator learning. The FNO combines…

Numerical Analysis · Mathematics 2025-09-29 Samuel Lanthaler , Andrew M. Stuart , Margaret Trautner

Neural operators serve as fast, data-driven surrogates for scientific modeling but typically rely on a monolithic, single-pass inference procedure that struggles to resolve high-frequency details, a limitation known as spectral bias. We…

Machine Learning · Computer Science 2026-05-27 Xiaotian Liu , Shuyuan Shang , Xiaopeng Wang , Pu Ren , Yaoqing Yang