English
Related papers

Related papers: PDEfuncta: Spectrally-Aware Neural Representation …

200 papers

Implicit Neural Representations (INR) use multilayer perceptrons to represent high-frequency functions in low-dimensional problem domains. Recently these representations achieved state-of-the-art results on tasks related to complex 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Nuri Benbarka , Timon Höfer , Hamd ul-moqeet Riaz , Andreas Zell

Neural time-series analysis has traditionally focused on modeling data in the time domain, often with some approaches incorporating equivalent Fourier domain representations as auxiliary spectral features. In this work, we shift the main…

Machine Learning · Computer Science 2024-10-08 Minjung Kim , Yusuke Hioka , Michael Witbrock

Image stacks provide invaluable 3D information in various biological and pathological imaging applications. Fourier ptychographic microscopy (FPM) enables reconstructing high-resolution, wide field-of-view image stacks without z-stack…

Implicit neural representations (INRs) have emerged as a powerful framework for continuous image representation learning. In Functa-based approaches, each image is encoded as a latent modulation vector that conditions a shared INR, enabling…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Julia Wolleb , Cristiana Baloescu , Alicia Durrer , Hemant D. Tagare , Xenophon Papademetris

We consider solving complex spatiotemporal dynamical systems governed by partial differential equations (PDEs) using frequency domain-based discrete learning approaches, such as Fourier neural operators. Despite their widespread use for…

Machine Learning · Computer Science 2024-07-17 Qingsong Xu , Nils Thuerey , Yilei Shi , Jonathan Bamber , Chaojun Ouyang , Xiao Xiang Zhu

Physics-Informed Neural Networks (PINNs) have advanced the data-driven solution of differential equations (DEs) in dynamic physical systems, yet challenges remain in explainability, scalability, and architectural complexity. This paper…

Signal Processing · Electrical Eng. & Systems 2025-12-03 Ibrahim Shahbaz , Mohammad J. Abdel-Rahman , Eman Hammad

Methods based on implicit neural representation have demonstrated remarkable capabilities in arbitrary-scale super-resolution (ASSR) tasks, but they neglect the potential value of the frequency domain, leading to sub-optimal performance. We…

Machine Learning · Computer Science 2025-04-29 Xufei Wang , Fei Ge , Jinchen Zhu , Mingjian Zhang , Qi Wu , Jifeng Ren Shizhuang Weng

Implicit Neural Representations (INRs) have emerged as a powerful alternative to traditional pixel-based formats by modeling images as continuous functions over spatial coordinates. A key challenge, however, lies in the spectral bias of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Sumit Kumar Dam , Mrityunjoy Gain , Eui-Nam Huh , Choong Seon Hong

Physics-Informed Neural Networks (PINNs) have emerged as a promising deep learning framework for approximating numerical solutions to partial differential equations (PDEs). However, conventional PINNs, relying on multilayer perceptrons…

Computational Engineering, Finance, and Science · Computer Science 2024-05-08 Zhiyuan Zhao , Xueying Ding , B. Aditya Prakash

The research community has witnessed the powerful potential of self-supervised Masked Image Modeling (MIM), which enables the models capable of learning visual representation from unlabeled data. In this paper, to incorporate both the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Wenxuan Wang , Jing Wang , Chen Chen , Jianbo Jiao , Yuanxiu Cai , Shanshan Song , Jiangyun Li

Implicit Neural Representations (INRs) have emerged and shown their benefits over discrete representations in recent years. However, fitting an INR to the given observations usually requires optimization with gradient descent from scratch,…

Machine Learning · Computer Science 2022-08-08 Yinbo Chen , Xiaolong Wang

Discrete transforms, such as the discrete Fourier transform, are widely used in machine learning to improve model performance by extracting meaningful features. However, with numerous transforms available, selecting an appropriate one often…

Machine Learning · Computer Science 2025-05-09 Gekko Budiutama , Shunsuke Daimon , Hirofumi Nishi , Yu-ichiro Matsushita

Portrait Fidelity Generation is a prominent research area in generative models.Current methods face challenges in generating full-body images with low-resolution faces, especially in multi-ID photo phenomenon.To tackle these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Zhaoli Deng , Fanyi Wang , Junkang Zhang , Fan Chen , Meng Zhang , Wendong Zhang , Wen Liu , Zhenpeng Mi

Deep learning surrogate models have shown promise in solving partial differential equations (PDEs). Among them, the Fourier neural operator (FNO) achieves good accuracy, and is significantly faster compared to numerical solvers, on a…

Machine Learning · Computer Science 2024-05-03 Zongyi Li , Daniel Zhengyu Huang , Burigede Liu , Anima Anandkumar

Neural fields, also known as implicit neural representations, have emerged as a powerful means to represent complex signals of various modalities. Based on this Dupont et al. (2022) introduce a framework that views neural fields as data,…

Machine Learning · Computer Science 2023-02-10 Matthias Bauer , Emilien Dupont , Andy Brock , Dan Rosenbaum , Jonathan Richard Schwarz , Hyunjik Kim

Implicit neural representations (INRs) have emerged as powerful tools for encoding signals, yet dominant MLP-based designs often suffer from slow convergence, overfitting to noise, and poor extrapolation. We introduce FUTON (Fourier Tensor…

Image and Video Processing · Electrical Eng. & Systems 2026-02-17 Pooya Ashtari , Pourya Behmandpoor , Nikos Deligiannis , Aleksandra Pizurica

Physics-Informed Neural Networks have become a powerful mesh-free method for solving partial differential equations, but their performance is often limited by spectral bias. Specifically, in standard MLPs used in PINNs, the global parameter…

Machine Learning · Computer Science 2026-05-04 Jianfeng Li , Feng Wang , Ke Tang

Recently, deep-learning-based approaches have been widely studied for deformable image registration task. However, most efforts directly map the composite image representation to spatial transformation through the convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2022-07-08 Jiashun Chen , Donghuan Lu , Yu Zhang , Dong Wei , Munan Ning , Xinyu Shi , Zhe Xu , Yefeng Zheng

Implicit Neural Representations (INRs) model signals as continuous, differentiable functions. However, monolithic INRs scale poorly with data dimensionality, leading to excessive training costs. We propose F-INR, a framework that addresses…

Machine Learning · Computer Science 2025-11-27 Sai Karthikeya Vemuri , Tim Büchner , Joachim Denzler

This paper presents a novel approach, Spectral-Interpretable and -Enhanced Transformer (SIEFormer), which leverages spectral analysis to reinterpret the attention mechanism within Vision Transformer (ViT) and enhance feature adaptability,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Chunming Li , Shidong Wang , Tong Xin , Haofeng Zhang