English
Related papers

Related papers: Fourier PlenOctrees for Dynamic Radiance Field Ren…

200 papers

Vision transformers have delivered tremendous success in representation learning. This is primarily due to effective token mixing through self attention. However, this scales quadratically with the number of pixels, which becomes infeasible…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 John Guibas , Morteza Mardani , Zongyi Li , Andrew Tao , Anima Anandkumar , Bryan Catanzaro

Neural representation for video (NeRV), which employs a neural network to parameterize video signals, introduces a novel methodology in video representations. However, existing NeRV-based methods have difficulty in capturing fine spatial…

Image and Video Processing · Electrical Eng. & Systems 2025-01-06 Jina Kim , Jihoo Lee , Je-Won Kang

The computational efficiency of many neural operators, widely used for learning solutions of PDEs, relies on the fast Fourier transform (FFT) for performing spectral computations. As the FFT is limited to equispaced (rectangular) grids,…

We present a method to learn compositional multi-object dynamics models from image observations based on implicit object encoders, Neural Radiance Fields (NeRFs), and graph neural networks. NeRFs have become a popular choice for…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Danny Driess , Zhiao Huang , Yunzhu Li , Russ Tedrake , Marc Toussaint

Computational fluid dynamics (CFD) has become an essential tool for predicting fire behavior, yet maintaining both efficiency and accuracy remains challenging. A major source of computational cost in fire simulations is the modeling of…

Fluid Dynamics · Physics 2026-04-16 Anran Jiao , Wengyao Jiang , Xiaoyi Lu , Yi Wang , Lu Lu

Implicit neural representations (INRs) have emerged as powerful tools for encoding signals, yet dominant MLP-based designs often suffer from slow convergence, overfitting to noise, and poor extrapolation. We introduce FUTON (Fourier Tensor…

Image and Video Processing · Electrical Eng. & Systems 2026-02-17 Pooya Ashtari , Pourya Behmandpoor , Nikos Deligiannis , Aleksandra Pizurica

This paper presents ER-NeRF, a novel conditional Neural Radiance Fields (NeRF) based architecture for talking portrait synthesis that can concurrently achieve fast convergence, real-time rendering, and state-of-the-art performance with…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Jiahe Li , Jiawei Zhang , Xiao Bai , Jun Zhou , Lin Gu

We present ZeroRF, a novel per-scene optimization method addressing the challenge of sparse view 360{\deg} reconstruction in neural field representations. Current breakthroughs like Neural Radiance Fields (NeRF) have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Ruoxi Shi , Xinyue Wei , Cheng Wang , Hao Su

In this paper, we address the challenge of generating novel views of real-world objects with limited multi-view images through our proposed approach, FewShotNeRF. Our method utilizes meta-learning to acquire optimal initialization,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Piraveen Sivakumar , Paul Janson , Jathushan Rajasegaran , Thanuja Ambegoda

Novel view synthesis is a long-standing problem that revolves around rendering frames of scenes from novel camera viewpoints. Volumetric approaches provide a solution for modeling occlusions through the explicit 3D representation of the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Youssef Abdelkareem , Shady Shehata , Fakhri Karray

Neural Radiance Fields (NeRF) have shown impressive performance in novel view synthesis, but challenges remain in rendering scenes with complex specular reflections and highlights. Existing approaches may produce blurry reflections due to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Wenpeng Xing , Jie Chen , Zaifeng Yang , Tiancheng Zhao , Gaolei Li , Changting Lin , Yike Guo , Meng Han

Partial differential equations (PDEs) govern a wide variety of dynamical processes in science and engineering, yet obtaining their numerical solutions often requires high-resolution discretizations and repeated evaluations of complex…

Machine Learning · Computer Science 2026-01-26 Valentin Duruisseaux , Jean Kossaifi , Anima Anandkumar

Perception of the full state is an essential technology to support the monitoring, analysis, and design of physical systems, one of whose challenges is to recover global field from sparse observations. Well-known for brilliant approximation…

Artificial Intelligence · Computer Science 2023-02-21 Xiaoyu Zhao , Xiaoqian Chen , Zhiqiang Gong , Weien Zhou , Wen Yao , Yunyang Zhang

Existing neural radiance fields (NeRF) methods for large-scale scene modeling require days of training using multiple GPUs, hindering their applications in scenarios with limited computing resources. Despite fast optimization NeRF variants…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Yuqi Zhang , Guanying Chen , Shuguang Cui

NeRF is a popular model that efficiently represents 3D objects from 2D images. However, vanilla NeRF has some important limitations. NeRF must be trained on each object separately. The training time is long since we encode the object's…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Dominik Zimny , Artur Kasymov , Adam Kania , Jacek Tabor , Maciej Zięba , Marcin Mazur , Przemysław Spurek

The conventional mesh-based Level of Detail (LoD) technique, exemplified by applications such as Google Earth and many game engines, exhibits the capability to holistically represent a large scene even the Earth, and achieves rendering with…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Jiabin Liang , Lanqing Zhang , Zhuoran Zhao , Xiangyu Xu

Neural Operators (NOs) are a leading method for surrogate modeling of partial differential equations. Unlike traditional neural networks, which approximate individual functions, NOs learn the mappings between function spaces. While NOs have…

Astrophysics of Galaxies · Physics 2025-08-01 Keith Poletti , Stella S. R. Offner , Rachel A. Ward

Fourier Neural Operators (FNOs) have proven to be an efficient and effective method for resolution-independent operator learning in a broad variety of application areas across scientific machine learning. A key reason for their success is…

Novel view synthesis using neural radiance fields (NeRF) is the state-of-the-art technique for generating high-quality images from novel viewpoints. Existing methods require a priori knowledge about extrinsic and intrinsic camera…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Hannah Schieber , Fabian Deuser , Bernhard Egger , Norbert Oswald , Daniel Roth

This project presents an exploration into 3D scene reconstruction of synthetic and real-world scenes using Neural Radiance Field (NeRF) approaches. We primarily take advantage of the reduction in training and rendering time of neural…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Benedict Quartey , Tuluhan Akbulut , Wasiwasi Mgonzo , Zheng Xin Yong