English
Related papers

Related papers: GM-NeRF: Learning Generalizable Model-based Neural…

200 papers

In recent years, novel view synthesis has gained popularity in generating high-fidelity images. While demonstrating superior performance in the task of synthesizing novel views, the majority of these methods are still based on the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Xiaoyan Yang , Dingbo Lu , Yang Li , Chenhui Li , Changbo Wang

We present a method to synthesize novel views from a single $360^\circ$ panorama image based on the neural radiance field (NeRF). Prior studies in a similar setting rely on the neighborhood interpolation capability of multi-layer…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Shreyas Kulkarni , Peng Yin , Sebastian Scherer

We present TimeNeRF, a generalizable neural rendering approach for rendering novel views at arbitrary viewpoints and at arbitrary times, even with few input views. For real-world applications, it is expensive to collect multiple views and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Hsiang-Hui Hung , Huu-Phu Do , Yung-Hui Li , Ching-Chun Huang

This paper addresses the challenge of Neural Field (NeF) generalization, where models must efficiently adapt to new signals given only a few observations. To tackle this, we propose Geometric Neural Process Fields (G-NPF), a probabilistic…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Wenzhe Yin , Zehao Xiao , Jiayi Shen , Yunlu Chen , Cees G. M. Snoek , Jan-Jakob Sonke , Efstratios Gavves

This paper presents a stylized novel view synthesis method. Applying state-of-the-art stylization methods to novel views frame by frame often causes jittering artifacts due to the lack of cross-view consistency. Therefore, this paper…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Thu Nguyen-Phuoc , Feng Liu , Lei Xiao

Novel view synthesis is a long-standing problem. In this work, we consider a variant of the problem where we are given only a few context views sparsely covering a scene or an object. The goal is to predict novel viewpoints in the scene,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Jonáš Kulhánek , Erik Derner , Torsten Sattler , Robert Babuška

Neural Radiance Field (NeRF) technology has made significant strides in creating novel viewpoints. However, its effectiveness is hampered when working with sparsely available views, often leading to performance dips due to overfitting.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Yuru Xiao , Xianming Liu , Deming Zhai , Kui Jiang , Junjun Jiang , Xiangyang Ji

Neural Radiance Fields (NeRFs) aim to synthesize novel views of objects and scenes, given the object-centric camera views with large overlaps. However, we conjugate that this paradigm does not fit the nature of the street views that are…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Ziyang Xie , Junge Zhang , Wenye Li , Feihu Zhang , Li Zhang

Recent neural human representations can produce high-quality multi-view rendering but require using dense multi-view inputs and costly training. They are hence largely limited to static models as training each frame is infeasible. We…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Fuqiang Zhao , Wei Yang , Jiakai Zhang , Pei Lin , Yingliang Zhang , Jingyi Yu , Lan Xu

We study the problem of novel view synthesis of objects from a single image. Existing methods have demonstrated the potential in single-view view synthesis. However, they still fail to recover the fine appearance details, especially in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Xingyi Li , Chaoyi Hong , Yiran Wang , Zhiguo Cao , Ke Xian , Guosheng Lin

Neural Radiance Fields (NeRF) have significantly advanced the field of novel view synthesis, yet their generalization across diverse scenes and conditions remains challenging. Addressing this, we propose the integration of a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Ahmed Qazi , Abdul Basit , Asim Iqbal

Neural Radiance Fields (NeRF) achieve photo-realistic view synthesis with densely captured input images. However, the geometry of NeRF is extremely under-constrained given sparse views, resulting in significant degradation of novel view…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Zheng Chen , Chen Wang , Yuan-Chen Guo , Song-Hai Zhang

3D-aware image generative modeling aims to generate 3D-consistent images with explicitly controllable camera poses. Recent works have shown promising results by training neural radiance field (NeRF) generators on unstructured 2D images, but…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Yu Deng , Jiaolong Yang , Jianfeng Xiang , Xin Tong

The neural radiance field (NERF) advocates learning the continuous representation of 3D geometry through a multilayer perceptron (MLP). By integrating this into a generative model, the generative neural radiance field (GRAF) is capable of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Jian Liu , Zhen Yu

In this paper, we present a novel and effective framework, named 4K-NeRF, to pursue high fidelity view synthesis on the challenging scenarios of ultra high resolutions, building on the methodology of neural radiance fields (NeRF). The…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Zhongshu Wang , Lingzhi Li , Zhen Shen , Li Shen , Liefeng Bo

Feature point detection and description is the backbone for various computer vision applications, such as Structure-from-Motion, visual SLAM, and visual place recognition. While learning-based methods have surpassed traditional handcrafted…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Ali Youssef , Francisco Vasconcelos

Neural rendering has received tremendous attention since the advent of Neural Radiance Fields (NeRF), and has pushed the state-of-the-art on novel-view synthesis considerably. The recent focus has been on models that overfit to a single…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Mohammed Suhail , Carlos Esteves , Leonid Sigal , Ameesh Makadia

Neural Radiance Fields (NeRF) is a revolutionary approach for rendering scenes by sampling a single ray per pixel and it has demonstrated impressive capabilities in novel-view synthesis from static scene images. However, in practice, we…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yifan Yang , Shuhai Zhang , Zixiong Huang , Yubing Zhang , Mingkui Tan

Neural Radiance Fields (NeRF) have demonstrated very impressive performance in novel view synthesis via implicitly modelling 3D representations from multi-view 2D images. However, most existing studies train NeRF models with either…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Jiahui Zhang , Fangneng Zhan , Rongliang Wu , Yingchen Yu , Wenqing Zhang , Bai Song , Xiaoqin Zhang , Shijian Lu

We present a new generalizable NeRF method that is able to directly generalize to new unseen scenarios and perform novel view synthesis with as few as two source views. The key to our approach lies in the explicitly modeled correspondence…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Yuedong Chen , Haofei Xu , Qianyi Wu , Chuanxia Zheng , Tat-Jen Cham , Jianfei Cai