English
Related papers

Related papers: Self-Supervised Visibility Learning for Novel View…

200 papers

We represent the ResNeRF, a novel geometry-guided two-stage framework for indoor scene novel view synthesis. Be aware of that a good geometry would greatly boost the performance of novel view synthesis, and to avoid the geometry ambiguity…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Yuting Xiao , Yiqun Zhao , Yanyu Xu , Shenghua Gao

We present PVSeRF, a learning framework that reconstructs neural radiance fields from single-view RGB images, for novel view synthesis. Previous solutions, such as pixelNeRF, rely only on pixel-aligned features and suffer from feature…

Computer Vision and Pattern Recognition · Computer Science 2022-02-11 Xianggang Yu , Jiapeng Tang , Yipeng Qin , Chenghong Li , Linchao Bao , Xiaoguang Han , Shuguang Cui

High dynamic range (HDR) novel view synthesis (NVS) aims to create photorealistic images from novel viewpoints using HDR imaging techniques. The rendered HDR images capture a wider range of brightness levels containing more details of the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yuanhao Cai , Zihao Xiao , Yixun Liang , Minghan Qin , Yulun Zhang , Xiaokang Yang , Yaoyao Liu , Alan Yuille

We present a new system (NPBG++) for the novel view synthesis (NVS) task that achieves high rendering realism with low scene fitting time. Our method efficiently leverages the multiview observations and the point cloud of a static scene to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Ruslan Rakhimov , Andrei-Timotei Ardelean , Victor Lempitsky , Evgeny Burnaev

Repurposing pre-trained diffusion models has been proven to be effective for NVS. However, these methods are mostly limited to a single object; directly applying such methods to compositional multi-object scenarios yields inferior results,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Ruijie Lu , Yixin Chen , Junfeng Ni , Baoxiong Jia , Yu Liu , Diwen Wan , Gang Zeng , Siyuan Huang

Given just a few glimpses of a scene, can you imagine the movie playing out as the camera glides through it? That's the lens we take on \emph{sparse-input novel view synthesis}, not only as filling spatial gaps between widely spaced views,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Yan Xu , Yixing Wang , Stella X. Yu

The generation of high-fidelity view synthesis is essential for robotic navigation and interaction but remains challenging, particularly in indoor environments and real-time scenarios. Existing techniques often require significant…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Sen Wang , Qing Cheng , Stefano Gasperini , Wei Zhang , Shun-Cheng Wu , Niclas Zeller , Daniel Cremers , Nassir Navab

Existing neural rendering-based urban scene reconstruction methods mainly focus on the Interpolated View Synthesis (IVS) setting that synthesizes from views close to training camera trajectory. However, IVS can not guarantee the on-par…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Tianhang Wang , Fan Lu , Sanqing Qu , Guo Yu , Shihang Du , Ya Wu , Yuan Huang , Guang Chen

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

Diffusion-based approaches have recently demonstrated strong performance for single-image novel view synthesis by conditioning generative models on geometry inferred from monocular depth estimation. However, in practice, the quality and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Amirhosein Javadi , Chi-Shiang Gau , Konstantinos D. Polyzos , Tara Javidi

We propose VISION-SLS, a method for nonlinear output-feedback control from high-resolution RGB images which provides robust constraint satisfaction guarantees under calibrated uncertainty bounds despite partial observability, sensor noise,…

Robotics · Computer Science 2026-04-29 Antoine P. Leeman , Shuyu Zhan , Melanie N. Zeilinger , Glen Chou

Rendering scenes with a high-quality human face from arbitrary viewpoints is a practical and useful technique for many real-world applications. Recently, Neural Radiance Fields (NeRF), a rendering technique that uses neural networks to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Satoshi Tsutsui , Weijia Mao , Sijing Lin , Yunyi Zhu , Murong Ma , Mike Zheng Shou

In this study, we present a method for synthesizing novel views from a single 360-degree RGB-D image based on the neural radiance field (NeRF) . Prior studies relied on the neighborhood interpolation capability of multi-layer perceptrons to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Takayuki Hara , Tatsuya Harada

Despite the photorealistic novel view synthesis (NVS) performance achieved by the original 3D Gaussian splatting (3DGS), its rendering quality significantly degrades with sparse input views. This performance drop is mainly caused by the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Zhenyu Bao , Guibiao Liao , Kaichen Zhou , Kanglin Liu , Qing Li , Guoping Qiu

This paper addresses the problem of novel view synthesis by means of neural rendering, where we are interested in predicting the novel view at an arbitrary camera pose based on a given set of input images from other viewpoints. Using the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Phong Nguyen-Ha , Lam Huynh , Esa Rahtu , Janne Heikkila

Novel view synthesis for dynamic $3$D scenes poses a significant challenge. Many notable efforts use NeRF-based approaches to address this task and yield impressive results. However, these methods rely heavily on sufficient motion parallax…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Huiqiang Sun , Xingyi Li , Juewen Peng , Liao Shen , Zhiguo Cao , Ke Xian , Guosheng Lin

In the last few years, deep neural networks opened the doors for big advances in novel view synthesis. Many of these approaches are based on a (coarse) proxy geometry obtained by structure from motion algorithms. Small deficiencies in this…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Linus Franke , Darius Rückert , Laura Fink , Matthias Innmann , Marc Stamminger

Depth-image-based rendering is a key view synthesis algorithm in 3D video systems, which enables the synthesis of virtual views from texture images and depth maps. An efficient view synthesis distortion estimation model is critical for…

Image and Video Processing · Electrical Eng. & Systems 2025-10-21 Chongyuan Bi , Jie Liang

Large transformer-based models have made significant progress in generalizable novel view synthesis (NVS) from sparse input views, generating novel viewpoints without the need for test-time optimization. However, these models are…

Recently, various view synthesis distortion estimation models have been studied to better serve for 3-D video coding. However, they can hardly model the relationship quantitatively among different levels of depth changes, texture…

Image and Video Processing · Electrical Eng. & Systems 2022-01-10 Jian Jin , Xingxing Zhang , Lili Meng , Weisi Lin , Jie Liang , Huaxiang Zhang , Yao Zhao