English
Related papers

Related papers: UMAMI: Unifying Masked Autoregressive Models and D…

200 papers

Although neural radiance fields (NeRFs) have achieved triumphs in image novel view synthesis (NVS), LiDAR NVS remains largely unexplored. Previous LiDAR NVS methods employ a simple shift from image NVS methods while ignoring the dynamic…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Zehan Zheng , Fan Lu , Weiyi Xue , Guang Chen , Changjun Jiang

Novel-view synthesis (NVS) approaches play a critical role in vast scene reconstruction. However, these methods rely heavily on dense image inputs and prolonged training times, making them unsuitable where computational resources are…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Hao Li , Yuanyuan Gao , Haosong Peng , Chenming Wu , Weicai Ye , Yufeng Zhan , Chen Zhao , Dingwen Zhang , Jingdong Wang , Junwei Han

Novel View Synthesis (NVS) is concerned with synthesizing views under camera viewpoint transformations from one or multiple input images. NVS requires explicit reasoning about 3D object structure and unseen parts of the scene to synthesize…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Nicolai Häni , Selim Engin , Jun-Jee Chao , Volkan Isler

View synthesis aims to generate novel views from one or more given source views. Although existing methods have achieved promising performance, they usually require paired views of different poses to learn a pixel transformation. This paper…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Bingzheng Liu , Jianjun Lei , Bo Peng , Chuanbo Yu , Wanqing Li , Nam Ling

Feedforward models for novel view synthesis (NVS) have recently advanced by transformer-based methods like LVSM, using attention among all input and target views. In this work, we argue that its full self-attention design is suboptimal,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Xiaosong Jia , Yihang Sun , Junqi You , Songbur Wong , Zichen Zou , Junchi Yan , Zuxuan Wu , Yu-Gang Jiang

The goal of Novel View Synthesis (NVS) is to generate realistic images of a given content from unseen viewpoints. But how can we trust that a generated image truly reflects the intended transformation? Evaluating its reliability remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Saar Stern , Ido Sobol , Or Litany

Recent breakthroughs in radiance fields have significantly advanced 3D scene reconstruction and novel view synthesis (NVS) in autonomous driving. Nevertheless, critical limitations persist: reconstruction-based methods exhibit substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Yingshuang Zou , Yikang Ding , Chuanrui Zhang , Jiazhe Guo , Bohan Li , Xiaoyang Lyu , Feiyang Tan , Xiaojuan Qi , Haoqian Wang

View synthesis is a process for generating novel views from a scene which has been recorded with a 3-D camera setup. It has important applications in 3-D post-production and 2-D to 3-D conversion. However, a central problem in the…

Computer Vision and Pattern Recognition · Computer Science 2014-06-25 Julian Habigt , Klaus Diepold

Photographs captured in unstructured tourist environments frequently exhibit variable appearances and transient occlusions, challenging accurate scene reconstruction and inducing artifacts in novel view synthesis. Although prior approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Jiacong Xu , Yiqun Mei , Vishal M. Patel

Text-to-image diffusion models generate impressive and realistic images, but do they learn to represent the 3D world from only 2D supervision? We demonstrate that yes, certain 3D scene representations are encoded in the text embedding space…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 James Burgess , Kuan-Chieh Wang , Serena Yeung-Levy

Mesh reconstruction from multi-view images is a fundamental problem in computer vision, but its performance degrades significantly under sparse-view conditions, especially in unseen regions where no ground-truth observations are available.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Haoyang Wang , Liming Liu , Peiheng Wang , Junlin Hao , Jiangkai Wu , Xinggong Zhang

We present MVD-Fusion: a method for single-view 3D inference via generative modeling of multi-view-consistent RGB-D images. While recent methods pursuing 3D inference advocate learning novel-view generative models, these generations are not…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Hanzhe Hu , Zhizhuo Zhou , Varun Jampani , Shubham Tulsiani

Scene view synthesis, which generates novel views from limited perspectives, is increasingly vital for applications like virtual reality, augmented reality, and robotics. Unlike object-based tasks, such as generating 360{\deg} views of a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Xiaofeng Jin , Yan Fang , Matteo Frosi , Jianfei Ge , Jiangjian Xiao , Matteo Matteucci

We introduce a single-view reconstruction technique of volumetric fields in which multiple light scattering effects are omnipresent, such as in clouds. We model the unknown distribution of volumetric fields using an unconditional diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Ludwic Leonard , Nils Thuerey , Ruediger Westermann

We introduce Free3D, a simple accurate method for monocular open-set novel view synthesis (NVS). Similar to Zero-1-to-3, we start from a pre-trained 2D image generator for generalization, and fine-tune it for NVS. Compared to other works…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Chuanxia Zheng , Andrea Vedaldi

Photo-realistic free-viewpoint rendering of real-world scenes using classical computer graphics techniques is challenging, because it requires the difficult step of capturing detailed appearance and geometry models. Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Lingjie Liu , Jiatao Gu , Kyaw Zaw Lin , Tat-Seng Chua , Christian Theobalt

Generative models have gained significant attention in novel view synthesis (NVS) by alleviating the reliance on dense multi-view captures. However, existing methods typically fall into a conventional paradigm, where generative models first…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Weiliang Chen , Jiayi Bi , Yuanhui Huang , Wenzhao Zheng , Yueqi Duan

One of the most critical factors in achieving sharp Novel View Synthesis (NVS) using neural field methods like Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) is the quality of the training images. However, Conventional RGB…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Gaole Dai , Zhenyu Wang , Qinwen Xu , Ming Lu , Wen Chen , Boxin Shi , Shanghang Zhang , Tiejun Huang

Novel View Synthesis (NVS) from sparse views presents a formidable challenge in 3D reconstruction, where limited multi-view constraints lead to severe overfitting, geometric distortion, and fragmented scenes. While 3D Gaussian Splatting…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Yu Ma , Guoliang Wei , Haihong Xiao , Yue Cheng

Novel-view synthesis plays a crucial role in computer vision with applications in 3D reconstruction, mixed reality, and robotics. Recent approaches, such as 3D Gaussian Splatting (3DGS), have emerged as state-of-the-art solutions, offering…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Ankit Dhiman , Tao Lu , R Srinath , Emre Arslan , Angela Xing , Yuanbo Xiangli , R Venkatesh Babu , Srinath Sridhar