English
Related papers

Related papers: Novel View Synthesis with Pixel-Space Diffusion Mo…

200 papers

Reconstructing 3D scenes and synthesizing novel views from sparse input views is a highly challenging task. Recent advances in video diffusion models have demonstrated strong temporal reasoning capabilities, making them a promising tool for…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yuqi Zhang , Guanying Chen , Jiaxing Chen , Chuanyu Fu , Chuan Huang , Shuguang Cui

Large image diffusion models have demonstrated zero-shot capability in novel view synthesis (NVS). However, existing diffusion-based NVS methods struggle to generate novel views that are accurately consistent with the corresponding ground…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Hongxiang Zhao , Xili Dai , Jianan Wang , Shengbang Tong , Jingyuan Zhang , Weida Wang , Lei Zhang , Yi Ma

The recent advent of large-scale 3D data, e.g. Objaverse, has led to impressive progress in training pose-conditioned diffusion models for novel view synthesis. However, due to the synthetic nature of such 3D data, their performance drops…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Chuang Lin , Bingbing Zhuang , Shanlin Sun , Ziyu Jiang , Jianfei Cai , Manmohan Chandraker

We present a new system (NPBG++) for the novel view synthesis (NVS) task that achieves high rendering realism with low scene fitting time. Our method efficiently leverages the multiview observations and the point cloud of a static scene to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Ruslan Rakhimov , Andrei-Timotei Ardelean , Victor Lempitsky , Evgeny Burnaev

We propose UpFusion, a system that can perform novel view synthesis and infer 3D representations for an object given a sparse set of reference images without corresponding pose information. Current sparse-view 3D inference methods typically…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Bharath Raj Nagoor Kani , Hsin-Ying Lee , Sergey Tulyakov , Shubham Tulsiani

We introduce Free3D, a simple accurate method for monocular open-set novel view synthesis (NVS). Similar to Zero-1-to-3, we start from a pre-trained 2D image generator for generalization, and fine-tune it for NVS. Compared to other works…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Chuanxia Zheng , Andrea Vedaldi

This paper addresses the problem of novel view synthesis by means of neural rendering, where we are interested in predicting the novel view at an arbitrary camera pose based on a given set of input images from other viewpoints. Using the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Phong Nguyen-Ha , Lam Huynh , Esa Rahtu , Janne Heikkila

We introduce HyperGS, a novel framework for Hyperspectral Novel View Synthesis (HNVS), based on a new latent 3D Gaussian Splatting (3DGS) technique. Our approach enables simultaneous spatial and spectral renderings by encoding material…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Christopher Thirgood , Oscar Mendez , Erin Chao Ling , Jon Storey , Simon Hadfield

This paper describes the Qualcomm AI Research solution to the RealADSim-NVS challenge, hosted at the RealADSim Workshop at ICCV 2025. The challenge concerns novel view synthesis in street scenes, and participants are required to generate,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Mohamed Omran , Farhad Zanjani , Davide Abati , Jens Petersen , Amirhossein Habibian

Novel view synthesis (NVS) is a challenging task in computer vision that involves synthesizing new views of a scene from a limited set of input images. Neural Radiance Fields (NeRF) have emerged as a powerful approach to address this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Shuja Khalid , Frank Rudzicz

Rendering photo-realistic novel-view images of complex scenes has been a long-standing challenge in computer graphics. In recent years, great research progress has been made on enhancing rendering quality and accelerating rendering speed in…

Graphics · Computer Science 2024-02-21 Tiansong Zhou , Yebin Liu , Xuangeng Chu , Chengkun Cao , Changyin Zhou , Fei Yu , Yu Li

We present a new method for lightweight novel-view synthesis that generalizes to an arbitrary forward-facing scene. Recent approaches are computationally expensive, require per-scene optimization, or produce a memory-expensive…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Pavel Solovev , Taras Khakhulin , Denis Korzhenkov

A concept of light-fields computed from multiple view images on regular grids has proven its benefit for scene representations, and supported realistic renderings of novel views and photographic effects such as refocusing and shallow depth…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Hyunjun Jung , Hae-Gon Jeon

In this study, we present a method for synthesizing novel views from a single 360-degree RGB-D image based on the neural radiance field (NeRF) . Prior studies relied on the neighborhood interpolation capability of multi-layer perceptrons to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Takayuki Hara , Tatsuya Harada

Recent advancements in view synthesis have significantly enhanced immersive experiences across various computer graphics and multimedia applications, including telepresence and entertainment. By enabling the generation of new perspectives…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Manu Gond , Emin Zerman , Sebastian Knorr , Mårten Sjöström

Novel view synthesis (NVS) aims to generate images at arbitrary viewpoints using multi-view images, and recent insights from neural radiance fields (NeRF) have contributed to remarkable improvements. Recently, studies on generalizable NeRF…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Youngho Yoon , Hyun-Kurl Jang , Kuk-Jin Yoon

Conventional depth-free multi-view datasets are captured using a moving monocular camera without metric calibration. The scales of camera positions in this monocular setting are ambiguous. Previous methods have acknowledged scale ambiguity…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Fereshteh Forghani , Jason J. Yu , Tristan Aumentado-Armstrong , Konstantinos G. Derpanis , Marcus A. Brubaker

Novel view synthesis (NVS) approaches such as NeRFs or 3DGS can produce photo-realistic 3D scene representation from a set of images with known extrinsic and intrinsic parameters. The necessary camera poses and calibrations are typically…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Jhacson Meza , Martin R. Oswald , Torsten Sattler

Single-view novel view synthesis (NVS) is a notorious problem due to its ill-posed nature, and often requires large, computationally expensive approaches to produce tangible results. In this paper, we propose CheapNVS: a fully end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Konstantinos Georgiadis , Mehmet Kerim Yucel , Albert Saa-Garriga

Estimating the pose of objects through vision is essential to make robotic platforms interact with the environment. Yet, it presents many challenges, often related to the lack of flexibility and generalizability of state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Francesco Di Felice , Alberto Remus , Stefano Gasperini , Benjamin Busam , Lionel Ott , Federico Tombari , Roland Siegwart , Carlo Alberto Avizzano