English
Related papers

Related papers: Appreciate the View: A Task-Aware Evaluation Frame…

200 papers

Neural radiance fields (NeRF) are a groundbreaking computer vision technology that enables the generation of high-quality, immersive visual content from multiple viewpoints. This capability has significant advantages for applications such…

Multimedia · Computer Science 2024-09-30 Pedro Martin , Antonio Rodrigues , Joao Ascenso , Maria Paula Queluz

We propose VISION-SLS, a method for nonlinear output-feedback control from high-resolution RGB images which provides robust constraint satisfaction guarantees under calibrated uncertainty bounds despite partial observability, sensor noise,…

Robotics · Computer Science 2026-04-29 Antoine P. Leeman , Shuyu Zhan , Melanie N. Zeilinger , Glen Chou

Repurposing pre-trained diffusion models has been proven to be effective for NVS. However, these methods are mostly limited to a single object; directly applying such methods to compositional multi-object scenarios yields inferior results,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Ruijie Lu , Yixin Chen , Junfeng Ni , Baoxiong Jia , Yu Liu , Diwen Wan , Gang Zeng , Siyuan Huang

Novel view synthesis (NVS) has shown significant promise for applications in cinematographic production, particularly through the exploitation of Neural Radiance Fields (NeRF) and Gaussian Splatting (GS). These methods model real 3D scenes,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Adrian Azzarelli , Nantheera Anantrasirichai , David R Bull

Novel-view synthesis (NVS) can be tackled through different approaches, depending on the general setting: a single source image to a short video sequence, exact or noisy camera pose information, 3D-based information such as point clouds…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Gaétan Landreau , Mohamed Tamaazousti

Single-view novel view synthesis (NVS) is a notorious problem due to its ill-posed nature, and often requires large, computationally expensive approaches to produce tangible results. In this paper, we propose CheapNVS: a fully end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Konstantinos Georgiadis , Mehmet Kerim Yucel , Albert Saa-Garriga

Traditional image similarity metrics are ineffective at evaluating the similarity between a real image of a scene and an artificially generated version of that viewpoint [6, 9, 13, 14]. Our research evaluates the effectiveness of a new,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Charith Wickrema , Sara Leary , Shivangi Sarkar , Mark Giglio , Eric Bianchi , Eliza Mace , Michael Twardowski

Novel-View Human Action Synthesis aims to synthesize the movement of a body from a virtual viewpoint, given a video from a real viewpoint. We present a novel 3D reasoning to synthesize the target viewpoint. We first estimate the 3D mesh of…

Computer Vision and Pattern Recognition · Computer Science 2020-10-09 Mohamed Ilyes Lakhal , Davide Boscaini , Fabio Poiesi , Oswald Lanz , Andrea Cavallaro

Neural View Synthesis (NVS), such as NeRF and 3D Gaussian Splatting, effectively creates photorealistic scenes from sparse viewpoints, typically evaluated by quality assessment methods like PSNR, SSIM, and LPIPS. However, these…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Qiang Qu , Yiran Shen , Xiaoming Chen , Yuk Ying Chung , Weidong Cai , Tongliang Liu

In this paper, we present TOSS, which introduces text to the task of novel view synthesis (NVS) from just a single RGB image. While Zero-1-to-3 has demonstrated impressive zero-shot open-set NVS capability, it treats NVS as a pure…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Yukai Shi , Jianan Wang , He Cao , Boshi Tang , Xianbiao Qi , Tianyu Yang , Yukun Huang , Shilong Liu , Lei Zhang , Heung-Yeung Shum

Novel view synthesis (NVS) seeks to render photorealistic, 3D-consistent images of a scene from unseen camera poses given only a sparse set of posed views. Existing deterministic networks render observed regions quickly but blur unobserved…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Thanh-Tung Le , Tuan Pham , Tung Nguyen , Deying Kong , Xiaohui Xie , Stephan Mandt

Transfer learning of large-scale Text-to-Image (T2I) models has recently shown impressive potential for Novel View Synthesis (NVS) of diverse objects from a single image. While previous methods typically train large models on multi-view…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Yoonwoo Jeong , Jinwoo Lee , Chiheon Kim , Minsu Cho , Doyup Lee

Large transformer-based models have made significant progress in generalizable novel view synthesis (NVS) from sparse input views, generating novel viewpoints without the need for test-time optimization. However, these models are…

In this paper, we identify that the key criterion for determining whether a model is truly capable of novel view synthesis (NVS) is transferability: Whether any pose representation extracted from one video sequence can be used to re-render…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Thomas W. Mitchel , Hyunwoo Ryu , Vincent Sitzmann

Novel View Synthesis (NVS) is concerned with synthesizing views under camera viewpoint transformations from one or multiple input images. NVS requires explicit reasoning about 3D object structure and unseen parts of the scene to synthesize…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Nicolai Häni , Selim Engin , Jun-Jee Chao , Volkan Isler

In this study, we propose two novel input processing paradigms for novel view synthesis (NVS) methods based on layered scene representations that significantly improve their runtime without compromising quality. Our approach identifies and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Jonas Kohler , Nicolas Griffiths Sanchez , Luca Cavalli , Catherine Herold , Albert Pumarola , Alberto Garcia Garcia , Ali Thabet

Generating high-quality novel views of a scene from a single image requires maintaining structural coherence across different views, referred to as view consistency. While diffusion models have driven advancements in novel view synthesis,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Jiwoo Park , Tae Eun Choi , Youngjun Jun , Seong Jae Hwang

We study the problem of novel view synthesis from sparse source observations of a scene comprised of 3D objects. We propose a simple yet effective approach that is neither continuous nor implicit, challenging recent trends on view…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Pengsheng Guo , Miguel Angel Bautista , Alex Colburn , Liang Yang , Daniel Ulbricht , Joshua M. Susskind , Qi Shan

In this paper, we propose an approach for synthesizing novel view images from a single RGBD (Red Green Blue-Depth) input. Novel view synthesis (NVS) is an interesting computer vision task with extensive applications. Methods using multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Congrui Hetang , Yuping Wang

Novel view synthesis (NVS) enables to generate new images of a scene or convert a set of 2D images into a comprehensive 3D model. In the context of Space Domain Awareness, since space is becoming increasingly congested, NVS can accurately…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Nidhi Mathihalli , Audrey Wei , Giovanni Lavezzi , Peng Mun Siew , Victor Rodriguez-Fernandez , Hodei Urrutxua , Richard Linares