中文
相关论文

相关论文: Aug3D: Augmenting large scale outdoor datasets for…

200 篇论文

We introduce MVGenMaster, a multi-view diffusion model enhanced with 3D priors to address versatile Novel View Synthesis (NVS) tasks. MVGenMaster leverages 3D priors that are warped using metric depth and camera poses, significantly…

计算机视觉与模式识别 · 计算机科学 2025-03-07 Chenjie Cao , Chaohui Yu , Shang Liu , Fan Wang , Xiangyang Xue , Yanwei Fu

The recent advent of large-scale 3D data, e.g. Objaverse, has led to impressive progress in training pose-conditioned diffusion models for novel view synthesis. However, due to the synthetic nature of such 3D data, their performance drops…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Chuang Lin , Bingbing Zhuang , Shanlin Sun , Ziyu Jiang , Jianfei Cai , Manmohan Chandraker

This paper describes the Qualcomm AI Research solution to the RealADSim-NVS challenge, hosted at the RealADSim Workshop at ICCV 2025. The challenge concerns novel view synthesis in street scenes, and participants are required to generate,…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Mohamed Omran , Farhad Zanjani , Davide Abati , Jens Petersen , Amirhossein Habibian

We present a diffusion-based model for 3D-aware generative novel view synthesis from as few as a single input image. Our model samples from the distribution of possible renderings consistent with the input and, even in the presence of…

The generation of high-fidelity view synthesis is essential for robotic navigation and interaction but remains challenging, particularly in indoor environments and real-time scenarios. Existing techniques often require significant…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Sen Wang , Qing Cheng , Stefano Gasperini , Wei Zhang , Shun-Cheng Wu , Niclas Zeller , Daniel Cremers , Nassir Navab

Novel view synthesis (NVS) from a single image is highly ill-posed due to large unobserved regions, especially for views that deviate significantly from the input. While existing methods focus on consistency between the source and generated…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Xueyang Kang , Zhengkang Xiang , Zezheng Zhang , Kourosh Khoshelham

In dynamic Neural Radiance Fields (NeRF) systems, state-of-the-art novel view synthesis methods often fail under significant viewpoint deviations, producing unstable and unrealistic renderings. To address this, we introduce Expanded Dynamic…

计算机视觉与模式识别 · 计算机科学 2025-12-17 Le Jiang , Shaotong Zhu , Yedi Luo , Shayda Moezzi , Sarah Ostadabbas

Neural Radiance Fields (NeRF) enable 3D scene reconstruction from 2D images and camera poses for Novel View Synthesis (NVS). Although NeRF can produce photorealistic results, it often suffers from overfitting to training views, leading to…

计算机视觉与模式识别 · 计算机科学 2023-11-07 Fusang Wang , Arnaud Louys , Nathan Piasco , Moussab Bennehar , Luis Roldão , Dzmitry Tsishkou

Novel View Synthesis (NVS), which tries to produce a realistic image at the target view given source view images and their corresponding poses, is a fundamental problem in 3D Vision. As this task is heavily under-constrained, some recent…

计算机视觉与模式识别 · 计算机科学 2023-12-15 Shijie Li , Farhad G. Zanjani , Haitam Ben Yahia , Yuki M. Asano , Juergen Gall , Amirhossein Habibian

3D Gaussian Splatting (3DGS) has demonstrated remarkable real-time performance in novel view synthesis, yet its effectiveness relies heavily on dense multi-view inputs with precisely known camera poses, which are rarely available in…

计算机视觉与模式识别 · 计算机科学 2025-08-22 Zongqi He , Hanmin Li , Kin-Chung Chan , Yushen Zuo , Hao Xie , Zhe Xiao , Jun Xiao , Kin-Man Lam

NeRF provides unparalleled fidelity of novel view synthesis: rendering a 3D scene from an arbitrary viewpoint. NeRF requires training on a large number of views that fully cover a scene, which limits its applicability. While these issues…

We study the problem of synthesizing immersive 3D indoor scenes from one or more images. Our aim is to generate high-resolution images and videos from novel viewpoints, including viewpoints that extrapolate far beyond the input images while…

计算机视觉与模式识别 · 计算机科学 2022-12-02 Jing Yu Koh , Harsh Agrawal , Dhruv Batra , Richard Tucker , Austin Waters , Honglak Lee , Yinfei Yang , Jason Baldridge , Peter Anderson

The goal of this work is to perform 3D reconstruction and novel view synthesis from data captured by scanning platforms commonly deployed for world mapping in urban outdoor environments (e.g., Street View). Given a sequence of posed RGB…

计算机视觉与模式识别 · 计算机科学 2021-11-30 Konstantinos Rematas , Andrew Liu , Pratul P. Srinivasan , Jonathan T. Barron , Andrea Tagliasacchi , Thomas Funkhouser , Vittorio Ferrari

Novel view synthesis is an essential functionality for enabling immersive experiences in various Augmented- and Virtual-Reality (AR/VR) applications, for which generalizable Neural Radiance Fields (NeRFs) have gained increasing popularity…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Yonggan Fu , Zhifan Ye , Jiayi Yuan , Shunyao Zhang , Sixu Li , Haoran You , Yingyan Celine Lin

We present Neural Feature Fusion Fields (N3F), a method that improves dense 2D image feature extractors when the latter are applied to the analysis of multiple images reconstructible as a 3D scene. Given an image feature extractor, for…

计算机视觉与模式识别 · 计算机科学 2022-09-09 Vadim Tschernezki , Iro Laina , Diane Larlus , Andrea Vedaldi

We introduce a method for using event camera data in novel view synthesis via Gaussian Splatting. Event cameras offer exceptional temporal resolution and a high dynamic range. Leveraging these capabilities allows us to effectively address…

计算机视觉与模式识别 · 计算机科学 2025-05-22 Toshiya Yura , Ashkan Mirzaei , Igor Gilitschenski

Novel view synthesis (NVS) of static and dynamic urban scenes is essential for autonomous driving simulation, yet existing methods often struggle to balance reconstruction time with quality. While state-of-the-art neural radiance fields and…

计算机视觉与模式识别 · 计算机科学 2026-01-23 Sheng Miao , Sijin Li , Pan Wang , Dongfeng Bai , Bingbing Liu , Yue Wang , Andreas Geiger , Yiyi Liao

The method of neural radiance fields (NeRF) has been developed in recent years, and this technology has promising applications for synthesizing novel views of complex scenes. However, NeRF requires dense input views, typically numbering in…

计算机视觉与模式识别 · 计算机科学 2022-11-24 Young Chun Ahn , Seokhwan Jang , Sungheon Park , Ji-Yeon Kim , Nahyup Kang

Neural Radiance Fields (NeRF) have been proposed for photorealistic novel view rendering. However, it requires many different views of one scene for training. Moreover, it has poor generalizations to new scenes and requires retraining or…

计算机视觉与模式识别 · 计算机科学 2023-05-12 Yurui Chen , Chun Gu , Feihu Zhang , Li Zhang

In this paper, we propose an approach for synthesizing novel view images from a single RGBD (Red Green Blue-Depth) input. Novel view synthesis (NVS) is an interesting computer vision task with extensive applications. Methods using multiple…

计算机视觉与模式识别 · 计算机科学 2023-11-03 Congrui Hetang , Yuping Wang