中文
相关论文

相关论文: Learning to Render Novel Views from Wide-Baseline …

200 篇论文

Building upon the recent progress in novel view synthesis, we propose its application to improve monocular depth estimation. In particular, we propose a novel training method split in three main steps. First, the prediction results of a…

计算机视觉与模式识别 · 计算机科学 2021-12-24 Zuria Bauer , Zuoyue Li , Sergio Orts-Escolano , Miguel Cazorla , Marc Pollefeys , Martin R. Oswald

We present a generalizable novel view synthesis method which enables modifying the visual appearance of an observed scene so rendered views match a target weather or lighting condition without any scene specific training or access to…

计算机视觉与模式识别 · 计算机科学 2024-01-29 Josef Bengtson , David Nilsson , Che-Tsung Lin , Marcel Büsching , Fredrik Kahl

Novel view synthesis from a single image has recently attracted a lot of attention, and it has been primarily advanced by 3D deep learning and rendering techniques. However, most work is still limited by synthesizing new views within…

计算机视觉与模式识别 · 计算机科学 2022-03-18 Xuanchi Ren , Xiaolong Wang

Disparity/depth estimation from sequences of stereo images is an important element in 3D vision. Owing to occlusions, imperfect settings and homogeneous luminance, accurate estimate of depth remains a challenging problem. Targetting view…

图像与视频处理 · 电气工程与系统科学 2020-03-17 Nantheera Anantrasirichai , Majid Geravand , David Braendler , David R. Bull

We present a new approach for synthesizing novel views of people in new poses. Our novel differentiable renderer enables the synthesis of highly realistic images from any viewpoint. Rather than operating over mesh-based structures, our…

计算机视觉与模式识别 · 计算机科学 2022-02-22 Guillaume Rochette , Chris Russell , Richard Bowden

We present a large-scale synthetic dataset for novel view synthesis consisting of ~300k images rendered from nearly 2000 complex scenes using high-quality ray tracing at high resolution (1600 x 1600 pixels). The dataset is orders of…

Novel view synthesis from a single image has been a cornerstone problem for many Virtual Reality applications that provide immersive experiences. However, most existing techniques can only synthesize novel views within a limited range of…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Hung-Yu Tseng , Qinbo Li , Changil Kim , Suhib Alsisan , Jia-Bin Huang , Johannes Kopf

Single-image novel view synthesis is a challenging and ongoing problem that aims to generate an infinite number of consistent views from a single input image. Although significant efforts have been made to advance the quality of generated…

计算机视觉与模式识别 · 计算机科学 2023-12-19 Guo Pu , Peng-Shuai Wang , Zhouhui Lian

The generation of high-fidelity view synthesis is essential for robotic navigation and interaction but remains challenging, particularly in indoor environments and real-time scenarios. Existing techniques often require significant…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Sen Wang , Qing Cheng , Stefano Gasperini , Wei Zhang , Shun-Cheng Wu , Niclas Zeller , Daniel Cremers , Nassir Navab

Implicit neural rendering techniques have shown promising results for novel view synthesis. However, existing methods usually encode the entire scene as a whole, which is generally not aware of the object identity and limits the ability to…

计算机视觉与模式识别 · 计算机科学 2021-09-07 Bangbang Yang , Yinda Zhang , Yinghao Xu , Yijin Li , Han Zhou , Hujun Bao , Guofeng Zhang , Zhaopeng Cui

This paper proposes a new method for simultaneous 3D reconstruction and semantic segmentation of indoor scenes. Unlike existing methods that require recording a video using a color camera and/or a depth camera, our method only needs a small…

计算机视觉与模式识别 · 计算机科学 2019-06-20 Jingyu Yang , Ji Xu , Kun Li , Yu-Kun Lai , Huanjing Yue , Jianzhi Lu , Hao Wu , Yebin Liu

This paper presents a new dataset for Novel View Synthesis, generated from a high-quality, animated film with stunning realism and intricate detail. Our dataset captures a variety of dynamic scenes, complete with detailed textures,…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Michal Nazarczuk , Thomas Tanay , Arthur Moreau , Zhensong Zhang , Eduardo Pérez-Pellitero

We propose a new method for realistic real-time novel-view synthesis (NVS) of large scenes. Existing neural rendering methods generate realistic results, but primarily work for small scale scenes (<50 square meters) and have difficulty at…

计算机视觉与模式识别 · 计算机科学 2023-11-10 Jeffrey Yunfan Liu , Yun Chen , Ze Yang , Jingkang Wang , Sivabalan Manivasagam , Raquel Urtasun

This paper presents a learning-based approach to synthesize the view from an arbitrary camera position given a sparse set of images. A key challenge for this novel view synthesis arises from the reconstruction process, when the views from…

计算机视觉与模式识别 · 计算机科学 2021-04-06 Nan Meng , Kai Li , Jianzhuang Liu , Edmund Y. Lam

Recent implicit neural representations have shown great results for novel view synthesis. However, existing methods require expensive per-scene optimization from many views hence limiting their application to real-world unbounded urban…

计算机视觉与模式识别 · 计算机科学 2023-08-25 Muhammad Zubair Irshad , Sergey Zakharov , Katherine Liu , Vitor Guizilini , Thomas Kollar , Adrien Gaidon , Zsolt Kira , Rares Ambrus

We explore novel-view synthesis for dynamic scenes from monocular videos. Prior approaches rely on costly test-time optimization of 4D representations or do not preserve scene geometry when trained in a feed-forward manner. Our approach is…

计算机视觉与模式识别 · 计算机科学 2026-01-14 Kaihua Chen , Tarasha Khurana , Deva Ramanan

Recent advancements in view synthesis have significantly enhanced immersive experiences across various computer graphics and multimedia applications, including telepresence and entertainment. By enabling the generation of new perspectives…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Manu Gond , Emin Zerman , Sebastian Knorr , Mårten Sjöström

Rendering scenes observed in a monocular video from novel viewpoints is a challenging problem. For static scenes the community has studied both scene-specific optimization techniques, which optimize on every test scene, and generalized…

计算机视觉与模式识别 · 计算机科学 2024-02-21 Xiaoming Zhao , Alex Colburn , Fangchang Ma , Miguel Angel Bautista , Joshua M. Susskind , Alexander G. Schwing

Dynamic novel view synthesis aims to capture the temporal evolution of visual content within videos. Existing methods struggle to distinguishing between motion and structure, particularly in scenarios where camera poses are either unknown…

计算机视觉与模式识别 · 计算机科学 2024-01-12 Chaoyang Wang , Peiye Zhuang , Aliaksandr Siarohin , Junli Cao , Guocheng Qian , Hsin-Ying Lee , Sergey Tulyakov

Classical light field rendering for novel view synthesis can accurately reproduce view-dependent effects such as reflection, refraction, and translucency, but requires a dense view sampling of the scene. Methods based on geometric…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Mohammed Suhail , Carlos Esteves , Leonid Sigal , Ameesh Makadia