English
Related papers

Related papers: NeuralMVS: Bridging Multi-View Stereo and Novel Vi…

200 papers

Novel view synthesis is an important problem in computer vision and graphics. Over the years a large number of solutions have been put forward to solve the problem. However, the large-baseline novel view synthesis problem is far from being…

Computer Vision and Pattern Recognition · Computer Science 2018-05-08 Tewodros Habtegebrial , Kiran Varanasi , Christian Bailer , Didier Stricker

Rendering scenes with a high-quality human face from arbitrary viewpoints is a practical and useful technique for many real-world applications. Recently, Neural Radiance Fields (NeRF), a rendering technique that uses neural networks to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Satoshi Tsutsui , Weijia Mao , Sijing Lin , Yunyi Zhu , Murong Ma , Mike Zheng Shou

Multi-task visual learning is a critical aspect of computer vision. Current research, however, predominantly concentrates on the multi-task dense prediction setting, which overlooks the intrinsic 3D world and its multi-view consistent…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Shuhong Zheng , Zhipeng Bao , Martial Hebert , Yu-Xiong Wang

In this paper, we propose the first generalizable view synthesis approach that specifically targets multi-view stereo-camera images. Since recent stereo matching has demonstrated accurate geometry prediction, we introduce stereo matching…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Haechan Lee , Wonjoon Jin , Seung-Hwan Baek , Sunghyun Cho

Neural rendering of implicit surfaces performs well in 3D vision applications. However, it requires dense input views as supervision. When only sparse input images are available, output quality drops significantly due to the shape-radiance…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Haoyu Wu , Alexandros Graikos , Dimitris Samaras

We present a method that achieves state-of-the-art results for synthesizing novel views of complex scenes by optimizing an underlying continuous volumetric scene function using a sparse set of input views. Our algorithm represents a scene…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Ben Mildenhall , Pratul P. Srinivasan , Matthew Tancik , Jonathan T. Barron , Ravi Ramamoorthi , Ren Ng

NeRF aims to learn a continuous neural scene representation by using a finite set of input images taken from various viewpoints. A well-known limitation of NeRF methods is their reliance on data: the fewer the viewpoints, the higher the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Matteo Bortolon , Alessio Del Bue , Fabio Poiesi

Bounded by the inherent ambiguity of depth perception, contemporary camera-based 3D object detection methods fall into the performance bottleneck. Intuitively, leveraging temporal multi-view stereo (MVS) technology is the natural knowledge…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Yinhao Li , Han Bao , Zheng Ge , Jinrong Yang , Jianjian Sun , Zeming Li

We present 3DVNet, a novel multi-view stereo (MVS) depth-prediction method that combines the advantages of previous depth-based and volumetric MVS approaches. Our key idea is the use of a 3D scene-modeling network that iteratively updates a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Alexander Rich , Noah Stier , Pradeep Sen , Tobias Höllerer

Recently, Neural Radiance Fields (NeRF) is revolutionizing the task of novel view synthesis (NVS) for its superior performance. In this paper, we propose to synthesize dynamic scenes. Extending the methods for static scenes to dynamic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Xiang Guo , Guanying Chen , Yuchao Dai , Xiaoqing Ye , Jiadai Sun , Xiao Tan , Errui Ding

High Dynamic Range Novel View Synthesis (HDR-NVS) aims to establish a 3D scene HDR model from Low Dynamic Range (LDR) imagery. Typically, multiple-exposure LDR images are employed to capture a wider range of brightness levels in a scene, as…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Kaixuan Zhang , Hu Wang , Minxian Li , Mingwu Ren , Mao Ye , Xiatian Zhu

Efficient and accurate 3D reconstruction is crucial for various applications, including augmented and virtual reality, medical imaging, and cinematic special effects. While traditional Multi-View Stereo (MVS) systems have been fundamental…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Umair Haroon , Ahmad AlMughrabi , Ricardo Marques , Petia Radeva

Recent works in volume rendering, \textit{e.g.} NeRF and 3D Gaussian Splatting (3DGS), significantly advance the rendering quality and efficiency with the help of the learned implicit neural radiance field or 3D Gaussians. Rendering on top…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Xiaobiao Du , Yida Wang , Xin Yu

Novel View Synthesis (NVS), which tries to produce a realistic image at the target view given source view images and their corresponding poses, is a fundamental problem in 3D Vision. As this task is heavily under-constrained, some recent…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Shijie Li , Farhad G. Zanjani , Haitam Ben Yahia , Yuki M. Asano , Juergen Gall , Amirhossein Habibian

While originally developed for novel view synthesis, Neural Radiance Fields (NeRFs) have recently emerged as an alternative to multi-view stereo (MVS). Triggered by a manifold of research activities, promising results have been gained…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Vincent Hackstein , Paul Fauth-Mayer , Matthias Rothermel , Norbert Haala

In this study, we propose two novel input processing paradigms for novel view synthesis (NVS) methods based on layered scene representations that significantly improve their runtime without compromising quality. Our approach identifies and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Jonas Kohler , Nicolas Griffiths Sanchez , Luca Cavalli , Catherine Herold , Albert Pumarola , Alberto Garcia Garcia , Ali Thabet

This study addresses the challenge of online 3D model generation for neural rendering using an RGB image stream. Previous research has tackled this issue by incorporating Neural Radiance Fields (NeRF) or 3D Gaussian Splatting (3DGS) as…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Byeonggwon Lee , Junkyu Park , Khang Truong Giang , Sungho Jo , Soohwan Song

In modern dense 3D reconstruction, feed-forward systems (e.g., VGGT, pi3) focus on end-to-end matching and geometry prediction but do not explicitly output the novel view synthesis (NVS). Neural rendering-based approaches offer…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Pengcheng Chen , Yue Hu , Wenhao Li , Nicole M Gunderson , Andrew Feng , Zhenglong Sun , Peter Beerel , Eric J Seibel

We introduce a novel multi-view stereo (MVS) method that can simultaneously recover not just per-pixel depth but also surface normals, together with the reflectance of textureless, complex non-Lambertian surfaces captured under known but…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Kohei Yamashita , Yuto Enyo , Shohei Nobuhara , Ko Nishino

Multi-view Stereo (MVS) with known camera parameters is essentially a 1D search problem within a valid depth range. Recent deep learning-based MVS methods typically densely sample depth hypotheses in the depth range, and then construct…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Zhenxing Mi , Di Chang , Dan Xu