English
Related papers

Related papers: Spurfies: Sparse Surface Reconstruction using Loca…

200 papers

Neural Radiance Fields (NeRFs) have achieved impressive results in novel view synthesis and surface reconstruction tasks. However, their performance suffers under challenging scenarios with sparse input views. We present CorresNeRF, a novel…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Yixing Lao , Xiaogang Xu , Zhipeng Cai , Xihui Liu , Hengshuang Zhao

This paper proposes Sparse View Synthesis. This is a view synthesis problem where the number of reference views is limited, and the baseline between target and reference view is significant. Under these conditions, current radiance field…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Violeta Menéndez González , Andrew Gilbert , Graeme Phillipson , Stephen Jolly , Simon Hadfield

Neural Radiance Fields from Sparse input} (NeRF-S) have shown great potential in synthesizing novel views with a limited number of observed viewpoints. However, due to the inherent limitations of sparse inputs and the gap between…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Yanqi Bao , Yuxin Li , Jing Huo , Tianyu Ding , Xinyue Liang , Wenbin Li , Yang Gao

Neural radiance fields (NeRFs) have enabled high fidelity 3D reconstruction from multiple 2D input views. However, a well-known drawback of NeRFs is the less-than-ideal performance under a small number of views, due to insufficient…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Mikaela Angelina Uy , Ricardo Martin-Brualla , Leonidas Guibas , Ke Li

The field of novel view synthesis from images has seen rapid advancements with the introduction of Neural Radiance Fields (NeRF) and more recently with 3D Gaussian Splatting. Gaussian Splatting became widely adopted due to its efficiency…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Ruihong Yin , Vladimir Yugay , Yue Li , Sezer Karaoglu , Theo Gevers

We present NeRFVS, a novel neural radiance fields (NeRF) based method to enable free navigation in a room. NeRF achieves impressive performance in rendering images for novel views similar to the input views while suffering for novel views…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Chen Yang , Peihao Li , Zanwei Zhou , Shanxin Yuan , Bingbing Liu , Xiaokang Yang , Weichao Qiu , Wei Shen

3D surface reconstruction from point clouds is a key step in areas such as content creation, archaeology, digital cultural heritage, and engineering. Current approaches either try to optimize a non-data-driven surface representation to fit…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Philipp Erler , Lizeth Fuentes , Pedro Hermosilla , Paul Guerrero , Renato Pajarola , Michael Wimmer

Synthesizing novel views from a single view image is a highly ill-posed problem. We discover an effective solution to reduce the learning ambiguity by expanding the single-view view synthesis problem to a multi-view setting. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Yang Zhou , Hanjie Wu , Wenxi Liu , Zheng Xiong , Jing Qin , Shengfeng He

Recent learning-based Multi-View Stereo models have demonstrated state-of-the-art performance in sparse-view 3D reconstruction. However, directly applying 3D Gaussian Splatting (3DGS) as a refinement step following these models presents…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Yongsung Kim , Minjun Park , Jooyoung Choi , Sungroh Yoon

We present DeepSurfels, a novel hybrid scene representation for geometry and appearance information. DeepSurfels combines explicit and neural building blocks to jointly encode geometry and appearance information. In contrast to established…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Marko Mihajlovic , Silvan Weder , Marc Pollefeys , Martin R. Oswald

We present Rewis3d, a framework that leverages recent advances in feed-forward 3D reconstruction to significantly improve weakly supervised semantic segmentation on 2D images. Obtaining dense, pixel-level annotations remains a costly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Jonas Ernst , Wolfgang Boettcher , Lukas Hoyer , Jan Eric Lenssen , Bernt Schiele

Digitizing 3D static scenes and 4D dynamic events from multi-view images has long been a challenge in computer vision and graphics. Recently, 3D Gaussian Splatting (3DGS) has emerged as a practical and scalable reconstruction method,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Marko Mihajlovic , Sergey Prokudin , Siyu Tang , Robert Maier , Federica Bogo , Tony Tung , Edmond Boyer

This paper introduces a novel deep framework for dense 3D reconstruction from multiple image frames, leveraging a sparse set of depth measurements gathered jointly with image acquisition. Given a deep multi-view stereo network, our…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Matteo Poggi , Andrea Conti , Stefano Mattoccia

2D-to-3D reconstruction is an ill-posed problem, yet humans are good at solving this problem due to their prior knowledge of the 3D world developed over years. Driven by this observation, we propose NeRDi, a single-view NeRF synthesis…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Congyue Deng , Chiyu "Max'' Jiang , Charles R. Qi , Xinchen Yan , Yin Zhou , Leonidas Guibas , Dragomir Anguelov

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

Dynamic Neural Radiance Fields (NeRFs) achieve remarkable visual quality when synthesizing novel views of time-evolving 3D scenes. However, the common reliance on backward deformation fields makes reanimation of the captured object poses…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Lukas Uzolas , Elmar Eisemann , Petr Kellnhofer

Recent advances in Neural Radiance Fields (NeRFs) treat the problem of novel view synthesis as Sparse Radiance Field (SRF) optimization using sparse voxels for efficient and fast rendering (plenoxels,InstantNGP). In order to leverage…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Abdullah Hamdi , Bernard Ghanem , Matthias Nießner

Computed tomography has propelled scientific advances in fields from biology to materials science. This technology allows for the elucidation of 3-dimensional internal structure by the attenuation of x-rays through an object at different…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Rey Mendoza , Minh Nguyen , Judith Weng Zhu , Vincent Dumont , Talita Perciano , Juliane Mueller , Vidya Ganapati

Under good conditions, Neural Radiance Fields (NeRFs) have shown impressive results on novel view synthesis tasks. NeRFs learn a scene's color and density fields by minimizing the photometric discrepancy between training views and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Jamie Wynn , Daniyar Turmukhambetov

Open-world 3D generation has recently attracted considerable attention. While many single-image-to-3D methods have yielded visually appealing outcomes, they often lack sufficient controllability and tend to produce hallucinated regions that…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Chao Xu , Ang Li , Linghao Chen , Yulin Liu , Ruoxi Shi , Hao Su , Minghua Liu