English
Related papers

Related papers: VMesh: Hybrid Volume-Mesh Representation for Effic…

200 papers

Surfaces are typically represented as meshes, which can be extracted from volumetric fields via meshing or optimized directly as surface parameterizations. Volumetric representations occupy 3D space and have a large effective receptive…

Graphics · Computer Science 2026-02-03 Ruiqi Zhang , Jiacheng Wu , Jie Chen

Mesh plays an indispensable role in dense real-time reconstruction essential in robotics. Efforts have been made to maintain flexible data structures for 3D data fusion, yet an efficient incremental framework specifically designed for…

Robotics · Computer Science 2018-03-13 Wei Dong , Jieqi Shi , Weijie Tang , Xin Wang , Hongbin Zha

While Neural Radiance Fields (NeRFs) have demonstrated exceptional quality, their protracted training duration remains a limitation. Generalizable and MVS-based NeRFs, although capable of mitigating training time, often incur tradeoffs in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Chih-Hai Su , Chih-Yao Hu , Shr-Ruei Tsai , Jie-Ying Lee , Chin-Yang Lin , Yu-Lun Liu

Neural radiance fields achieve unprecedented quality for novel view synthesis, but their volumetric formulation remains expensive, requiring a huge number of samples to render high-resolution images. Volumetric encodings are essential to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Zian Wang , Tianchang Shen , Merlin Nimier-David , Nicholas Sharp , Jun Gao , Alexander Keller , Sanja Fidler , Thomas Müller , Zan Gojcic

Novel view synthesis is a long-standing problem that revolves around rendering frames of scenes from novel camera viewpoints. Volumetric approaches provide a solution for modeling occlusions through the explicit 3D representation of the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Youssef Abdelkareem , Shady Shehata , Fakhri Karray

Creating realistic virtual assets is a time-consuming process: it usually involves an artist designing the object, then spending a lot of effort on tweaking its appearance. Intricate details and certain effects, such as subsurface…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Aljaž Božič , Denis Gladkov , Luke Doukakis , Christoph Lassner

Deep generative models have shown success in generating 3D shapes with different representations. In this work, we propose Neural Volumetric Mesh Generator(NVMG) which can generate novel and high-quality volumetric meshes. Unlike the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Yan Zheng , Lemeng Wu , Xingchao Liu , Zhen Chen , Qiang Liu , Qixing Huang

Obtaining high-quality 3D reconstructions of room-scale scenes is of paramount importance for upcoming applications in AR or VR. These range from mixed reality applications for teleconferencing, virtual measuring, virtual room planing, to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Dejan Azinović , Ricardo Martin-Brualla , Dan B Goldman , Matthias Nießner , Justus Thies

Neural Radiance Field (NeRF) has shown impressive performance in novel view synthesis via implicit scene representation. However, it usually suffers from poor scalability as requiring densely sampled images for each new scene. Several…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Muyu Xu , Fangneng Zhan , Jiahui Zhang , Yingchen Yu , Xiaoqin Zhang , Christian Theobalt , Ling Shao , Shijian Lu

We present a novel method for performing flexible, 3D-aware image content manipulation while enabling high-quality novel view synthesis. While NeRF-based approaches are effective for novel view synthesis, such models memorize the radiance…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Verica Lazova , Vladimir Guzov , Kyle Olszewski , Sergey Tulyakov , Gerard Pons-Moll

Novel view synthesis (NVS) is a challenge in computer vision and graphics, focusing on generating realistic images of a scene from unobserved camera poses, given a limited set of authentic input images. Neural radiance fields (NeRF)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Austin Peng

Making generative models 3D-aware bridges the 2D image space and the 3D physical world yet remains challenging. Recent attempts equip a Generative Adversarial Network (GAN) with a Neural Radiance Field (NeRF), which maps 3D coordinates to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Yinghao Xu , Sida Peng , Ceyuan Yang , Yujun Shen , Bolei Zhou

Neural Radiance Fields (NeRF) have demonstrated very impressive performance in novel view synthesis via implicitly modelling 3D representations from multi-view 2D images. However, most existing studies train NeRF models with either…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Jiahui Zhang , Fangneng Zhan , Rongliang Wu , Yingchen Yu , Wenqing Zhang , Bai Song , Xiaoqin Zhang , Shijian Lu

Novel view synthesis (NVS) of multi-human scenes imposes challenges due to the complex inter-human occlusions. Layered representations handle the complexities by dividing the scene into multi-layered radiance fields, however, they are…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Youssef Abdelkareem , Shady Shehata , Fakhri Karray

Very recently neural implicit rendering techniques have been rapidly evolved and shown great advantages in novel view synthesis and 3D scene reconstruction. However, existing neural rendering methods for editing purposes offer limited…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Bangbang Yang , Chong Bao , Junyi Zeng , Hujun Bao , Yinda Zhang , Zhaopeng Cui , Guofeng Zhang

NeRFs have enabled highly realistic synthesis of human faces including complex appearance and reflectance effects of hair and skin. These methods typically require a large number of multi-view input images, making the process hardware…

We propose a novel neural rendering pipeline, Hybrid Volumetric-Textural Rendering (HVTR), which synthesizes virtual human avatars from arbitrary poses efficiently and at high quality. First, we learn to encode articulated human motions on…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Tao Hu , Tao Yu , Zerong Zheng , He Zhang , Yebin Liu , Matthias Zwicker

We present a method for reconstructing high-quality meshes of large unbounded real-world scenes suitable for photorealistic novel view synthesis. We first optimize a hybrid neural volume-surface scene representation designed to have…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Lior Yariv , Peter Hedman , Christian Reiser , Dor Verbin , Pratul P. Srinivasan , Richard Szeliski , Jonathan T. Barron , Ben Mildenhall

Multi-view photometric stereo (MVPS) is a preferred method for detailed and precise 3D acquisition of an object from images. Although popular methods for MVPS can provide outstanding results, they are often complex to execute and limited to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Berk Kaya , Suryansh Kumar , Carlos Oliveira , Vittorio Ferrari , Luc Van Gool

While surface-based view synthesis algorithms are appealing due to their low computational requirements, they often struggle to reproduce thin structures. In contrast, more expensive methods that model the scene's geometry as a volumetric…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Christian Reiser , Stephan Garbin , Pratul P. Srinivasan , Dor Verbin , Richard Szeliski , Ben Mildenhall , Jonathan T. Barron , Peter Hedman , Andreas Geiger