English
Related papers

Related papers: Surface-Aligned Neural Radiance Fields for Control…

200 papers

Various SDF-based neural implicit surface reconstruction methods have been proposed recently, and have demonstrated remarkable modeling capabilities. However, due to the global nature and limited representation ability of a single network,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Leyuan Yang , Bailin Deng , Juyong Zhang

This paper presents Neural Mesh Fusion (NMF), an efficient approach for joint optimization of polygon mesh from multi-view image observations and unsupervised 3D planar-surface parsing of the scene. In contrast to implicit neural…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Farhad G. Zanjani , Hong Cai , Yinhao Zhu , Leyla Mirvakhabova , Fatih Porikli

In this work, we present a new method for 3D face reconstruction from sparse-view RGB images. Unlike previous methods which are built upon 3D morphable models (3DMMs) with limited details, we leverage an implicit representation to encode…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Moran Li , Haibin Huang , Yi Zheng , Mengtian Li , Nong Sang , Chongyang Ma

Contemporary registration devices for 3D visual information, such as LIDARs and various depth cameras, capture data as 3D point clouds. In turn, such clouds are challenging to be processed due to their size and complexity. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Dominik Zimny , Joanna Waczyńska , Tomasz Trzciński , Przemysław Spurek

Unsupervised learning of 3D-aware generative adversarial networks has lately made much progress. Some recent work demonstrates promising results of learning human generative models using neural articulated radiance fields, yet their…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Xinya Chen , Jiaxin Huang , Yanrui Bin , Lu Yu , Yiyi Liao

We propose a method for generating video-realistic animations of real humans under user control. In contrast to conventional human character rendering, we do not require the availability of a production-quality photo-realistic 3D model of…

Computer Vision and Pattern Recognition · Computer Science 2019-05-13 Lingjie Liu , Weipeng Xu , Michael Zollhoefer , Hyeongwoo Kim , Florian Bernard , Marc Habermann , Wenping Wang , Christian Theobalt

We present a novel semantic model for human head defined with neural radiance field. The 3D-consistent head model consist of a set of disentangled and interpretable bases, and can be driven by low-dimensional expression coefficients. Thanks…

Graphics · Computer Science 2022-10-13 Xuan Gao , Chenglai Zhong , Jun Xiang , Yang Hong , Yudong Guo , Juyong Zhang

3D scene reconstruction from 2D images has been a long-standing task. Instead of estimating per-frame depth maps and fusing them in 3D, recent research leverages the neural implicit surface as a unified representation for 3D reconstruction.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Xinyi Yu , Liqin Lu , Jintao Rong , Guangkai Xu , Linlin Ou

In this work, we aim to address the 3D scene stylization problem - generating stylized images of the scene at arbitrary novel view angles. A straightforward solution is to combine existing novel view synthesis and image/video style transfer…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Pei-Ze Chiang , Meng-Shiun Tsai , Hung-Yu Tseng , Wei-sheng Lai , Wei-Chen Chiu

Neural volumetric representations have become a widely adopted model for radiance fields in 3D scenes. These representations are fully implicit or hybrid function approximators of the instantaneous volumetric radiance in a scene, which are…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Yuval Bahat , Yuxuan Zhang , Hendrik Sommerhoff , Andreas Kolb , Felix Heide

We present a novel neural surface reconstruction method called NeuralRoom for reconstructing room-sized indoor scenes directly from a set of 2D images. Recently, implicit neural representations have become a promising way to reconstruct…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Yusen Wang , Zongcheng Li , Yu Jiang , Kaixuan Zhou , Tuo Cao , Yanping Fu , Chunxia Xiao

Neural Radiance Fields (NeRFs) are a very recent and very popular approach for the problems of novel view synthesis and 3D reconstruction. A popular scene representation used by NeRFs is to combine a uniform, voxel-based subdivision of the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jonas Kulhanek , Torsten Sattler

Novel view synthesis (NVS) of multi-human scenes imposes challenges due to the complex inter-human occlusions. Layered representations handle the complexities by dividing the scene into multi-layered radiance fields, however, they are…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Youssef Abdelkareem , Shady Shehata , Fakhri Karray

Recent works on implicit neural representations have shown promising results for multi-view surface reconstruction. However, most approaches are limited to relatively simple geometries and usually require clean object masks for…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Jingyang Zhang , Yao Yao , Long Quan

Recent progress in neural implicit functions has set new state-of-the-art in reconstructing high-fidelity 3D shapes from a collection of images. However, these approaches are limited to closed surfaces as they require the surface to be…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Xiaoxu Meng , Weikai Chen , Bo Yang

We propose and evaluate a neural point-based graphics method that can model semi-transparent scene parts. Similarly to its predecessor pipeline, ours uses point clouds to model proxy geometry, and augments each point with a neural…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Maria Kolos , Artem Sevastopolsky , Victor Lempitsky

Representing 3D objects and scenes with neural radiance fields has become very popular over the last years. Recently, surface-based representations have been proposed, that allow to reconstruct 3D objects from simple photographs. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Sarthak Gupta , Patrik Huber

In this paper, we present a novel double diffusion based neural radiance field, dubbed DD-NeRF, to reconstruct human body geometry and render the human body appearance in novel views from a sparse set of images. We first propose a double…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Guangming Yao , Hongzhi Wu , Yi Yuan , Lincheng Li , Kun Zhou , Xin Yu

Reconstructing general dynamic scenes is important for many computer vision and graphics applications. Recent works represent the dynamic scene with neural radiance fields for photorealistic view synthesis, while their surface geometry is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Decai Chen , Haofei Lu , Ingo Feldmann , Oliver Schreer , Peter Eisert

Previous multi-view normal integration methods typically sample a single ray per pixel, without considering the spatial area covered by each pixel, which varies with camera intrinsics and the camera-to-object distance. Consequently, when…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Tongyu Yang , Heng Guo , Yasuyuki Matsushita , Fumio Okura , Yu Luo , Xin Fan