English
Related papers

Related papers: StyleTRF: Stylizing Tensorial Radiance Fields

200 papers

Despite the rapid development of Neural Radiance Field (NeRF), the necessity of dense covers largely prohibits its wider applications. While several recent works have attempted to address this issue, they either operate with sparse views…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Dejia Xu , Yifan Jiang , Peihao Wang , Zhiwen Fan , Humphrey Shi , Zhangyang Wang

Novel view synthesis using neural radiance fields (NeRF) is the state-of-the-art technique for generating high-quality images from novel viewpoints. Existing methods require a priori knowledge about extrinsic and intrinsic camera…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Hannah Schieber , Fabian Deuser , Bernhard Egger , Norbert Oswald , Daniel Roth

In volume visualization, visualization synthesis has attracted much attention due to its ability to generate novel visualizations without following the conventional rendering pipeline. However, existing solutions based on generative…

Graphics · Computer Science 2024-08-02 Kaiyuan Tang , Chaoli Wang

We propose a Transformer-based NeRF (TransNeRF) to learn a generic neural radiance field conditioned on observed-view images for the novel view synthesis task. By contrast, existing MLP-based NeRFs are not able to directly receive observed…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Dan Wang , Xinrui Cui , Septimiu Salcudean , Z. Jane Wang

Style transfer for human face has been widely researched in recent years. Majority of the existing approaches work in 2D image domain and have 3D inconsistency issue when applied on different viewpoints of the same face. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Jianwei Feng , Prateek Singhal

Extensions of Neural Radiance Fields (NeRFs) to model dynamic scenes have enabled their near photo-realistic, free-viewpoint rendering. Although these methods have shown some potential in creating immersive experiences, two drawbacks limit…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang , Pedro Miraldo , Suhas Lohit , Moitreya Chatterjee

Neural Radiance Fields (NeRF) show impressive performance in photo-realistic free-view rendering of scenes. Recent improvements on the NeRF such as TensoRF and ZipNeRF employ explicit models for faster optimization and rendering, as…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Nagabhushan Somraj , Sai Harsha Mupparaju , Adithyan Karanayil , Rajiv Soundararajan

We present neural radiance fields (NeRF) with templates, dubbed Template-NeRF, for modeling appearance and geometry and generating dense shape correspondences simultaneously among objects of the same category from only multi-view posed…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Jianfei Guo , Zhiyuan Yang , Xi Lin , Qingfu Zhang

3D style transfer aims to render stylized novel views of a 3D scene with multi-view consistency. However, most existing work suffers from a three-way dilemma over accurate geometry reconstruction, high-quality stylization, and being…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Kunhao Liu , Fangneng Zhan , Yiwen Chen , Jiahui Zhang , Yingchen Yu , Abdulmotaleb El Saddik , Shijian Lu , Eric Xing

This paper introduces a novel continual learning framework for synthesising novel views of multiple scenes, learning multiple 3D scenes incrementally, and updating the network parameters only with the training data of the upcoming new…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Yuze Wang , Junyi Wang , Chen Wang , Wantong Duan , Yongtang Bao , Yue Qi

This paper presents a novel grid-based NeRF called F2-NeRF (Fast-Free-NeRF) for novel view synthesis, which enables arbitrary input camera trajectories and only costs a few minutes for training. Existing fast grid-based NeRF training…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Peng Wang , Yuan Liu , Zhaoxi Chen , Lingjie Liu , Ziwei Liu , Taku Komura , Christian Theobalt , Wenping Wang

Neural Radiance Field (NeRF) has emerged as a compelling method to represent 3D objects and scenes for photo-realistic rendering. However, its implicit representation causes difficulty in manipulating the models like the explicit mesh…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Jiaxiang Tang , Xiaokang Chen , Jingbo Wang , Gang Zeng

Neural Radiance Field (NeRF) is a promising approach for synthesizing novel views, given a set of images and the corresponding camera poses of a scene. However, images photographed from a low-light scene can hardly be used to train a NeRF…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Haoyuan Wang , Xiaogang Xu , Ke Xu , Rynson WH. Lau

Advances in image diffusion models have recently led to notable improvements in the generation of high-quality images. In combination with Neural Radiance Fields (NeRFs), they enabled new opportunities in 3D generation. However, most…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Jan-Niklas Dihlmann , Andreas Engelhardt , Hendrik Lensch

We present a method for estimating neural scenes representations of objects given only a single image. The core of our method is the estimation of a geometric scaffold for the object and its use as a guide for the reconstruction of the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Konstantinos Rematas , Ricardo Martin-Brualla , Vittorio Ferrari

We propose a simple yet effective pipeline for stylizing a 3D scene, harnessing the power of 2D image diffusion models. Given a NeRF model reconstructed from a set of multi-view images, we perform 3D style transfer by refining the source…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Haruo Fujiwara , Yusuke Mukuta , Tatsuya Harada

Neural Radiance Fields (NeRF) show impressive performance for the photorealistic free-view rendering of scenes. However, NeRFs require dense sampling of images in the given scene, and their performance degrades significantly when only a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Nagabhushan Somraj , Adithyan Karanayil , Rajiv Soundararajan

Neural rendering techniques combining machine learning with geometric reasoning have arisen as one of the most promising approaches for synthesizing novel views of a scene from a sparse set of images. Among these, stands out the Neural…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Albert Pumarola , Enric Corona , Gerard Pons-Moll , Francesc Moreno-Noguer

As a promising fashion for visual localization, scene coordinate regression (SCR) has seen tremendous progress in the past decade. Most recent methods usually adopt neural networks to learn the mapping from image pixels to 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Le Chen , Weirong Chen , Rui Wang , Marc Pollefeys

Novel view synthesis (NVS) is a challenging task in computer vision that involves synthesizing new views of a scene from a limited set of input images. Neural Radiance Fields (NeRF) have emerged as a powerful approach to address this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Shuja Khalid , Frank Rudzicz