English
Related papers

Related papers: NeRF-Art: Text-Driven Neural Radiance Fields Styli…

200 papers

Neural Radiance Fields (NeRFs) have emerged as powerful tools for capturing detailed 3D scenes through continuous volumetric representations. Recent NeRFs utilize feature grids to improve rendering quality and speed; however, these…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Tuan Pham , Stephan Mandt

We tackle the task of NeRF inversion for style-based neural radiance fields, (e.g., StyleNeRF). In the task, we aim to learn an inversion function to project an input image to the latent space of a NeRF generator and then synthesize novel…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Yu-Jhe Li , Tao Xu , Bichen Wu , Ningyuan Zheng , Xiaoliang Dai , Albert Pumarola , Peizhao Zhang , Peter Vajda , Kris Kitani

Neural Radiance Fields (NeRFs) aim to synthesize novel views of objects and scenes, given the object-centric camera views with large overlaps. However, we conjugate that this paradigm does not fit the nature of the street views that are…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Ziyang Xie , Junge Zhang , Wenye Li , Feihu Zhang , Li Zhang

In this paper, we present a novel and effective framework, named 4K-NeRF, to pursue high fidelity view synthesis on the challenging scenarios of ultra high resolutions, building on the methodology of neural radiance fields (NeRF). The…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Zhongshu Wang , Lingzhi Li , Zhen Shen , Li Shen , Liefeng Bo

Novel view synthesis (NVS) aims to generate images at arbitrary viewpoints using multi-view images, and recent insights from neural radiance fields (NeRF) have contributed to remarkable improvements. Recently, studies on generalizable NeRF…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Youngho Yoon , Hyun-Kurl Jang , Kuk-Jin Yoon

Contemporary registration devices for 3D visual information, such as LIDARs and various depth cameras, capture data as 3D point clouds. In turn, such clouds are challenging to be processed due to their size and complexity. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Dominik Zimny , Joanna Waczyńska , Tomasz Trzciński , Przemysław Spurek

Recently, the editing of neural radiance fields (NeRFs) has gained considerable attention, but most prior works focus on static scenes while research on the appearance editing of dynamic scenes is relatively lacking. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Shangzan Zhang , Sida Peng , Yinji ShenTu , Qing Shuai , Tianrun Chen , Kaicheng Yu , Hujun Bao , Xiaowei Zhou

Volumetric neural rendering methods, such as neural radiance fields (NeRFs), have enabled photo-realistic novel view synthesis. However, in their standard form, NeRFs do not support the editing of objects, such as a human head, within a…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 ShahRukh Athar , Zexiang Xu , Kalyan Sunkavalli , Eli Shechtman , Zhixin Shu

3D face generation has achieved high visual quality and 3D consistency thanks to the development of neural radiance fields (NeRF). Recently, to generate and edit 3D faces with NeRF representation, some methods are proposed and achieve good…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Wenyang Zhou , Lu Yuan , Shuyu Chen , Lin Gao , Shimin Hu

As a promising fashion for visual localization, scene coordinate regression (SCR) has seen tremendous progress in the past decade. Most recent methods usually adopt neural networks to learn the mapping from image pixels to 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Le Chen , Weirong Chen , Rui Wang , Marc Pollefeys

Neural Radiance Field (NeRF) and its variants have exhibited great success on representing 3D scenes and synthesizing photo-realistic novel views. However, they are generally based on the pinhole camera model and assume all-in-focus inputs.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Zijin Wu , Xingyi Li , Juewen Peng , Hao Lu , Zhiguo Cao , Weicai Zhong

Neural Radiance Field (NeRF) has shown impressive performance in novel view synthesis via implicit scene representation. However, it usually suffers from poor scalability as requiring densely sampled images for each new scene. Several…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Muyu Xu , Fangneng Zhan , Jiahui Zhang , Yingchen Yu , Xiaoqin Zhang , Christian Theobalt , Ling Shao , Shijian Lu

We study the problem of reconstructing 3D feature curves of an object from a set of calibrated multi-view images. To do so, we learn a neural implicit field representing the density distribution of 3D edges which we refer to as Neural Edge…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Yunfan Ye , Renjiao Yi , Zhirui Gao , Chenyang Zhu , Zhiping Cai , Kai Xu

While Neural Radiance Fields (NeRFs) had achieved unprecedented novel view synthesis results, they have been struggling in dealing with large-scale cluttered scenes with sparse input views and highly view-dependent appearances.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang

Recently, Neural Radiance Fields (NeRF) have emerged as a potent method for synthesizing novel views from a dense set of images. Despite its impressive performance, NeRF is plagued by its necessity for numerous calibrated views and its…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Jiayang Bai , Letian Huang , Wen Gong , Jie Guo , Yanwen Guo

We present Neural Articulated Radiance Field (NARF), a novel deformable 3D representation for articulated objects learned from images. While recent advances in 3D implicit representation have made it possible to learn models of complex…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Atsuhiro Noguchi , Xiao Sun , Stephen Lin , Tatsuya Harada

In this work, we develop intuitive controls for editing the style of 3D objects. Our framework, Text2Mesh, stylizes a 3D mesh by predicting color and local geometric details which conform to a target text prompt. We consider a disentangled…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Oscar Michel , Roi Bar-On , Richard Liu , Sagie Benaim , Rana Hanocka

The neural radiance field (NeRF) achieved remarkable success in modeling 3D scenes and synthesizing high-fidelity novel views. However, existing NeRF-based methods focus more on the make full use of the image resolution to generate novel…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Yuqi Han , Tao Yu , Xiaohang Yu , Yuwang Wang , Qionghai Dai

Animating high-fidelity video portrait with speech audio is crucial for virtual reality and digital entertainment. While most previous studies rely on accurate explicit structural information, recent works explore the implicit scene…

Computer Vision and Pattern Recognition · Computer Science 2022-02-11 Xian Liu , Yinghao Xu , Qianyi Wu , Hang Zhou , Wayne Wu , Bolei Zhou

Current 3D stylization methods often assume static scenes, which violates the dynamic nature of our real world. To address this limitation, we present S-DyRF, a reference-based spatio-temporal stylization method for dynamic neural radiance…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Xingyi Li , Zhiguo Cao , Yizheng Wu , Kewei Wang , Ke Xian , Zhe Wang , Guosheng Lin