English
Related papers

Related papers: NeRFEditor: Differentiable Style Decomposition for…

200 papers

Neural Radiance Fields (NeRF) have been widely adopted for reconstructing high quality 3D point clouds from 2D RGB images. However, the segmentation of these reconstructed 3D scenes is more essential for downstream tasks such as object…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Jiangsan Zhao , Jakob Geipel , Krzysztof Kusnierek , Xuean Cui

Recent advances in 3D scene representation and novel view synthesis have witnessed the rise of Neural Radiance Fields (NeRFs). Nevertheless, it is not trivial to exploit NeRF for the photorealistic 3D scene stylization task, which aims to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Zicheng Zhang , Yinglu Liu , Congying Han , Yingwei Pan , Tiande Guo , Ting Yao

Neural Radiance Fields (NeRF) is a novel implicit 3D reconstruction method that shows immense potential and has been gaining increasing attention. It enables the reconstruction of 3D scenes solely from a set of photographs. However, its…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Jiaming Gu , Minchao Jiang , Hongsheng Li , Xiaoyuan Lu , Guangming Zhu , Syed Afaq Ali Shah , Liang Zhang , Mohammed Bennamoun

The utilization of implicit representation for visual data (such as images, videos, and 3D models) has recently gained significant attention in computer vision research. In this letter, we propose a novel model steganography scheme with…

Cryptography and Security · Computer Science 2023-09-20 Weina Dong , Jia Liu , Yan Ke , Lifeng Chen , Wenquan Sun , Xiaozhong Pan

Novel view synthesis from a single image requires inferring occluded regions of objects and scenes whilst simultaneously maintaining semantic and physical consistency with the input. Existing approaches condition neural radiance fields…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Jiatao Gu , Alex Trevithick , Kai-En Lin , Josh Susskind , Christian Theobalt , Lingjie Liu , Ravi Ramamoorthi

We introduce a method to generate 3D scenes that are disentangled into their component objects. This disentanglement is unsupervised, relying only on the knowledge of a large pretrained text-to-image model. Our key insight is that objects…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Dave Epstein , Ben Poole , Ben Mildenhall , Alexei A. Efros , Aleksander Holynski

Recently, neural radiance field (NeRF) has shown remarkable performance in novel view synthesis and 3D reconstruction. However, it still requires abundant high-quality images, limiting its applicability in real-world scenarios. To overcome…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Jaewoo Jung , Jisang Han , Jiwon Kang , Seongchan Kim , Min-Seop Kwak , Seungryong Kim

Recently, Neural Radiance Fields (NeRF) is revolutionizing the task of novel view synthesis (NVS) for its superior performance. In this paper, we propose to synthesize dynamic scenes. Extending the methods for static scenes to dynamic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Xiang Guo , Guanying Chen , Yuchao Dai , Xiaoqing Ye , Jiadai Sun , Xiao Tan , Errui Ding

We present Neural 3D Strokes, a novel technique to generate stylized images of a 3D scene at arbitrary novel views from multi-view 2D images. Different from existing methods which apply stylization to trained neural radiance fields at the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Hao-Bin Duan , Miao Wang , Yan-Xun Li , Yong-Liang Yang

Neural radiance fields~(NeRF) have recently been applied to render large-scale scenes. However, their limited model capacity typically results in blurred rendering results. Existing large-scale NeRFs primarily address this limitation by…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Mingqi Shao , Feng Xiong , Hang Zhang , Shuang Yang , Mu Xu , Wei Bian , Xueqian Wang

Extensions of Neural Radiance Fields (NeRFs) to model dynamic scenes have enabled their near photo-realistic, free-viewpoint rendering. Although these methods have shown some potential in creating immersive experiences, two drawbacks limit…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang , Pedro Miraldo , Suhas Lohit , Moitreya Chatterjee

3D-aware image synthesis encompasses a variety of tasks, such as scene generation and novel view synthesis from images. Despite numerous task-specific methods, developing a comprehensive model remains challenging. In this paper, we present…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Hansheng Chen , Jiatao Gu , Anpei Chen , Wei Tian , Zhuowen Tu , Lingjie Liu , Hao Su

Recently, significant progress has been made in the study of methods for 3D reconstruction from multiple images using implicit neural representations, exemplified by the neural radiance field (NeRF) method. Such methods, which are based on…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Wooseok Kim , Taiki Fukiage , Takeshi Oishi

Fully unsupervised 3D representation learning has gained attention owing to its advantages in data collection. A successful approach involves a viewpoint-aware approach that learns an image distribution based on generative models (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Takuhiro Kaneko

Under good conditions, Neural Radiance Fields (NeRFs) have shown impressive results on novel view synthesis tasks. NeRFs learn a scene's color and density fields by minimizing the photometric discrepancy between training views and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Jamie Wynn , Daniyar Turmukhambetov

The ability of neural radiance fields or NeRFs to conduct accurate 3D modelling has motivated application of the technique to scene representation. Previous approaches have mainly followed a centralised learning paradigm, which assumes that…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Lachlan Holden , Feras Dayoub , David Harvey , Tat-Jun Chin

We cast multiview reconstruction from unknown pose as a generative modeling problem. From a collection of unannotated 2D images of a scene, our approach simultaneously learns both a network to predict camera pose from 2D image input, as…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Xin Yuan , Rana Hanocka , Michael Maire

We introduce NeRFCom, a novel communication system designed for end-to-end 3D scene transmission. Compared to traditional systems relying on handcrafted NeRF semantic feature decomposition for compression and well-adaptive channel coding…

Signal Processing · Electrical Eng. & Systems 2025-02-28 Weijie Yue , Zhongwei Si , Bolin Wu , Sixian Wang , Xiaoqi Qin , Kai Niu , Jincheng Dai , Ping Zhang

Recent advances in neural rendering have enabled highly photorealistic 3D scene reconstruction and novel view synthesis. Despite this progress, current state-of-the-art methods struggle to reconstruct high frequency detail, due to factors…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Sibi Catley-Chandar , Richard Shaw , Gregory Slabaugh , Eduardo Perez-Pellitero

A practical benefit of implicit visual representations like Neural Radiance Fields (NeRFs) is their memory efficiency: large scenes can be efficiently stored and shared as small neural nets instead of collections of images. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Jiading Fang , Shengjie Lin , Igor Vasiljevic , Vitor Guizilini , Rares Ambrus , Adrien Gaidon , Gregory Shakhnarovich , Matthew R. Walter