中文
相关论文

相关论文: S2RF: Semantically Stylized Radiance Fields

200 篇论文

We present Instant Neural Radiance Fields Stylization, a novel approach for multi-view image stylization for the 3D scene. Our approach models a neural radiance field based on neural graphics primitives, which use a hash table-based…

计算机视觉与模式识别 · 计算机科学 2024-07-03 Shaoxu Li , Ye Pan

Neural Radiance Fields (NeRFs) encode the radiance in a scene parameterized by the scene's plenoptic function. This is achieved by using an MLP together with a mapping to a higher-dimensional space, and has been proven to capture scenes…

计算机视觉与模式识别 · 计算机科学 2022-12-08 Siddhant Ranade , Christoph Lassner , Kai Li , Christian Haene , Shen-Chi Chen , Jean-Charles Bazin , Sofien Bouaziz

We present a novel approach to perform 3D semantic segmentation solely from 2D supervision by leveraging Neural Radiance Fields (NeRFs). By extracting features along a surface point cloud, we achieve a compact representation of the scene…

计算机视觉与模式识别 · 计算机科学 2023-10-10 Dominik Hollidt , Clinton Wang , Polina Golland , Marc Pollefeys

Neural Radiance Field (NeRF) approaches learn the underlying 3D representation of a scene and generate photo-realistic novel views with high fidelity. However, most proposed settings concentrate on modelling a single object or a single…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Ankit Dhiman , Srinath R , Harsh Rangwani , Rishubh Parihar , Lokesh R Boregowda , Srinath Sridhar , R Venkatesh Babu

Stylizing 3D scenes instantly while maintaining multi-view consistency and faithfully resembling a style image remains a significant challenge. Current state-of-the-art 3D stylization methods typically involve computationally intensive…

计算机视觉与模式识别 · 计算机科学 2025-10-21 Peng Wang , Xiang Liu , Peidong Liu

Recent advancements in radiance fields have opened new avenues for creating high-quality 3D assets and scenes. Style transfer can enhance these 3D assets with diverse artistic styles, transforming creative expression. However, existing…

计算机视觉与模式识别 · 计算机科学 2024-07-15 Sahil Jain , Avik Kuthiala , Prabhdeep Singh Sethi , Prakanshul Saxena

Radiance Fields (RF) are popular to represent casually-captured scenes for new view synthesis and several applications beyond it. Mixed reality on personal spaces needs understanding and manipulating scenes represented as RFs, with semantic…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Rahul Goel , Dhawal Sirikonda , Saurabh Saini , PJ Narayanan

3D reconstruction from a single 2D image was extensively covered in the literature but relies on depth supervision at training time, which limits its applicability. To relax the dependence to depth we propose SceneRF, a self-supervised…

计算机视觉与模式识别 · 计算机科学 2023-08-28 Anh-Quan Cao , Raoul de Charette

Most of the existing works on arbitrary 3D NeRF style transfer required retraining on each single style condition. This work aims to achieve zero-shot controlled stylization in 3D scenes utilizing text or visual input as conditioning…

计算机视觉与模式识别 · 计算机科学 2024-03-08 Xingyu Miao , Yang Bai , Haoran Duan , Fan Wan , Yawen Huang , Yang Long , Yefeng Zheng

Recent advances in 3D scene representation and novel view synthesis have witnessed the rise of Neural Radiance Fields (NeRFs). Nevertheless, it is not trivial to exploit NeRF for the photorealistic 3D scene stylization task, which aims to…

计算机视觉与模式识别 · 计算机科学 2023-03-24 Zicheng Zhang , Yinglu Liu , Congying Han , Yingwei Pan , Tiande Guo , Ting Yao

We present radiance field propagation (RFP), a novel approach to segmenting objects in 3D during reconstruction given only unlabeled multi-view images of a scene. RFP is derived from emerging neural radiance field-based techniques, which…

计算机视觉与模式识别 · 计算机科学 2022-10-20 Xinhang Liu , Jiaben Chen , Huai Yu , Yu-Wing Tai , Chi-Keung Tang

Shape and geometric patterns are essential in defining stylistic identity. However, current 3D style transfer methods predominantly focus on transferring colors and textures, often overlooking geometric aspects. In this paper, we introduce…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Hyunyoung Jung , Seonghyeon Nam , Nikolaos Sarafianos , Sungjoo Yoo , Alexander Sorkine-Hornung , Rakesh Ranjan

3D style transfer aims to generate stylized views of 3D scenes with specified styles, which requires high-quality generating and keeping multi-view consistency. Existing methods still suffer the challenges of high-quality stylization with…

计算机视觉与模式识别 · 计算机科学 2025-01-28 Zijiang Yang , Zhongwei Qiu , Chang Xu , Dongmei Fu

Comprehensive 3D scene understanding, both geometrically and semantically, is important for real-world applications such as robot perception. Most of the existing work has focused on developing data-driven discriminative models for scene…

计算机视觉与模式识别 · 计算机科学 2022-06-10 Mingtong Zhang , Shuhong Zheng , Zhipeng Bao , Martial Hebert , Yu-Xiong Wang

4D style transfer aims at transferring arbitrary visual style to the synthesized novel views of a dynamic 4D scene with varying viewpoints and times. Existing efforts on 3D style transfer can effectively combine the visual features of style…

计算机视觉与模式识别 · 计算机科学 2024-03-14 Hongbin Xu , Weitao Chen , Feng Xiao , Baigui Sun , Wenxiong Kang

We present an explicit-grid based method for efficiently reconstructing streaming radiance fields for novel view synthesis of real world dynamic scenes. Instead of training a single model that combines all the frames, we formulate the…

计算机视觉与模式识别 · 计算机科学 2022-10-27 Lingzhi Li , Zhen Shen , Zhongshu Wang , Li Shen , Ping Tan

Emerging neural radiance fields (NeRF) are a promising scene representation for computer graphics, enabling high-quality 3D reconstruction and novel view synthesis from image observations. However, editing a scene represented by a NeRF is…

计算机视觉与模式识别 · 计算机科学 2022-10-18 Sosuke Kobayashi , Eiichi Matsumoto , Vincent Sitzmann

In this system, we discuss methods to stylize a scene of 3D primitive objects into a higher fidelity 3D scene using novel 3D representations like NeRFs and 3D Gaussian Splatting. Our approach leverages existing image stylization systems and…

计算机视觉与模式识别 · 计算机科学 2024-11-12 Yuanbo Chen , Yixiao Kang , Yukun Song , Cyrus Vachha , Sining Huang

Neural radiance fields (NeRF) achieve highly photo-realistic novel-view synthesis, but it's a challenging problem to edit the scenes modeled by NeRF-based methods, especially for dynamic scenes. We propose editable neural radiance fields…

计算机视觉与模式识别 · 计算机科学 2023-03-29 Chengwei Zheng , Wenbin Lin , Feng Xu

Recent neural view synthesis methods have achieved impressive quality and realism, surpassing classical pipelines which rely on multi-view reconstruction. State-of-the-Art methods, such as NeRF, are designed to learn a single scene with a…

计算机视觉与模式识别 · 计算机科学 2021-04-15 Julian Chibane , Aayush Bansal , Verica Lazova , Gerard Pons-Moll