English
Related papers

Related papers: NeRF-Insert: 3D Local Editing with Multimodal Cont…

200 papers

We propose InNeRF360, an automatic system that accurately removes text-specified objects from 360-degree Neural Radiance Fields (NeRF). The challenge is to effectively remove objects while inpainting perceptually consistent content for the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Dongqing Wang , Tong Zhang , Alaa Abboud , Sabine Süsstrunk

We present neural radiance fields (NeRF) with templates, dubbed Template-NeRF, for modeling appearance and geometry and generating dense shape correspondences simultaneously among objects of the same category from only multi-view posed…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Jianfei Guo , Zhiyuan Yang , Xi Lin , Qingfu Zhang

Most NeRF-based models are designed for learning the entire scene, and complex scenes can lead to longer learning times and poorer rendering effects. This paper utilizes scene semantic priors to make improvements in fast training, allowing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Yuesong Li , Feng Pan , Helong Yan , Xiuli Xin , Xiaoxue Feng

The emergence of Neural Radiance Fields (NeRF) for novel view synthesis has increased interest in 3D scene editing. An essential task in editing is removing objects from a scene while ensuring visual reasonability and multiview consistency.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Youtan Yin , Zhoujie Fu , Fan Yang , Guosheng Lin

3D scene stylization aims at generating stylized images of the scene from arbitrary novel views following a given set of style examples, while ensuring consistency when rendered from different views. Directly applying methods for image or…

Graphics · Computer Science 2022-05-26 Yi-Hua Huang , Yue He , Yu-Jie Yuan , Yu-Kun Lai , Lin Gao

We propose Multi-spectral Neural Radiance Fields(Spec-NeRF) for jointly reconstructing a multispectral radiance field and spectral sensitivity functions(SSFs) of the camera from a set of color images filtered by different filters. The…

Image and Video Processing · Electrical Eng. & Systems 2023-10-23 Jiabao Li , Yuqi Li , Ciliang Sun , Chong Wang , Jinhui Xiang

Recent advancements in text-based diffusion models have accelerated progress in 3D reconstruction and text-based 3D editing. Although existing 3D editing methods excel at modifying color, texture, and style, they struggle with extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Susung Hong , Johanna Karras , Ricardo Martin-Brualla , Ira Kemelmacher-Shlizerman

The method of neural radiance fields (NeRF) has been developed in recent years, and this technology has promising applications for synthesizing novel views of complex scenes. However, NeRF requires dense input views, typically numbering in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Young Chun Ahn , Seokhwan Jang , Sungheon Park , Ji-Yeon Kim , Nahyup Kang

Style transfer for human face has been widely researched in recent years. Majority of the existing approaches work in 2D image domain and have 3D inconsistency issue when applied on different viewpoints of the same face. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Jianwei Feng , Prateek Singhal

Purely MLP-based neural radiance fields (NeRF-based methods) often suffer from underfitting with blurred renderings on large-scale scenes due to limited model capacity. Recent approaches propose to geographically divide the scene and adopt…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Linning Xu , Yuanbo Xiangli , Sida Peng , Xingang Pan , Nanxuan Zhao , Christian Theobalt , Bo Dai , Dahua Lin

Recent advances in Neural Fields mostly rely on developing task-specific supervision which often complicates the models. Rather than developing hard-to-combine and specific modules, another approach generally overlooked is to directly…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Doriand Petit , Steve Bourgeois , Dumitru Pavel , Vincent Gay-Bellile , Florian Chabot , Loic Barthe

The success of the GAN-NeRF structure has enabled face editing on NeRF to maintain 3D view consistency. However, achieving simultaneously multi-view consistency and temporal coherence while editing video sequences remains a formidable…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Hao Zhang , Yu-Wing Tai , Chi-Keung Tang

Neural Radiance Fields (NeRFs) have proven to be powerful 3D representations, capable of high quality novel view synthesis of complex scenes. While NeRFs have been applied to graphics, vision, and robotics, problems with slow rendering…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Tristan Aumentado-Armstrong , Ashkan Mirzaei , Marcus A. Brubaker , Jonathan Kelly , Alex Levinshtein , Konstantinos G. Derpanis , Igor Gilitschenski

Many real-world 3D reconstruction applications demand photorealism and metric accuracy across unbounded, complex scenes with challenging lighting and imperfect captures that current Neural Radiance Field (NeRF) pipelines only partly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Vladislav Polianskii , Elijs Dima , Isabel Salmerón Marazuela , Gergő László Nagy , Sigurdur Sverrisson , Volodya Grancharov

Traditional 3D face models are based on mesh representations with texture. One of the most important models is FLAME (Faces Learned with an Articulated Model and Expressions), which produces meshes of human faces that are fully…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Wojciech Zając , Joanna Waczyńska , Piotr Borycki , Jacek Tabor , Maciej Zięba , Przemysław Spurek

We address efficient and structure-aware 3D scene representation from images. Nerflets are our key contribution -- a set of local neural radiance fields that together represent a scene. Each nerflet maintains its own spatial position,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Xiaoshuai Zhang , Abhijit Kundu , Thomas Funkhouser , Leonidas Guibas , Hao Su , Kyle Genova

Implicit neural representations have shown powerful capacity in modeling real-world 3D scenes, offering superior performance in novel view synthesis. In this paper, we target a more challenging scenario, i.e., joint scene novel view…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Yuxin Wang , Wayne Wu , Dan Xu

Generating free-viewpoint videos is critical for immersive VR/AR experience but recent neural advances still lack the editing ability to manipulate the visual perception for large dynamic scenes. To fill this gap, in this paper we propose…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Jiakai Zhang , Xinhang Liu , Xinyi Ye , Fuqiang Zhao , Yanshun Zhang , Minye Wu , Yingliang Zhang , Lan Xu , Jingyi Yu

Neural Radiance Fields (NeRF) have transformed novel view synthesis by modeling scene-specific volumetric representations directly from images. While generalizable NeRF models can generate novel views across unknown scenes by learning…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 You Wang , Li Fang , Hao Zhu , Fei Hu , Long Ye , Zhan Ma

This work presents Insert Anything, a unified framework for reference-based image insertion that seamlessly integrates objects from reference images into target scenes under flexible, user-specified control guidance. Instead of training…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Wensong Song , Hong Jiang , Zongxing Yang , Ruijie Quan , Yi Yang