English
Related papers

Related papers: Language-driven Object Fusion into Neural Radiance…

200 papers

Radiance fields have revolutionized photo-realistic 3D scene visualization by enabling high-fidelity reconstruction of complex environments, making them an ideal match for light field displays. However, integrating these technologies…

Neural Radiance Fields (NeRF) has achieved unprecedented view synthesis quality using coordinate-based neural scene representations. However, NeRF's view dependency can only handle simple reflections like highlights but cannot deal with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Yuan-Chen Guo , Di Kang , Linchao Bao , Yu He , Song-Hai Zhang

We combine neural rendering with multi-modal image and text representations to synthesize diverse 3D objects solely from natural language descriptions. Our method, Dream Fields, can generate the geometry and color of a wide range of objects…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Ajay Jain , Ben Mildenhall , Jonathan T. Barron , Pieter Abbeel , Ben Poole

Neural radiance fields (NeRFs) are able to synthesize realistic novel views from multi-view images captured from distinct positions and perspectives. In NeRF's rendering pipeline, neural networks are used to represent a scene independently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Kang Han , Wei Xiang , Lu Yu

In recent years, there has been a surge of interest in open-vocabulary 3D scene reconstruction facilitated by visual language models (VLMs), which showcase remarkable capabilities in open-set retrieval. However, existing methods face some…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Yinan Deng , Jiahui Wang , Jingyu Zhao , Jianyu Dou , Yi Yang , Yufeng Yue

3D scenes photorealistic stylization aims to generate photorealistic images from arbitrary novel views according to a given style image while ensuring consistency when rendering from different viewpoints. Some existing stylization methods…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Yaosen Chen , Qi Yuan , Zhiqiang Li , Yuegen Liu , Wei Wang , Chaoping Xie , Xuming Wen , Qien Yu

Dynamic neural radiance fields (dynamic NeRFs) have demonstrated impressive results in novel view synthesis on 3D dynamic scenes. However, they often require complete video sequences for training followed by novel view synthesis, which is…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Zhiwen Yan , Chen Li , Gim Hee Lee

This paper proposes a hybrid radiance field representation for unbounded immersive light field reconstruction which supports high-quality rendering and aggressive view extrapolation. The key idea is to first formally separate the foreground…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Xiaohang Yu , Haoxiang Wang , Yuqi Han , Lei Yang , Tao Yu , Qionghai Dai

Image blending aims to combine multiple images seamlessly. It remains challenging for existing 2D-based methods, especially when input images are misaligned due to differences in 3D camera poses and object shapes. To tackle these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Hyunsu Kim , Gayoung Lee , Yunjey Choi , Jin-Hwa Kim , Jun-Yan Zhu

Existing inverse rendering combined with neural rendering methods can only perform editable novel view synthesis on object-specific scenes, while we present intrinsic neural radiance fields, dubbed IntrinsicNeRF, which introduce intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Weicai Ye , Shuo Chen , Chong Bao , Hujun Bao , Marc Pollefeys , Zhaopeng Cui , Guofeng Zhang

Neural Radiance Fields (NeRF) give rise to learning-based 3D reconstruction methods widely used in industrial applications. Although prevalent methods achieve considerable improvements in small-scale scenes, accomplishing reconstruction in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Bingnan Ni , Huanyu Wang , Dongfeng Bai , Minghe Weng , Dexin Qi , Weichao Qiu , Bingbing Liu

We address the problem of multi-object 3D pose control in image diffusion models. Instead of conditioning on a sequence of text tokens, we propose to use a set of per-object representations, Neural Assets, to control the 3D pose of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Ziyi Wu , Yulia Rubanova , Rishabh Kabra , Drew A. Hudson , Igor Gilitschenski , Yusuf Aytar , Sjoerd van Steenkiste , Kelsey R. Allen , Thomas Kipf

Neural Radiance Fields (NeRF) is a cutting-edge neural network-based technique for novel view synthesis in 3D reconstruction. However, its significant computational demands pose challenges for deployment on mobile devices. While mesh-based…

Graphics · Computer Science 2025-04-07 Zhe Wang , Yifei Zhu

Neural Radiance Field (NeRF) has achieved substantial progress in novel view synthesis given multi-view images. Recently, some works have attempted to train a NeRF from a single image with 3D priors. They mainly focus on a limited field of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Guangcong Wang , Peng Wang , Zhaoxi Chen , Wenping Wang , Chen Change Loy , Ziwei Liu

This paper proposes a method for fast scene radiance field reconstruction with strong novel view synthesis performance and convenient scene editing functionality. The key idea is to fully utilize semantic parsing and primitive extraction…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Haiyang Ying , Baowei Jiang , Jinzhi Zhang , Di Xu , Tao Yu , Qionghai Dai , Lu Fang

We present ASSIST, an object-wise neural radiance field as a panoptic representation for compositional and realistic simulation. Central to our approach is a novel scene node data structure that stores the information of each object in a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Zhide Zhong , Jiakai Cao , Songen Gu , Sirui Xie , Weibo Gao , Liyi Luo , Zike Yan , Hao Zhao , Guyue Zhou

This paper targets interactive object-level editing (e.g., deletion, recoloring, transformation, composition) in dynamic scenes. Recently, some methods aiming for flexible editing static scenes represented by neural radiance field (NeRF)…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Dadong Jiang , Zhihui Ke , Xiaobo Zhou , Xidong Shi

Neural radiance fields (NeRFs) have become a ubiquitous tool for modeling scene appearance and geometry from multiview imagery. Recent work has also begun to explore how to use additional supervision from lidar or depth sensor measurements…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Anagh Malik , Parsa Mirdehghan , Sotiris Nousias , Kiriakos N. Kutulakos , David B. Lindell

This paper proposes a novel approach for rendering a pre-trained Neural Radiance Field (NeRF) in real-time on resource-constrained devices. We introduce Re-ReND, a method enabling Real-time Rendering of NeRFs across Devices. Re-ReND is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Sara Rojas , Jesus Zarzar , Juan Camilo Perez , Artsiom Sanakoyeu , Ali Thabet , Albert Pumarola , Bernard Ghanem

Neural Radiance Fields (NeRFs) have remodeled 3D scene representation since release. NeRFs can effectively reconstruct complex 3D scenes from 2D images, advancing different fields and applications such as scene understanding, 3D content…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Wenhui Xiao , Remi Chierchia , Rodrigo Santa Cruz , Xuesong Li , David Ahmedt-Aristizabal , Olivier Salvado , Clinton Fookes , Leo Lebrat