English
Related papers

Related papers: Learning Object-Compositional Neural Radiance Fiel…

200 papers

Neural fields have recently enjoyed great success in representing and rendering 3D scenes. However, most state-of-the-art implicit representations model static or dynamic scenes as a whole, with minor variations. Existing work on learning…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Akshay Krishnan , Amit Raj , Xianling Zhang , Alexandra Carlson , Nathan Tseng , Sandhya Sridhar , Nikita Jaipuria , James Hays

We present Neural Reflectance Fields, a novel deep scene representation that encodes volume density, normal and reflectance properties at any 3D point in a scene using a fully-connected neural network. We combine this representation with a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Sai Bi , Zexiang Xu , Pratul Srinivasan , Ben Mildenhall , Kalyan Sunkavalli , Miloš Hašan , Yannick Hold-Geoffroy , David Kriegman , Ravi Ramamoorthi

We propose a novel visual re-localization method based on direct matching between the implicit 3D descriptors and the 2D image with transformer. A conditional neural radiance field(NeRF) is chosen as the 3D scene representation in our…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Jianlin Liu , Qiang Nie , Yong Liu , Chengjie Wang

We, as human beings, can understand and picture a familiar scene from arbitrary viewpoints given a single image, whereas this is still a grand challenge for computers. We hereby present a novel solution to mimic such human perception…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Bangbang Yang , Yinda Zhang , Yijin Li , Zhaopeng Cui , Sean Fanello , Hujun Bao , Guofeng Zhang

In this work, we aim to address the 3D scene stylization problem - generating stylized images of the scene at arbitrary novel view angles. A straightforward solution is to combine existing novel view synthesis and image/video style transfer…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Pei-Ze Chiang , Meng-Shiun Tsai , Hung-Yu Tseng , Wei-sheng Lai , Wei-Chen Chiu

We present Instant Neural Radiance Fields Stylization, a novel approach for multi-view image stylization for the 3D scene. Our approach models a neural radiance field based on neural graphics primitives, which use a hash table-based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Shaoxu Li , Ye Pan

Rendering novel views from captured multi-view images has made considerable progress since the emergence of the neural radiance field. This paper aims to further advance the quality of view synthesis by proposing a novel approach dubbed the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Kang Han , Wei Xiang

Since the advent of Neural Radiance Fields, novel view synthesis has received tremendous attention. The existing approach for the generalization of radiance field reconstruction primarily constructs an encoding volume from nearby source…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Jingliang Li , Qiang Zhou , Chaohui Yu , Zhengda Lu , Jun Xiao , Zhibin Wang , Fan Wang

This project presents an exploration into 3D scene reconstruction of synthetic and real-world scenes using Neural Radiance Field (NeRF) approaches. We primarily take advantage of the reduction in training and rendering time of neural…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Benedict Quartey , Tuluhan Akbulut , Wasiwasi Mgonzo , Zheng Xin Yong

We introduce an improved solution to the neural image-based rendering problem in computer vision. Given a set of images taken from a freely moving camera at train time, the proposed approach could synthesize a realistic image of the scene…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Nishant Jain , Suryansh Kumar , Luc Van Gool

Comprehensive 3D scene understanding, both geometrically and semantically, is important for real-world applications such as robot perception. Most of the existing work has focused on developing data-driven discriminative models for scene…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Mingtong Zhang , Shuhong Zheng , Zhipeng Bao , Martial Hebert , Yu-Xiong Wang

Decomposing a scene into its shape, reflectance, and illumination is a challenging but important problem in computer vision and graphics. This problem is inherently more challenging when the illumination is not a single light source under…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Mark Boss , Raphael Braun , Varun Jampani , Jonathan T. Barron , Ce Liu , Hendrik P. A. Lensch

We propose a method for reconstructing a continuous light field of a target scene from a single observed image. Our method takes the best of two worlds: joint aperture-exposure coding for compressive light-field acquisition, and a neural…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Yuya Ishikawa , Keita Takahashi , Chihiro Tsutake , Toshiaki Fujii

We present ASSIST, an object-wise neural radiance field as a panoptic representation for compositional and realistic simulation. Central to our approach is a novel scene node data structure that stores the information of each object in a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Zhide Zhong , Jiakai Cao , Songen Gu , Sirui Xie , Weibo Gao , Liyi Luo , Zike Yan , Hao Zhao , Guyue Zhou

Neural radiance fields (NeRF) achieve highly photo-realistic novel-view synthesis, but it's a challenging problem to edit the scenes modeled by NeRF-based methods, especially for dynamic scenes. We propose editable neural radiance fields…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Chengwei Zheng , Wenbin Lin , Feng Xu

We present a new neural representation, called Neural Ray (NeuRay), for the novel view synthesis task. Recent works construct radiance fields from image features of input views to render novel view images, which enables the generalization…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yuan Liu , Sida Peng , Lingjie Liu , Qianqian Wang , Peng Wang , Christian Theobalt , Xiaowei Zhou , Wenping Wang

Synthesizing photo-realistic images and videos is at the heart of computer graphics and has been the focus of decades of research. Traditionally, synthetic images of a scene are generated using rendering algorithms such as rasterization or…

Classical light field rendering for novel view synthesis can accurately reproduce view-dependent effects such as reflection, refraction, and translucency, but requires a dense view sampling of the scene. Methods based on geometric…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Mohammed Suhail , Carlos Esteves , Leonid Sigal , Ameesh Makadia

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

We estimate the radiance field of large-scale dynamic areas from multiple vehicle captures under varying environmental conditions. Previous works in this domain are either restricted to static environments, do not scale to more than a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Tobias Fischer , Lorenzo Porzi , Samuel Rota Bulò , Marc Pollefeys , Peter Kontschieder