English
Related papers

Related papers: ROGR: Relightable 3D Objects using Generative Reli…

200 papers

We present a method to learn compositional multi-object dynamics models from image observations based on implicit object encoders, Neural Radiance Fields (NeRFs), and graph neural networks. NeRFs have become a popular choice for…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Danny Driess , Zhiao Huang , Yunzhu Li , Russ Tedrake , Marc Toussaint

We present a scheme for fast environment light estimation from the RGBD appearance of individual objects and their local image areas. Conventional inverse rendering is too computationally demanding for real-time applications, and the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-07 Xin Wei , Guojun Chen , Yue Dong , Stephen Lin , Xin Tong

3D reconstruction from images has wide applications in Virtual Reality and Automatic Driving, where the precision requirement is very high. Ground-breaking research in the neural radiance field (NeRF) by utilizing Multi-Layer Perceptions…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Jiaming Shen , Bolin Song , Zirui Wu , Yi Xu

We present a method for learning a generative 3D model based on neural radiance fields, trained solely from data with only single views of each object. While generating realistic images is no longer a difficult task, producing the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Daniel Rebain , Mark Matthews , Kwang Moo Yi , Dmitry Lagun , Andrea Tagliasacchi

3D reconstruction technology generates three-dimensional representations of real-world objects, scenes, or environments using sensor data such as 2D images, with extensive applications in robotics, autonomous vehicles, and virtual reality…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Hong Zhang , Fei Guo , Zihan Xie , Dizhao Yao

Recent work on Neural Radiance Fields (NeRF) exploits multi-view 3D consistency, achieving impressive results in 3D scene modeling and high-fidelity novel-view synthesis. However, there are limitations. First, existing methods assume enough…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Mengfei Li , Ming Lu , Xiaofang Li , Shanghang Zhang

Unlike opaque object, novel view synthesis of transparent object is a challenging task, because transparent object refracts light of background causing visual distortions on the transparent object surface along the viewpoint change.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Heechan Yoon , Seungkyu Lee

Articulated objects and their representations pose a difficult problem for robots. These objects require not only representations of geometry and texture, but also of the various connections and joint parameters that make up each…

Robotics · Computer Science 2024-09-17 Stanley Lewis , Tom Gao , Odest Chadwicke Jenkins

We consider the challenging problem of outdoor lighting estimation for the goal of photorealistic virtual object insertion into photographs. Existing works on outdoor lighting estimation typically simplify the scene lighting into an…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Zian Wang , Wenzheng Chen , David Acuna , Jan Kautz , Sanja Fidler

Common capture low-light scenes are challenging for most computer vision techniques, including Neural Radiance Fields (NeRF). Vanilla NeRF is viewer-centred simplifies the rendering process only as light emission from 3D locations in the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Ziteng Cui , Lin Gu , Xiao Sun , Xianzheng Ma , Yu Qiao , Tatsuya Harada

We introduce Stanford-ORB, a new real-world 3D Object inverse Rendering Benchmark. Recent advances in inverse rendering have enabled a wide range of real-world applications in 3D content generation, moving rapidly from research and…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Zhengfei Kuang , Yunzhi Zhang , Hong-Xing Yu , Samir Agarwala , Shangzhe Wu , Jiajun Wu

Neural implicit representation of visual scenes has attracted a lot of attention in recent research of computer vision and graphics. Most prior methods focus on how to reconstruct 3D scene representation from a set of images. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Wenpu Li , Pian Wan , Peng Wang , Jinghang Li , Yi Zhou , Peidong Liu

Reconstructing an object from photos and placing it virtually in a new environment goes beyond the standard novel view synthesis task as the appearance of the object has to not only adapt to the novel viewpoint but also to the new lighting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Benjamin Ummenhofer , Sanskar Agrawal , Rene Sepulveda , Yixing Lao , Kai Zhang , Tianhang Cheng , Stephan Richter , Shenlong Wang , German Ros

This study presents a novel approach for generating holograms based on the neural radiance fields (NeRF) technique. Generating three-dimensional (3D) data is difficult in hologram computation. NeRF is a state-of-the-art technique for 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Minsung Kang , Fan Wang , Kai Kumano , Tomoyoshi Ito , Tomoyoshi Shimobaba

Neural Radiance Fields (NeRFs) have become a widely-applied scene representation technique in recent years, showing advantages for robot navigation and manipulation tasks. To further advance the utility of NeRFs for robotics, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Jiankai Sun , Yan Xu , Mingyu Ding , Hongwei Yi , Chen Wang , Jingdong Wang , Liangjun Zhang , Mac Schwager

Radiance fields have gradually become a main representation of media. Although its appearance editing has been studied, how to achieve view-consistent recoloring in an efficient manner is still under explored. We present RecolorNeRF, a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Bingchen Gong , Yuehao Wang , Xiaoguang Han , Qi Dou

Neural Radiance Fields (NeRF) have shown impressive novel view synthesis results; nonetheless, even thorough recordings yield imperfections in reconstructions, for instance due to poorly observed areas or minor lighting changes. Our goal is…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Barbara Roessle , Norman Müller , Lorenzo Porzi , Samuel Rota Bulò , Peter Kontschieder , Matthias Nießner

We introduce DyNFL, a novel neural field-based approach for high-fidelity re-simulation of LiDAR scans in dynamic driving scenes. DyNFL processes LiDAR measurements from dynamic environments, accompanied by bounding boxes of moving objects,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Hanfeng Wu , Xingxing Zuo , Stefan Leutenegger , Or Litany , Konrad Schindler , Shengyu Huang

We propose a Transformer-based NeRF (TransNeRF) to learn a generic neural radiance field conditioned on observed-view images for the novel view synthesis task. By contrast, existing MLP-based NeRFs are not able to directly receive observed…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Dan Wang , Xinrui Cui , Septimiu Salcudean , Z. Jane Wang

Recent advances in Neural Radiance Fields (NeRF) have shown great potential in 3D reconstruction and novel view synthesis, particularly for indoor and small-scale scenes. However, extending NeRF to large-scale outdoor environments presents…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yizhou Li , Yusuke Monno , Masatoshi Okutomi , Yuuichi Tanaka , Seiichi Kataoka , Teruaki Kosiba