English
Related papers

Related papers: NeROIC: Neural Rendering of Objects from Online Im…

200 papers

Existing inverse rendering combined with neural rendering methods can only perform editable novel view synthesis on object-specific scenes, while we present intrinsic neural radiance fields, dubbed IntrinsicNeRF, which introduce intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Weicai Ye , Shuo Chen , Chong Bao , Hujun Bao , Marc Pollefeys , Zhaopeng Cui , Guofeng Zhang

Photorealistic rendering and reposing of humans is important for enabling augmented reality experiences. We propose a novel framework to reconstruct the human and the scene that can be rendered with novel human poses and views from just a…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Wei Jiang , Kwang Moo Yi , Golnoosh Samei , Oncel Tuzel , Anurag Ranjan

While recent research in image understanding has often focused on recognizing more types of objects, understanding more about the objects is just as important. Recognizing object parts and attributes has been extensively studied before, yet…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 David Novotny , Diane Larlus , Andrea Vedaldi

We introduce a novel learning-based method to reconstruct the high-quality geometry and complex, spatially-varying BRDF of an arbitrary object from a sparse set of only six images captured by wide-baseline cameras under collocated point…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Sai Bi , Zexiang Xu , Kalyan Sunkavalli , David Kriegman , Ravi Ramamoorthi

We present an efficient method for joint optimization of topology, materials and lighting from multi-view image observations. Unlike recent multi-view reconstruction approaches, which typically produce entangled 3D representations encoded…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Jacob Munkberg , Jon Hasselgren , Tianchang Shen , Jun Gao , Wenzheng Chen , Alex Evans , Thomas Müller , Sanja Fidler

We present GeoNeRF, a generalizable photorealistic novel view synthesis method based on neural radiance fields. Our approach consists of two main stages: a geometry reasoner and a renderer. To render a novel view, the geometry reasoner…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Mohammad Mahdi Johari , Yann Lepoittevin , François Fleuret

This paper proposes a novel approach for rendering a pre-trained Neural Radiance Field (NeRF) in real-time on resource-constrained devices. We introduce Re-ReND, a method enabling Real-time Rendering of NeRFs across Devices. Re-ReND is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Sara Rojas , Jesus Zarzar , Juan Camilo Perez , Artsiom Sanakoyeu , Ali Thabet , Albert Pumarola , Bernard Ghanem

In this paper, we present a novel and effective framework, named 4K-NeRF, to pursue high fidelity view synthesis on the challenging scenarios of ultra high resolutions, building on the methodology of neural radiance fields (NeRF). The…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Zhongshu Wang , Lingzhi Li , Zhen Shen , Li Shen , Liefeng Bo

Virtual reality and augmented reality (XR) bring increasing demand for 3D content. However, creating high-quality 3D content requires tedious work that a human expert must do. In this work, we study the challenging task of lifting a single…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Dejia Xu , Yifan Jiang , Peihao Wang , Zhiwen Fan , Yi Wang , Zhangyang Wang

We present a novel neural surface reconstruction method called NeuralRoom for reconstructing room-sized indoor scenes directly from a set of 2D images. Recently, implicit neural representations have become a promising way to reconstruct…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Yusen Wang , Zongcheng Li , Yu Jiang , Kaixuan Zhou , Tuo Cao , Yanping Fu , Chunxia Xiao

Implicit representations of 3D objects have recently achieved impressive results on learning-based 3D reconstruction tasks. While existing works use simple texture models to represent object appearance, photo-realistic image synthesis…

Computer Vision and Pattern Recognition · Computer Science 2020-03-30 Michael Oechsle , Michael Niemeyer , Lars Mescheder , Thilo Strauss , Andreas Geiger

We present High Dynamic Range Neural Radiance Fields (HDR-NeRF) to recover an HDR radiance field from a set of low dynamic range (LDR) views with different exposures. Using the HDR-NeRF, we are able to generate both novel HDR views and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Xin Huang , Qi Zhang , Ying Feng , Hongdong Li , Xuan Wang , Qing Wang

Neural Radiance Fields (NeRF) have demonstrated remarkable performance in novel view synthesis. However, there is much improvement room on restoring 3D scenes based on NeRF from corrupted images, which are common in natural scene captures…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Xianliang Huang , Zhizhou Zhong , Shuhang Chen , Yi Xu , Juhong Guan , Shuigeng Zhou

Recovering 3D geometry and textures of individual objects is crucial for many robotics applications, such as manipulation, pose estimation, and autonomous driving. However, decomposing a target object from a complex background is…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Jun Wu , Sicheng Li , Sihui Ji , Yifei Yang , Yue Wang , Rong Xiong , Yiyi Liao

Surveillance and surveying are two important applications of empirical research. A major part of terrain modelling is supported by photographic surveys which are used for capturing expansive natural surfaces using a wide range of sensors --…

Image and Video Processing · Electrical Eng. & Systems 2023-05-16 Maniratnam Mandal , Venkatesh K. Subramanian

Neural Radiance Fields (NeRFs) have recently emerged as a popular option for photo-realistic object capture due to their ability to faithfully capture high-fidelity volumetric content even from handheld video input. Although much research…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Binglun Wang , Niladri Shekhar Dutt , Niloy J. Mitra

Estimating neural radiance fields (NeRFs) from "ideal" images has been extensively studied in the computer vision community. Most approaches assume optimal illumination and slow camera motion. These assumptions are often violated in robotic…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Simon Klenk , Lukas Koestler , Davide Scaramuzza , Daniel Cremers

Panoramic imaging research on geometry recovery and High Dynamic Range (HDR) reconstruction becomes a trend with the development of Extended Reality (XR). Neural Radiance Fields (NeRF) provide a promising scene representation for both tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Zhan Lu , Qian Zheng , Boxin Shi , Xudong Jiang

Neural radiance fields (NeRF) show great success in novel view synthesis. However, in real-world scenes, recovering high-quality details from the source images is still challenging for the existing NeRF-based approaches, due to the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Kun Zhou , Wenbo Li , Yi Wang , Tao Hu , Nianjuan Jiang , Xiaoguang Han , Jiangbo Lu

The reconstruction of indoor scenes from multi-view RGB images is challenging due to the coexistence of flat and texture-less regions alongside delicate and fine-grained regions. Recent methods leverage neural radiance fields aided by…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Sheng Ye , Yubin Hu , Matthieu Lin , Yu-Hui Wen , Wang Zhao , Yong-Jin Liu , Wenping Wang