English
Related papers

Related papers: Neural Reflectance Fields for Appearance Acquisiti…

200 papers

Neural Radiance Fields (NeRF) achieve photo-realistic view synthesis with densely captured input images. However, the geometry of NeRF is extremely under-constrained given sparse views, resulting in significant degradation of novel view…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Zheng Chen , Chen Wang , Yuan-Chen Guo , Song-Hai Zhang

Emerging neural radiance fields (NeRF) are a promising scene representation for computer graphics, enabling high-quality 3D reconstruction and novel view synthesis from image observations. However, editing a scene represented by a NeRF is…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Sosuke Kobayashi , Eiichi Matsumoto , Vincent Sitzmann

We address the challenge of constructing a consistent and photorealistic Neural Radiance Field in inhomogeneously illuminated, scattering environments with unknown, co-moving light sources. While most existing works on underwater scene…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Mengkun She , Felix Seegräber , David Nakath , Patricia Schöntag , Kevin Köser

Given a set of images of a scene, the re-rendering of this scene from novel views and lighting conditions is an important and challenging problem in Computer Vision and Graphics. On the one hand, most existing works in Computer Vision…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Linjie Lyu , Ayush Tewari , Thomas Leimkuehler , Marc Habermann , Christian Theobalt

The remarkable progress in neural-network-driven visual data generation, especially with neural rendering techniques like Neural Radiance Fields and 3D Gaussian splatting, offers a powerful alternative to GANs and diffusion models. These…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Chengdong Dong , Vijayakumar Bhagavatula , Zhenyu Zhou , Ajay Kumar

Accurately measuring the geometry and spatially-varying reflectance of real-world objects is a complex task due to their intricate shapes formed by concave features, hollow engravings and diverse surfaces, resulting in inter-reflection and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Jing Yang , Pratusha Bhuvana Prasad , Qing Zhang , Yajie Zhao

Dynamic scene representation and reconstruction have undergone transformative advances in recent years, catalyzed by breakthroughs in neural radiance fields and 3D Gaussian splatting techniques. While initially developed for static…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Jinlong Fan , Xuepu Zeng , Jing Zhang , Mingming Gong , Yuxiang Yang , Dacheng Tao

Photorealistic rendering of dynamic humans is an important ability for telepresence systems, virtual shopping, synthetic data generation, and more. Recently, neural rendering methods, which combine techniques from computer graphics and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-21 Ziyan Wang , Timur Bagautdinov , Stephen Lombardi , Tomas Simon , Jason Saragih , Jessica Hodgins , Michael Zollhöfer

Recent research explosion on Neural Radiance Field (NeRF) shows the encouraging potential to represent complex scenes with neural networks. One major drawback of NeRF is its prohibitive inference time: Rendering a single pixel requires…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Huan Wang , Jian Ren , Zeng Huang , Kyle Olszewski , Menglei Chai , Yun Fu , Sergey Tulyakov

Neural radiance fields (NeRF) has gained significant attention for its exceptional visual effects. However, most existing NeRF methods reconstruct 3D scenes from RGB images captured by visible light cameras. In practical scenarios like…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Chonghao Zhong , Chao Xu

We present Panoptic Neural Fields (PNF), an object-aware neural scene representation that decomposes a scene into a set of objects (things) and background (stuff). Each object is represented by an oriented 3D bounding box and a multi-layer…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Abhijit Kundu , Kyle Genova , Xiaoqi Yin , Alireza Fathi , Caroline Pantofaru , Leonidas Guibas , Andrea Tagliasacchi , Frank Dellaert , Thomas Funkhouser

We present a novel technique for implicit neural representation of light fields at continuously defined viewpoints with high quality and fidelity. Our implicit neural representation maps 4D coordinates defining two-plane parameterization of…

Graphics · Computer Science 2023-05-11 Süleyman Aslan , Brandon Yushan Feng , Amitabh Varshney

Neural Radiance Fields employ simple volume rendering as a way to overcome the challenges of differentiating through ray-triangle intersections by leveraging a probabilistic notion of visibility. This is achieved by assuming the scene is…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Andrea Tagliasacchi , Ben Mildenhall

Dense 3D reconstruction has many applications in automated driving including automated annotation validation, multimodal data augmentation, providing ground truth annotations for systems lacking LiDAR, as well as enhancing auto-labeling…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Shihao Shen , Louis Kerofsky , Varun Ravi Kumar , Senthil Yogamani

Neural implicit representation has attracted attention in 3D reconstruction through various success cases. For further applications such as scene understanding or editing, several works have shown progress towards object compositional…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Taekbeom Lee , Youngseok Jang , H. Jin Kim

A Neural Radiance Field (NeRF) encodes the specific relation of 3D geometry and appearance of a scene. We here ask the question whether we can transfer the appearance from a source NeRF onto a target 3D geometry in a semantically meaningful…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Michael Fischer , Zhengqin Li , Thu Nguyen-Phuoc , Aljaz Bozic , Zhao Dong , Carl Marshall , Tobias Ritschel

We consider the challenging problem of outdoor lighting estimation for the goal of photorealistic virtual object insertion into photographs. Existing works on outdoor lighting estimation typically simplify the scene lighting into an…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Zian Wang , Wenzheng Chen , David Acuna , Jan Kautz , Sanja Fidler

We propose a novel approach that jointly removes reflection or translucent layer from a scene and estimates scene depth. The input data are captured via light field imaging. The problem is couched as minimizing the rank of the transmitted…

Computer Vision and Pattern Recognition · Computer Science 2015-06-16 Qiaosong Wang , Haiting Lin , Yi Ma , Sing Bing Kang , Jingyi Yu

We explore total scene capture -- recording, modeling, and rerendering a scene under varying appearance such as season and time of day. Starting from internet photos of a tourist landmark, we apply traditional 3D reconstruction to register…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Moustafa Meshry , Dan B Goldman , Sameh Khamis , Hugues Hoppe , Rohit Pandey , Noah Snavely , Ricardo Martin-Brualla

In this paper, we present a framework to represent mock 3D objects and scenes, which are not 3D but appear 3D. In our framework, each mock-3D object is represented using 2D non-conservative vector fields and thickness information that are…

Graphics · Computer Science 2024-01-02 Ergun Akleman , Youyou Wang , Ozgur Gonen