English
Related papers

Related papers: Learning Implicit Surface Light Fields

200 papers

Deep implicit surfaces excel at modeling generic shapes but do not always capture the regularities present in manufactured objects, which is something simple geometric primitives are particularly good at. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-09-09 Subeesh Vasu , Nicolas Talabot , Artem Lukoianov , Pierre Baqué , Jonathan Donier , Pascal Fua

In this paper, we tackle the challenging problem of 3D keypoint estimation of general objects using a novel implicit representation. Previous works have demonstrated promising results for keypoint prediction through direct coordinate…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Xiangyu Zhu , Dong Du , Haibin Huang , Chongyang Ma , Xiaoguang Han

Conventional 3D object detection approaches concentrate on bounding boxes representation learning with several parameters, i.e., localization, dimension, and orientation. Despite its popularity and universality, such a straightforward…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Xuelin Qian , Li Wang , Yi Zhu , Li Zhang , Yanwei Fu , Xiangyang Xue

We present a novel technique for implicit neural representation of light fields at continuously defined viewpoints with high quality and fidelity. Our implicit neural representation maps 4D coordinates defining two-plane parameterization of…

Graphics · Computer Science 2023-05-11 Süleyman Aslan , Brandon Yushan Feng , Amitabh Varshney

We present an approach for interactively scanning highly reflective objects with a commodity RGBD sensor. In addition to shape, our approach models the surface light field, encoding scene appearance from all directions. By factoring the…

Computer Vision and Pattern Recognition · Computer Science 2018-09-07 Jeong Joon Park , Richard Newcombe , Steve Seitz

Template 3D shapes are useful for many tasks in graphics and vision, including fitting observation data, analyzing shape collections, and transferring shape attributes. Because of the variety of geometry and topology of real-world shapes,…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Kyle Genova , Forrester Cole , Daniel Vlasic , Aaron Sarna , William T. Freeman , Thomas Funkhouser

We present a new learning-based framework S-3D-RCNN that can recover accurate object orientation in SO(3) and simultaneously predict implicit rigid shapes from stereo RGB images. For orientation estimation, in contrast to previous studies…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Shichao Li , Xijie Huang , Zechun Liu , Kwang-Ting Cheng

Neural implicit representations have emerged as a powerful paradigm for 3D reconstruction. However, despite their success, existing methods fail to capture fine geometric details and thin structures, especially in scenarios where only…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Aarya Patel , Hamid Laga , Ojaswa Sharma

Photorealistic object appearance modeling from 2D images is a constant topic in vision and graphics. While neural implicit methods (such as Neural Radiance Fields) have shown high-fidelity view synthesis results, they cannot relight the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Hong-Xing Yu , Michelle Guo , Alireza Fathi , Yen-Yu Chang , Eric Ryan Chan , Ruohan Gao , Thomas Funkhouser , Jiajun Wu

Implicit surface representations, such as signed-distance functions, combined with deep learning have led to impressive models which can represent detailed shapes of objects with arbitrary topology. Since a continuous function is learned,…

Computer Vision and Pattern Recognition · Computer Science 2021-02-08 Edgar Tretschk , Ayush Tewari , Vladislav Golyanik , Michael Zollhöfer , Carsten Stoll , Christian Theobalt

Classical light field rendering for novel view synthesis can accurately reproduce view-dependent effects such as reflection, refraction, and translucency, but requires a dense view sampling of the scene. Methods based on geometric…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Mohammed Suhail , Carlos Esteves , Leonid Sigal , Ameesh Makadia

Physically-based rendering (PBR) is key for immersive rendering effects used widely in the industry to showcase detailed realistic scenes from computer graphics assets. A well-known caveat is that producing the same is computationally heavy…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Jing Yang , Hanyuan Xiao , Wenbin Teng , Yunxuan Cai , Yajie Zhao

3D reconstruction is a fundamental problem in computer vision, and the task is especially challenging when the object to reconstruct is partially or fully occluded. We introduce a method that uses the shadows cast by an unobserved object in…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Ruoshi Liu , Sachit Menon , Chengzhi Mao , Dennis Park , Simon Stent , Carl Vondrick

In recent years, substantial progress has been achieved in learning-based reconstruction of 3D objects. At the same time, generative models were proposed that can generate highly realistic images. However, despite this success in these…

Computer Vision and Pattern Recognition · Computer Science 2019-05-20 Michael Oechsle , Lars Mescheder , Michael Niemeyer , Thilo Strauss , Andreas Geiger

This paper presents a novel neural implicit radiance representation for free viewpoint relighting from a small set of unstructured photographs of an object lit by a moving point light source different from the view position. We express the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Chong Zeng , Guojun Chen , Yue Dong , Pieter Peers , Hongzhi Wu , Xin Tong

Estimating and modelling the appearance of an object under outdoor illumination conditions is a complex process. Although there have been several studies on illumination estimation and relighting, very few of them focus on estimating the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Farhan Rahman Wasee , Alen Joy , Charalambos Poullis

Reconstructing general dynamic scenes is important for many computer vision and graphics applications. Recent works represent the dynamic scene with neural radiance fields for photorealistic view synthesis, while their surface geometry is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Decai Chen , Haofei Lu , Ingo Feldmann , Oliver Schreer , Peter Eisert

We propose a novel method to reconstruct the 3D shapes of transparent objects using hand-held captured images under natural light conditions. It combines the advantage of explicit mesh and multi-layer perceptron (MLP) network, a hybrid…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Jiamin Xu , Zihan Zhu , Hujun Bao , Weiwei Xu

Light field, as a new data representation format in multimedia, has the ability to capture both intensity and direction of light rays. However, the additional angular information also brings a large volume of data. Classical coding methods…

Image and Video Processing · Electrical Eng. & Systems 2024-07-16 Henan Wang , Hanxin Zhu , Zhibo Chen

We propose a novel neural architecture for representing 3D surfaces, which harnesses two complementary shape representations: (i) an explicit representation via an atlas, i.e., embeddings of 2D domains into 3D; (ii) an implicit-function…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Omid Poursaeed , Matthew Fisher , Noam Aigerman , Vladimir G. Kim