English
Related papers

Related papers: Structural Causal 3D Reconstruction

200 papers

Implicit representations are widely used for object reconstruction due to their efficiency and flexibility. In 2021, a novel structure named neural implicit map has been invented for incremental reconstruction. A neural implicit map…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Yijun Yuan , Andreas Nuechter

We present an approach for the planar surface reconstruction of a scene from images with limited overlap. This reconstruction task is challenging since it requires jointly reasoning about single image 3D reconstruction, correspondence…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Samir Agarwala , Linyi Jin , Chris Rockwell , David F. Fouhey

We are witnessing an explosion of neural implicit representations in computer vision and graphics. Their applicability has recently expanded beyond tasks such as shape generation and image-based rendering to the fundamental problem of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Jiaming Sun , Xi Chen , Qianqian Wang , Zhengqi Li , Hadar Averbuch-Elor , Xiaowei Zhou , Noah Snavely

Capturing contextual dependencies has proven useful to improve the representational power of deep neural networks. Recent approaches that focus on modeling global context, such as self-attention and non-local operation, achieve this goal by…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Shenao Zhang , Li Shen , Zhifeng Li , Wei Liu

We propose a fast and accurate surface reconstruction algorithm for unorganized point clouds using an implicit representation. Recent learning methods are either single-object representations with small neural models that allow for high…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Siddhant Ranade , Gonçalo Dias Pais , Ross Tyler Whitaker , Jacinto C. Nascimento , Pedro Miraldo , Srikumar Ramalingam

Recovering the 3D shape of transparent objects using a small number of unconstrained natural images is an ill-posed problem. Complex light paths induced by refraction and reflection have prevented both traditional and deep multiview stereo…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Zhengqin Li , Yu-Ying Yeh , Manmohan Chandraker

We learn a self-supervised, single-view 3D reconstruction model that predicts the 3D mesh shape, texture and camera pose of a target object with a collection of 2D images and silhouettes. The proposed method does not necessitate 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Xueting Li , Sifei Liu , Kihwan Kim , Shalini De Mello , Varun Jampani , Ming-Hsuan Yang , Jan Kautz

From a single image, humans are able to perceive the full 3D shape of an object by exploiting learned shape priors from everyday life. Contemporary single-image 3D reconstruction algorithms aim to solve this task in a similar fashion, but…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Xiuming Zhang , Zhoutong Zhang , Chengkai Zhang , Joshua B. Tenenbaum , William T. Freeman , Jiajun Wu

An emerging problem in computer vision is the reconstruction of 3D shape and pose of an object from a single image. Hitherto, the problem has been addressed through the application of canonical deep learning methods to regress from the…

Computer Vision and Pattern Recognition · Computer Science 2017-07-27 Rui Zhu , Hamed Kiani Galoogahi , Chaoyang Wang , Simon Lucey

Generic 3D reconstruction from a single image is a difficult problem. A lot of data loss occurs in the projection. A domain based approach to reconstruction where we solve a smaller set of problems for a particular use case lead to greater…

Computer Vision and Pattern Recognition · Computer Science 2016-06-21 Atishay Jain

We propose an approach for dense semantic 3D reconstruction which uses a data term that is defined as potentials over viewing rays, combined with continuous surface area penalization. Our formulation is a convex relaxation which we augment…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Nikolay Savinov , Christian Haene , Lubor Ladicky , Marc Pollefeys

Causal representation learning aims to recover the latent causal variables and their causal relations, typically represented by directed acyclic graphs (DAGs), from low-level observations such as image pixels. A prevailing line of research…

Machine Learning · Computer Science 2026-04-28 Ignavier Ng , Shaoan Xie , Xinshuai Dong , Peter Spirtes , Kun Zhang

Reconstructing physically stable 3D scenes from a single RGB image enables casual images to be converted into simulation-ready digital assets for applications such as immersive interaction and content creation. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Xiaoxuan Ma , Jiashun Wang , Nicolas Ugrinovic , Yehonathan Litman , Kris Kitani

Causal learning has long concerned itself with the accurate recovery of underlying causal mechanisms. Such causal modelling enables better explanations of out-of-distribution data. Prior works on causal learning assume that the high-level…

Man-made 3D shapes are naturally organized in parts and hierarchies; such structures provide important constraints for shape reconstruction and generation. Modeling shape structures is difficult, because there can be multiple hierarchies…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Jiepeng Wang , Hao Pan , Yang Liu , Xin Tong , Taku Komura , Wenping Wang

Acquiring the virtual equivalent of exhibits, such as sculptures, in virtual reality (VR) museums, can be labour-intensive and sometimes infeasible. Deep learning based 3D reconstruction approaches allow us to recover 3D shapes from 2D…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Ziyi Chang , George Alex Koulieris , Hubert P. H. Shum

Humans perceive the 3D world as a set of distinct objects that are characterized by various low-level (geometry, reflectance) and high-level (connectivity, adjacency, symmetry) properties. Recent methods based on convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Despoina Paschalidou , Luc van Gool , Andreas Geiger

Learning sensorimotor control policies from high-dimensional images crucially relies on the quality of the underlying visual representations. Prior works show that structured latent space such as visual keypoints often outperforms…

Machine Learning · Computer Science 2021-06-15 Boyuan Chen , Pieter Abbeel , Deepak Pathak

We provide explicit, finite-sample guarantees for learning causal representations from data with a sublinear number of environments. Causal representation learning seeks to provide a rigourous foundation for the general representation…

Machine Learning · Statistics 2026-03-30 Inbeom Lee , Tongtong Jin , Bryon Aragam

Monocular 3D reconstruction of articulated object categories is challenging due to the lack of training data and the inherent ill-posedness of the problem. In this work we use video self-supervision, forcing the consistency of consecutive…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Filippos Kokkinos , Iasonas Kokkinos