English
Related papers

Related papers: Structure from Duplicates: Neural Inverse Graphics…

200 papers

In this work, we use multi-view aerial images to reconstruct the geometry, lighting, and material of facades using neural signed distance fields (SDFs). Without the requirement of complex equipment, our method only takes simple RGB images…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Zixuan Xie , Rengan Xie , Rong Li , Kai Huang , Pengju Qiao , Jingsen Zhu , Xu Yin , Qi Ye , Wei Hua , Yuchi Huo , Hujun Bao

We introduce a novel method to obtain high-quality 3D reconstructions from consumer RGB-D sensors. Our core idea is to simultaneously optimize for geometry encoded in a signed distance field (SDF), textures from automatically-selected…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Robert Maier , Kihwan Kim , Daniel Cremers , Jan Kautz , Matthias Nießner

The neural implicit representation has shown its effectiveness in novel view synthesis and high-quality 3D reconstruction from multi-view images. However, most approaches focus on holistic scene representation yet ignore individual objects…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Qianyi Wu , Xian Liu , Yuedong Chen , Kejie Li , Chuanxia Zheng , Jianfei Cai , Jianmin Zheng

This paper addresses the problem of Structure from Motion (SfM) for indoor panoramic image streams, extremely challenging even for the state-of-the-art due to the lack of textures and minimal parallax. The key idea is the fusion of…

Computer Vision and Pattern Recognition · Computer Science 2016-12-06 Satoshi Ikehata , Ivaylo Boyadzhiev , Qi Shan , Yasutaka Furukawa

3D reconstruction of dynamic scenes is a long-standing problem in computer graphics and increasingly difficult the less information is available. Shape-from-Template (SfT) methods aim to reconstruct a template-based geometry from RGB images…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 David Stotko , Nils Wandel , Reinhard Klein

Shape from Polarization (SfP) estimates surface normals using photos captured at different polarizer rotations. Fundamentally, the SfP model assumes that light is reflected either diffusely or specularly. However, this model is not valid…

Computer Vision and Pattern Recognition · Computer Science 2016-06-14 Vage Taamazyan , Achuta Kadambi , Ramesh Raskar

Structure from Motion (SfM) refers to the problem of recovering both structure (i.e., 3D coordinates of points in the scene) and motion (i.e., camera matrices) starting from point correspondences in multiple images. It has attracted…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Federica Arrigoni

In this paper, we address the "dual problem" of multi-view scene reconstruction in which we utilize single-view images captured under different point lights to learn a neural scene representation. Different from existing single-view methods…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Wenqi Yang , Guanying Chen , Chaofeng Chen , Zhenfang Chen , Kwan-Yee K. Wong

Reconstructing the surfaces of deformable objects from correspondences between a 3D template and a 2D image is well studied under Shape-from-Template (SfT) methods; however, existing approaches break down when topological changes accompany…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Kevin Manogue , Tomasz M Schang , Dilara Kuş , Jonas Müller , Stefan Zachow , Agniva Sengupta

Structure-from-Motion (SfM), a task aiming at jointly recovering camera poses and 3D geometry of a scene given a set of images, remains a hard problem with still many open challenges despite decades of significant progress. The traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Bardienus Duisterhof , Lojze Zust , Philippe Weinzaepfel , Vincent Leroy , Yohann Cabon , Jerome Revaud

Reconstructing the shape and spatially varying surface appearances of a physical-world object as well as its surrounding illumination based on 2D images (e.g., photographs) of the object has been a long-standing problem in computer vision…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Cheng Sun , Guangyan Cai , Zhengqin Li , Kai Yan , Cheng Zhang , Carl Marshall , Jia-Bin Huang , Shuang Zhao , Zhao Dong

We propose a method to detect and reconstruct multiple 3D objects from a single RGB image. The key idea is to optimize for detection, alignment and shape jointly over all objects in the RGB image, while focusing on realistic and physically…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Francis Engelmann , Konstantinos Rematas , Bastian Leibe , Vittorio Ferrari

Multi-view 3D reconstruction, namely, structure-from-motion followed by multi-view stereo, is a fundamental component of 3D computer vision. In general, multi-view 3D reconstruction suffers from an unknown scale ambiguity unless a reference…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Lilika Makabe , Kohei Ashida , Hiroaki Santo , Fumio Okura , Yasuyuki Matsushita

Existing methods for reconstructing objects and humans from a monocular image suffer from severe mesh collisions and performance limitations for interacting occluding objects. This paper introduces a method to obtain a globally consistent…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Sarthak Batra , Partha P. Chakrabarti , Simon Hadfield , Armin Mustafa

We present an approach for reconstructing vehicles from a single (RGB) image, in the context of autonomous driving. Though the problem appears to be ill-posed, we demonstrate that prior knowledge about how 3D shapes of vehicles project to…

Computer Vision and Pattern Recognition · Computer Science 2016-09-30 J. Krishna Murthy , G. V. Sai Krishna , Falak Chhaya , K. Madhava Krishna

Accurate reconstruction of both the geometric and topological details of a 3D object from a single 2D image embodies a fundamental challenge in computer vision. Existing explicit/implicit solutions to this problem struggle to recover…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Mohammad Samiul Arshad , William J. Beksi

Humans can infer 3D structure from 2D images of an object based on past experience and improve their 3D understanding as they see more images. Inspired by this behavior, we introduce SAP3D, a system for 3D reconstruction and novel view…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Xinyang Han , Zelin Gao , Angjoo Kanazawa , Shubham Goel , Yossi Gandelsman

Scene and object reconstruction is an important problem in robotics, in particular in planning collision-free trajectories or in object manipulation. This paper compares two strategies for the reconstruction of nonvisible parts of the…

Robotics · Computer Science 2025-01-28 Rafał Staszak , Piotr Michałek , Jakub Chudziński , Marek Kopicki , Dominik Belter

Inverse rendering aims to estimate physical attributes of a scene, e.g., reflectance, geometry, and lighting, from image(s). Inverse rendering has been studied primarily for single objects or with methods that solve for only one of the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Soumyadip Sengupta , Jinwei Gu , Kihwan Kim , Guilin Liu , David W. Jacobs , Jan Kautz

Accurately predicting the 3D shape of any arbitrary object in any pose from a single image is a key goal of computer vision research. This is challenging as it requires a model to learn a representation that can infer both the visible and…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Anh Thai , Stefan Stojanov , Vijay Upadhya , James M. Rehg