English
Related papers

Related papers: Structure from Duplicates: Neural Inverse Graphics…

200 papers

Recovering the shape and appearance of real-world objects from natural 2D images is a long-standing and challenging inverse rendering problem. In this paper, we introduce a novel hybrid differentiable rendering method to efficiently…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Xiangyang Zhu , Yiling Pan , Bailin Deng , Bin Wang

While initial approaches to Structure-from-Motion (SfM) revolved around both global and incremental methods, most recent applications rely on incremental systems to estimate camera poses due to their superior robustness. Though there has…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Ayush Baid , John Lambert , Travis Driver , Akshay Krishnan , Hayk Stepanyan , Frank Dellaert

This paper presents a neural incremental Structure-from-Motion (SfM) approach, Level-S$^2$fM, which estimates the camera poses and scene geometry from a set of uncalibrated images by learning coordinate MLPs for the implicit surfaces and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yuxi Xiao , Nan Xue , Tianfu Wu , Gui-Song Xia

An emerging problem in computer vision is the reconstruction of 3D shape and pose of an object from a single image. Hitherto, the problem has been addressed through the application of canonical deep learning methods to regress from the…

Computer Vision and Pattern Recognition · Computer Science 2017-07-27 Rui Zhu , Hamed Kiani Galoogahi , Chaoyang Wang , Simon Lucey

We recover the underlying 3D structure from images of cartoons and anime depicting the same scene. This is an interesting problem domain because images in creative media are often depicted without explicit geometric consistency for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Ethan Weber , Riley Peterlinz , Rohan Mathur , Frederik Warburg , Alexei A. Efros , Angjoo Kanazawa

One practical approach to infer 3D scene structure from a single image is to retrieve a closely matching 3D model from a database and align it with the object in the image. Existing methods rely on supervised training with images and pose…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Pattaramanee Arsomngern , Sasikarn Khwanmuang , Matthias Nießner , Supasorn Suwajanakorn

We present a simple yet effective general-purpose framework for modeling 3D shapes by leveraging recent advances in 2D image generation using CNNs. Using just a single depth image of the object, we can output a dense multi-view depth map…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Kamal Gupta , Susmija Jabbireddy , Ketul Shah , Abhinav Shrivastava , Matthias Zwicker

Humans tend to build environments with structure, which consists of mainly planar surfaces. From the intersection of planar surfaces arise straight lines. Lines have more degrees-of-freedom than points. Thus, line-based…

Robotics · Computer Science 2021-06-01 André Mateus , Omar Tahri , A. Pedro Aguiar , Pedro U. Lima , Pedro Miraldo

Dense 3D object reconstruction from a single image has recently witnessed remarkable advances, but supervising neural networks with ground-truth 3D shapes is impractical due to the laborious process of creating paired image-shape datasets.…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Chen-Hsuan Lin , Chaoyang Wang , Simon Lucey

In this paper, we propose a framework to reconstruct 3D models from raw scanned points by learning the prior knowledge of a specific class of objects. Unlike previous work that heuristically specifies particular regularities and defines…

Computational Geometry · Computer Science 2017-01-13 Oussama Remil , Qian Xie , Xingyu Xie , Kai Xu , Jun Wang

View-graph is an essential input to large-scale structure from motion (SfM) pipelines. Accuracy and efficiency of large-scale SfM is crucially dependent on the input view-graph. Inconsistent or inaccurate edges can lead to inferior or wrong…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Rajvi Shah , Visesh Chari , P J Narayanan

Implicit Neural Representations have gained prominence as a powerful framework for capturing complex data modalities, encompassing a wide range from 3D shapes to images and audio. Within the realm of 3D shape representation, Neural Signed…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Amine Ouasfi , Adnane Boukhayma

We propose an end-to-end trainable, cross-category method for reconstructing multiple man-made articulated objects from a single RGBD image, focusing on part-level shape reconstruction and pose and kinematics estimation. We depart from…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Yuki Kawana , Tatsuya Harada

In recent years, neural implicit surface reconstruction has emerged as a popular paradigm for multi-view 3D reconstruction. Unlike traditional multi-view stereo approaches, the neural implicit surface-based methods leverage neural networks…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Qianyi Wu , Kaisiyuan Wang , Kejie Li , Jianmin Zheng , Jianfei Cai

This paper makes a first attempt to bring the Shape from Polarization (SfP) problem to the realm of deep learning. The previous state-of-the-art methods for SfP have been purely physics-based. We see value in these principled models, and…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Yunhao Ba , Alex Ross Gilbert , Franklin Wang , Jinfa Yang , Rui Chen , Yiqin Wang , Lei Yan , Boxin Shi , Achuta Kadambi

Today, most methods for image understanding tasks rely on feed-forward neural networks. While this approach has allowed for empirical accuracy, efficiency, and task adaptation via fine-tuning, it also comes with fundamental disadvantages.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Julian Ost , Tanushree Banerjee , Mario Bijelic , Felix Heide

In this work, we address the challenging task of 3D object recognition without the reliance on real-world 3D labeled data. Our goal is to predict the 3D shape, size, and 6D pose of objects within a single RGB-D image, operating at the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Mayank Lunayach , Sergey Zakharov , Dian Chen , Rares Ambrus , Zsolt Kira , Muhammad Zubair Irshad

In the last twenty years, Structure from Motion (SfM) has been a constant research hotspot in the fields of photogrammetry, computer vision, robotics etc., whereas real-time performance is just a recent topic of growing interest. This work…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Zongqian Zhan , Yifei Yu , Rui Xia , Wentian Gan , Hong Xie , Giulio Perda , Luca Morelli , Fabio Remondino , Xin Wang

We introduce Intrinsic Image Fusion, a method that reconstructs high-quality physically based materials from multi-view images. Material reconstruction is highly underconstrained and typically relies on analysis-by-synthesis, which requires…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Peter Kocsis , Lukas Höllein , Matthias Nießner

Intrinsic decomposition from a single image is a highly challenging task, due to its inherent ambiguity and the scarcity of training data. In contrast to traditional fully supervised learning approaches, in this paper we propose learning…

Computer Vision and Pattern Recognition · Computer Science 2018-02-07 Michael Janner , Jiajun Wu , Tejas D. Kulkarni , Ilker Yildirim , Joshua B. Tenenbaum