English
Related papers

Related papers: PlaneFormers: From Sparse View Planes to 3D Recons…

200 papers

Automatic reconstruction of 3D models from images using multi-view Structure-from-Motion methods has been one of the most fruitful outcomes of computer vision. These advances combined with the growing popularity of Micro Aerial Vehicles as…

Robotics · Computer Science 2016-11-15 Shreyansh Daftry , Christof Hoppe , Horst Bischof

Recent advancements in 3D robotic manipulation have improved grasping of everyday objects, but transparent and specular materials remain challenging due to depth sensing limitations. While several 3D reconstruction and depth completion…

Robotics · Computer Science 2025-06-23 Mingxu Zhang , Xiaoqi Li , Jiahui Xu , Kaichen Zhou , Hojin Bae , Yan Shen , Chuyan Xiong , Hao Dong

We study the inverse graphics problem of inferring a holistic representation for natural images. Given an input image, our goal is to induce a neuro-symbolic, program-like representation that jointly models camera poses, object locations,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-29 Yikai Li , Jiayuan Mao , Xiuming Zhang , William T. Freeman , Joshua B. Tenenbaum , Jiajun Wu

Humans can infer 3D structure from 2D images of an object based on past experience and improve their 3D understanding as they see more images. Inspired by this behavior, we introduce SAP3D, a system for 3D reconstruction and novel view…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Xinyang Han , Zelin Gao , Angjoo Kanazawa , Shubham Goel , Yossi Gandelsman

Deep learning applied to the reconstruction of 3D shapes has seen growing interest. A popular approach to 3D reconstruction and generation in recent years has been the CNN encoder-decoder model usually applied in voxel space. However, this…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Mateusz Michalkiewicz , Eugene Belilovsky , Mahsa Baktashmotlagh , Anders Eriksson

In recent years, many video tasks have achieved breakthroughs by utilizing the vision transformer and establishing spatial-temporal decoupling for feature extraction. Although multi-view 3D reconstruction also faces multiple images as…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Zhenwei Zhu , Liying Yang , Ning Li , Chaohao Jiang , Yanyan Liang

This paper presents a generalizable 3D plane detection and reconstruction framework named MonoPlane. Unlike previous robust estimator-based works (which require multiple images or RGB-D input) and learning-based works (which suffer from…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Wang Zhao , Jiachen Liu , Sheng Zhang , Yishu Li , Sili Chen , Sharon X Huang , Yong-Jin Liu , Hengkai Guo

Reconstructing the geometry and appearance of objects from photographs taken in different environments is difficult as the illumination and therefore the object appearance vary across captured images. This is particularly challenging for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Hadi Alzayer , Philipp Henzler , Jonathan T. Barron , Jia-Bin Huang , Pratul P. Srinivasan , Dor Verbin

Reconstructing 3D objects from a single image is an intriguing but challenging problem. One promising solution is to utilize multi-view (MV) 3D reconstruction to fuse generated MV images into consistent 3D objects. However, the generated…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Yizheng Chen , Rengan Xie , Qi Ye , Sen Yang , Zixuan Xie , Tianxiao Chen , Rong Li , Yuchi Huo

Event cameras are rapidly emerging as powerful vision sensors for 3D reconstruction, uniquely capable of asynchronously capturing per-pixel brightness changes. Compared to traditional frame-based cameras, event cameras produce sparse yet…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Chuanzhi Xu , Haoxian Zhou , Langyi Chen , Haodong Chen , Zeke Zexi Hu , Zhicheng Lu , Ying Zhou , Vera Chung , Qiang Qu , Weidong Cai

Light detection and ranging (Lidar) single-photon devices capture range and intensity information from a 3D scene. This modality enables long range 3D reconstruction with high range precision and low laser power. A multispectral…

Signal Processing · Electrical Eng. & Systems 2019-09-20 Julián Tachella , Yoann Altmann , Miguel Márquez , Henry Arguello-Fuentes , Jean-Yves Tourneret , Stephen McLaughlin

In architecture and computer-aided design, wireframes (i.e., line-based models) are widely used as basic 3D models for design evaluation and fast design iterations. However, unlike a full design file, a wireframe model lacks critical…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Yuan Xue , Zihan Zhou , Xiaolei Huang

Object reconstruction is relevant for many autonomous robotic tasks that require interaction with the environment. A key challenge in such scenarios is planning view configurations to collect informative measurements for reconstructing an…

Robotics · Computer Science 2024-09-17 Sicong Pan , Liren Jin , Xuying Huang , Cyrill Stachniss , Marija Popović , Maren Bennewitz

We propose an unsupervised method for parsing large 3D scans of real-world scenes with easily-interpretable shapes. This work aims to provide a practical tool for analyzing 3D scenes in the context of aerial surveying and mapping, without…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Romain Loiseau , Elliot Vincent , Mathieu Aubry , Loic Landrieu

Advancements in 3D scene reconstruction have transformed 2D images from the real world into 3D models, producing realistic 3D results from hundreds of input photos. Despite great success in dense-view reconstruction scenarios, rendering a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Fangfu Liu , Wenqiang Sun , Hanyang Wang , Yikai Wang , Haowen Sun , Junliang Ye , Jun Zhang , Yueqi Duan

Image matching is still challenging in such scenes with large viewpoints or illumination changes or with low textures. In this paper, we propose a Transformer-based pseudo 3D image matching method. It upgrades the 2D features extracted from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Liming Han , Zhaoxiang Liu , Shiguo Lian

We present a fast and simple technique to convert images into a radiance surface-based scene representation. Building on existing radiance volume reconstruction algorithms, we introduce a subtle yet impactful modification of the loss…

Recovering the shape and appearance of real-world objects from natural 2D images is a long-standing and challenging inverse rendering problem. In this paper, we introduce a novel hybrid differentiable rendering method to efficiently…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Xiangyang Zhu , Yiling Pan , Bailin Deng , Bin Wang

The accurate characterisation of the 3D deformations of slender fibres and thin sheets in flow, is a key experimental challenge in the study of particle-laden flows. We propose a high-resolution, single-camera method to visualise…

Fluid Dynamics · Physics 2026-03-18 Tymoteusz Miara , Draga Pihler-Puzović , Matthias Heil , Anne Juel

We address the problem of reconstructing 3D surfaces from depth and surface normal maps acquired by a sensor system based on a single perspective camera. Depth and normal maps can be obtained through techniques such as structured-light…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Ondrej Hlinka , Georg Kaniak , Christian Kapeller