English
Related papers

Related papers: 3D-MOV: Audio-Visual LSTM Autoencoder for 3D Recon…

200 papers

3D reconstruction aims to recover the dense 3D structure of a scene. It plays an essential role in various applications such as Augmented/Virtual Reality (AR/VR), autonomous driving and robotics. Leveraging multiple views of a scene…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Fangjinhua Wang , Qingtian Zhu , Di Chang , Quankai Gao , Junlin Han , Tong Zhang , Richard Hartley , Marc Pollefeys

Large Reconstruction Models (LRMs) have recently become a popular method for creating 3D foundational models. Training 3D reconstruction models with 2D visual data traditionally requires prior knowledge of camera poses for the training…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Shiu-hong Kao , Xiao Li , Jinglu Wang , Yang Li , Chi-Keung Tang , Yu-Wing Tai , Yan Lu

We introduce a novel, data-driven approach for reconstructing temporally coherent 3D motion from unstructured and potentially partial observations of non-rigidly deforming shapes. Our goal is to achieve high-fidelity motion reconstructions…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Aymen Merrouche , Stefanie Wuhrer , Edmond Boyer

We propose a method to detect and reconstruct multiple 3D objects from a single RGB image. The key idea is to optimize for detection, alignment and shape jointly over all objects in the RGB image, while focusing on realistic and physically…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Francis Engelmann , Konstantinos Rematas , Bastian Leibe , Vittorio Ferrari

We propose a transformer-based neural network architecture for multi-object 3D reconstruction from RGB videos. It relies on two alternative ways to represent its knowledge: as a global 3D grid of features and an array of view-specific 2D…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Michał J. Tyszkiewicz , Kevis-Kokitsi Maninis , Stefan Popov , Vittorio Ferrari

We are working towards 3D reconstruction of indoor spaces using a pair of HDR cameras in a stereo vision configuration mounted on an indoor mobile floor robot that captures various textures and spatial features as 2D images and this data is…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Kshitij Karnawat , Hritvik Choudhari , Abhimanyu Saxena , Mudit Singal , Raajith Gadam

Intelligently reasoning about the world often requires integrating data from multiple modalities, as any individual modality may contain unreliable or incomplete information. Prior work in multimodal learning fuses input modalities only…

Machine Learning · Computer Science 2020-11-17 George Barnum , Sabera Talukder , Yisong Yue

Legged robots have the potential to expand the reach of autonomy beyond paved roads. In this work, we consider the difficult problem of locomotion on challenging terrains using a single forward-facing depth camera. Due to the partial…

Robotics · Computer Science 2023-04-04 Ruihan Yang , Ge Yang , Xiaolong Wang

Reconstructing a 3D object from a 2D image is a well-researched vision problem, with many kinds of deep learning techniques having been tried. Most commonly, 3D convolutional approaches are used, though previous work has shown…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Rohan Agarwal , Wei Zhou , Xiaofeng Wu , Yuhan Li

We investigate the problem of learning to generate 3D parametric surface representations for novel object instances, as seen from one or more views. Previous work on learning shape reconstruction from multiple views uses discrete…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Jiahui Lei , Srinath Sridhar , Paul Guerrero , Minhyuk Sung , Niloy Mitra , Leonidas J. Guibas

Computer graphics, 3D computer vision and robotics communities have produced multiple approaches to represent and generate 3D shapes, as well as a vast number of use cases. However, single-view reconstruction remains a challenging topic…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Alara Dirik , Pinar Yanardag

Reconstructing detailed 3D scenes from single-view images remains a challenging task due to limitations in existing approaches, which primarily focus on geometric shape recovery, overlooking object appearances and fine shape details. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Yixin Chen , Junfeng Ni , Nan Jiang , Yaowei Zhang , Yixin Zhu , Siyuan Huang

3D reconstruction from a single-RGB image in unconstrained real-world scenarios presents numerous challenges due to the inherent diversity and complexity of objects and environments. In this paper, we introduce Anything-3D, a methodical…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Qiuhong Shen , Xingyi Yang , Xinchao Wang

Monocular image-based 3D reconstruction of faces is a long-standing problem in computer vision. Since image data is a 2D projection of a 3D face, the resulting depth ambiguity makes the problem ill-posed. Most existing methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Ayush Tewari , Florian Bernard , Pablo Garrido , Gaurav Bharaj , Mohamed Elgharib , Hans-Peter Seidel , Patrick Pérez , Michael Zollhöfer , Christian Theobalt

A key question in the problem of 3D reconstruction is how to train a machine or a robot to model 3D objects. Many tasks like navigation in real-time systems such as autonomous vehicles directly depend on this problem. These systems usually…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 AmirHossein Zamani , Amir G. Aghdam , Kamran Ghaffari T

One challenge that remains open in 3D deep learning is how to efficiently represent 3D data to feed deep networks. Recent works have relied on volumetric or point cloud representations, but such approaches suffer from a number of issues…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Jhony K. Pontes , Chen Kong , Sridha Sridharan , Simon Lucey , Anders Eriksson , Clinton Fookes

Recently, the reconstruction of high-fidelity 3D head models from static portrait image has made great progress. However, most methods require multi-view or multi-illumination information, which therefore put forward high requirements for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Xueying Wang , Juyong Zhang

Underwater perception and 3D surface reconstruction are challenging problems with broad applications in construction, security, marine archaeology, and environmental monitoring. Treacherous operating conditions, fragile surroundings, and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Mohamad Qadri , Kevin Zhang , Akshay Hinduja , Michael Kaess , Adithya Pediredla , Christopher A. Metzler

Neural 3D reconstruction from multi-view images has recently attracted increasing attention from the community. Existing methods normally learn a neural field for the whole scene, while it is still under-explored how to reconstruct a target…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Xiaobao Wei , Renrui Zhang , Jiarui Wu , Jiaming Liu , Ming Lu , Yandong Guo , Shanghang Zhang

We propose an approach for 3D reconstruction and segmentation of a single object placed on a flat surface from an input video. Our approach is to perform dense depth map estimation for multiple views using a proposed objective function that…

Computer Vision and Pattern Recognition · Computer Science 2016-07-29 Tanmay Gupta , Daeyun Shin , Naren Sivagnanadasan , Derek Hoiem