English
Related papers

Related papers: Pix2Vox: Context-aware 3D Reconstruction from Sing…

200 papers

While weakly supervised multi-view face reconstruction (MVR) is garnering increased attention, one critical issue still remains open: how to effectively interact and fuse multiple image information to reconstruct high-precision 3D models.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Weiguang Zhao , Chaolong Yang , Jianan Ye , Rui Zhang , Yuyao Yan , Xi Yang , Bin Dong , Amir Hussain , Kaizhu Huang

The fusion of visible light and infrared images has garnered significant attention in the field of imaging due to its pivotal role in various applications, including surveillance, remote sensing, and medical imaging. Therefore, this paper…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Xu Song , Yongbiao Xiao , Hui Li , Xiao-Jun Wu , Jun Sun , Vasile Palade

Single image 3D reconstruction is an important but challenging task that requires extensive knowledge of our natural world. Many existing methods solve this problem by optimizing a neural radiance field under the guidance of 2D diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Minghua Liu , Chao Xu , Haian Jin , Linghao Chen , Mukund Varma T , Zexiang Xu , Hao Su

We present an approach for the reconstruction of textured 3D meshes of human heads from one or few views. Since such few-shot reconstruction is underconstrained, it requires prior knowledge which is hard to impose on traditional 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Egor Burkov , Ruslan Rakhimov , Aleksandr Safin , Evgeny Burnaev , Victor Lempitsky

Convolutional Neural Networks (CNN) have been regarded as a powerful class of models for image recognition problems. Nevertheless, it is not trivial when utilizing a CNN for learning spatio-temporal video representation. A few studies have…

Computer Vision and Pattern Recognition · Computer Science 2017-11-29 Zhaofan Qiu , Ting Yao , Tao Mei

We tackle the problem of automatically reconstructing a complete 3D model of a scene from a single RGB image. This challenging task requires inferring the shape of both visible and occluded surfaces. Our approach utilizes viewer-centered,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Daeyun Shin , Zhile Ren , Erik B. Sudderth , Charless C. Fowlkes

Existing methods for single-view 3D object reconstruction directly learn to transform image features into 3D representations. However, these methods are vulnerable to images containing noisy backgrounds and heavy occlusions because the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Shuo Yang , Min Xu , Haozhe Xie , Stuart Perry , Jiahao Xia

The best way to combine the results of deep learning with standard 3D reconstruction pipelines remains an open problem. While systems that pass the output of traditional multi-view stereo approaches to a network for regularisation or…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Tristan Laidlow , Jan Czarnowski , Andrea Nicastro , Ronald Clark , Stefan Leutenegger

We investigate the problem of learning category-specific 3D shape reconstruction from a variable number of RGB views of previously unobserved object instances. Most approaches for multiview shape reconstruction operate on sparse shape…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Srinath Sridhar , Davis Rempe , Julien Valentin , Sofien Bouaziz , Leonidas J. Guibas

Single-view 3D object reconstruction is a fundamental and challenging computer vision task that aims at recovering 3D shapes from single-view RGB images. Most existing deep learning based reconstruction methods are trained and evaluated on…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Xianghui Yang , Guosheng Lin , Luping Zhou

Object recognition has seen significant progress in the image domain, with focus primarily on 2D perception. We propose to leverage existing large-scale datasets of 3D models to understand the underlying 3D structure of objects seen in an…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Weicheng Kuo , Anelia Angelova , Tsung-Yi Lin , Angela Dai

One challenge that remains open in 3D deep learning is how to efficiently represent 3D data to feed deep networks. Recent works have relied on volumetric or point cloud representations, but such approaches suffer from a number of issues…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Jhony K. Pontes , Chen Kong , Sridha Sridharan , Simon Lucey , Anders Eriksson , Clinton Fookes

Achieving high-fidelity 3D surface reconstruction while preserving fine details remains challenging, especially in the presence of materials with complex reflectance properties and without a dense-view setup. In this paper, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Robin Bruneau , Baptiste Brument , Yvain Quéau , Jean Mélou , François Bernard Lauze , Jean-Denis Durou , Lilian Calvet

Generating consistent multiple views for 3D reconstruction tasks is still a challenge to existing image-to-3D diffusion models. Generally, incorporating 3D representations into diffusion model decrease the model's speed as well as…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Emmanuelle Bourigault , Pauline Bourigault

With the goal of recovering high-quality image content from its degraded version, image restoration enjoys numerous applications, such as in surveillance, computational photography, medical imaging, and remote sensing. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-09 Syed Waqas Zamir , Aditya Arora , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Ming-Hsuan Yang , Ling Shao

This paper is about reducing the cost of building good large-scale 3D reconstructions post-hoc. We render 2D views of an existing reconstruction and train a convolutional neural network (CNN) that refines inverse-depth to match a…

Computer Vision and Pattern Recognition · Computer Science 2020-01-23 Ştefan Săftescu , Paul Newman

Pixel2Mesh (P2M) is a classical approach for reconstructing 3D shapes from a single color image through coarse-to-fine mesh deformation. Although P2M is capable of generating plausible global shapes, its Graph Convolution Network (GCN)…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Shijie Zhang , Boyan Jiang , Keke He , Junwei Zhu , Ying Tai , Chengjie Wang , Yinda Zhang , Yanwei Fu

Fast and robust three-dimensional reconstruction of facial geometric structure from a single image is a challenging task with numerous applications. Here, we introduce a learning-based approach for reconstructing a three-dimensional face…

Computer Vision and Pattern Recognition · Computer Science 2016-09-27 Elad Richardson , Matan Sela , Ron Kimmel

Recent open-vocabulary 3D scene understanding approaches mainly focus on training 3D networks through contrastive learning with point-text pairs or by distilling 2D features into 3D models via point-pixel alignment. While these methods show…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Xingyilang Yin , Jiale Wang , Xi Yang , Mutian Xu , Xu Gu , Nannan Wang

Inferring the 3D shape of an object from an RGB image has shown impressive results, however, existing methods rely primarily on recognizing the most similar 3D model from the training set to solve the problem. These methods suffer from poor…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Haozhe Xie , Hongxun Yao , Shangchen Zhou , Shengping Zhang , Xiaoshuai Sun , Wenxiu Sun