English
Related papers

Related papers: POEM: Reconstructing Hand in a Point Embedded Mult…

200 papers

A great deal of research has demonstrated recently that multi-view stereo (MVS) matching can be solved with deep learning methods. However, these efforts were focused on close-range objects and only a very few of the deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Jin Liu , Shunping Ji

We present a learnt system for multi-view stereopsis. In contrast to recent learning based methods for 3D reconstruction, we leverage the underlying 3D geometry of the problem through feature projection and unprojection along viewing rays.…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Abhishek Kar , Christian Häne , Jitendra Malik

3D reconstruction from single view images is an ill-posed problem. Inferring the hidden regions from self-occluded images is both challenging and ambiguous. We propose a two-pronged approach to address these issues. To better incorporate…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Priyanka Mandikal , K L Navaneet , Mayank Agarwal , R. Venkatesh Babu

In this work, we address the lack of 3D understanding of generative neural networks by introducing a persistent 3D feature embedding for view synthesis. To this end, we propose DeepVoxels, a learned representation that encodes the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Vincent Sitzmann , Justus Thies , Felix Heide , Matthias Nießner , Gordon Wetzstein , Michael Zollhöfer

We present a method for 3D reconstruction only using calibrated multi-view surface azimuth maps. Our method, multi-view azimuth stereo, is effective for textureless or specular surfaces, which are difficult for conventional multi-view…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Xu Cao , Hiroaki Santo , Fumio Okura , Yasuyuki Matsushita

Today, Multi-View Stereo techniques are able to reconstruct robust and detailed 3D models, especially when starting from high-resolution images. However, there are cases in which the resolution of input images is relatively low, for…

Computer Vision and Pattern Recognition · Computer Science 2021-07-29 Eugenio Lomurno , Andrea Romanoni , Matteo Matteucci

Existing methods for capturing datasets of 3D heads in dense semantic correspondence are slow, and commonly address the problem in two separate steps; multi-view stereo (MVS) reconstruction followed by non-rigid registration. To simplify…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Timo Bolkart , Tianye Li , Michael J. Black

3D hand shape and pose estimation from a single depth map is a new and challenging computer vision problem with many applications. The state-of-the-art methods directly regress 3D hand meshes from 2D depth images via 2D convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Jameel Malik , Ibrahim Abdelaziz , Ahmed Elhayek , Soshi Shimada , Sk Aziz Ali , Vladislav Golyanik , Christian Theobalt , Didier Stricker

Multi-view hand mesh reconstruction is a critical task for applications in virtual reality and human-computer interaction, but it remains a formidable challenge. Although existing multi-view hand reconstruction methods achieve remarkable…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Jian Yang , Jiakun Li , Guoming Li , Zhen Shen , Huai-Yu Wu , Zhaoxin Fan , Heng Huang

Multi-view Stereo (MVS) aims to estimate depth and reconstruct 3D point clouds from a series of overlapping images. Recent learning-based MVS frameworks overlook the geometric information embedded in features and correlations, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Yuxi Hu , Jun Zhang , Zhe Zhang , Rafael Weilharter , Yuchen Rao , Kuangyi Chen , Runze Yuan , Friedrich Fraundorfer

The matching of 3D shapes has been extensively studied for shapes represented as surface meshes, as well as for shapes represented as point clouds. While point clouds are a common representation of raw real-world 3D data (e.g. from laser…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Dongliang Cao , Florian Bernard

In this paper, a complete pipeline for image-based 3D reconstruction of urban scenarios is proposed, based on PatchMatch Multi-View Stereo (MVS). Input images are firstly fed into an off-the-shelf visual SLAM system to extract camera poses…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Marco Orsingher , Paolo Zani , Paolo Medici , Massimo Bertozzi

3D reconstruction has lately attracted increasing attention due to its wide application in many areas, such as autonomous driving, robotics and virtual reality. As a dominant technique in artificial intelligence, deep learning has been…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Qingtian Zhu , Chen Min , Zizhuang Wei , Yisong Chen , Guoping Wang

Synthesizing novel views from a single view image is a highly ill-posed problem. We discover an effective solution to reduce the learning ambiguity by expanding the single-view view synthesis problem to a multi-view setting. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Yang Zhou , Hanjie Wu , Wenxi Liu , Zheng Xiong , Jing Qin , Shengfeng He

We present a deep reinforcement learning method of progressive view inpainting for 3D point scene completion under volume guidance, achieving high-quality scene reconstruction from only a single depth image with severe occlusion. Our…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Xiaoguang Han , Zhaoxuan Zhang , Dong Du , Mingdai Yang , Jingming Yu , Pan Pan , Xin Yang , Ligang Liu , Zixiang Xiong , Shuguang Cui

In computer vision domain, how to fast and accurately perform multiview stereo (MVS) is still a challenging problem. In this paper we present a fast yet accurate method for 3D dense reconstruction, called AMHMVS, built on the PatchMatch…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Qingshan Xu , Wenbing Tao

One challenge that remains open in 3D deep learning is how to efficiently represent 3D data to feed deep networks. Recent works have relied on volumetric or point cloud representations, but such approaches suffer from a number of issues…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Jhony K. Pontes , Chen Kong , Sridha Sridharan , Simon Lucey , Anders Eriksson , Clinton Fookes

Semantic segmentation of 3D meshes is an important problem for 3D scene understanding. In this paper we revisit the classic multiview representation of 3D meshes and study several techniques that make them effective for 3D semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Abhijit Kundu , Xiaoqi Yin , Alireza Fathi , David Ross , Brian Brewington , Thomas Funkhouser , Caroline Pantofaru

Embodied reasoning is inherently viewpoint-dependent: what is visible, occluded, or reachable depends critically on where the agent stands. However, existing spatial memory systems for embodied agents typically store either multi-view…

Artificial Intelligence · Computer Science 2026-03-17 JooHyun Park , HyeongYeop Kang

Multi-view depth estimation plays a critical role in reconstructing and understanding the 3D world. Recent learning-based methods have made significant progress in it. However, multi-view depth estimation is fundamentally a…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Kai Cheng , Hao Chen , Wei Yin , Guangkai Xu , Xuejin Chen