English
Related papers

Related papers: 3D-R2N2: A Unified Approach for Single and Multi-v…

200 papers

We introduce a deep learning-based method to generate full 3D hair geometry from an unconstrained image. Our method can recover local strand details and has real-time performance. State-of-the-art hair modeling techniques rely on large…

Graphics · Computer Science 2018-07-12 Yi Zhou , Liwen Hu , Jun Xing , Weikai Chen , Han-Wei Kung , Xin Tong , Hao Li

Three-dimensional (3D) object reconstruction based on differentiable rendering (DR) is an active research topic in computer vision. DR-based methods minimize the difference between the rendered and target images by optimizing both the shape…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Chunyu Li , Taisuke Hashimoto , Eiichi Matsumoto , Hiroharu Kato

Grasp synthesis is one of the challenging tasks for any robot object manipulation task. In this paper, we present a new deep learning-based grasp synthesis approach for 3D objects. In particular, we propose an end-to-end 3D Convolutional…

Robotics · Computer Science 2020-09-15 Yikun Li , Lambert Schomaker , S. Hamidreza Kasaei

We propose an analysis-by-synthesis method for fast multi-view 3D reconstruction of opaque objects with arbitrary materials and illumination. State-of-the-art methods use both neural surface representations and neural rendering. While…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Markus Worchel , Rodrigo Diaz , Weiwen Hu , Oliver Schreer , Ingo Feldmann , Peter Eisert

In this paper, we introduce 3D-GMNet, a deep neural network for 3D object shape reconstruction from a single image. As the name suggests, 3D-GMNet recovers 3D shape as a Gaussian mixture. In contrast to voxels, point clouds, or meshes, a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Kohei Yamashita , Shohei Nobuhara , Ko Nishino

We propose a method for 3D object reconstruction and 6D-pose estimation from 2D images that uses knowledge about object shape as the primary key. In the proposed pipeline, recognition and labeling of objects in 2D images deliver 2D segment…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Marcell Wolnitza , Osman Kaya , Tomas Kulvicius , Florentin Wörgötter , Babette Dellen

Implicit neural representations have shown compelling results in offline 3D reconstruction and also recently demonstrated the potential for online SLAM systems. However, applying them to autonomous 3D reconstruction, where a robot is…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Yunlong Ran , Jing Zeng , Shibo He , Lincheng Li , Yingfeng Chen , Gimhee Lee , Jiming Chen , Qi Ye

Much of the recent research on solving iterative inference problems focuses on moving away from hand-chosen inference algorithms and towards learned inference. In the latter, the inference process is unrolled in time and interpreted as a…

Neural and Evolutionary Computing · Computer Science 2017-06-14 Patrick Putzky , Max Welling

Mesh reconstruction from Neural Radiance Fields (NeRF) is widely used in 3D reconstruction and has been applied across numerous domains. However, existing methods typically rely solely on the given training set images, which restricts…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Haoyang Wang , Liming Liu , Xinggong Zhang

We present a novel approach to robotic grasp planning using both a learned grasp proposal network and a learned 3D shape reconstruction network. Our system generates 6-DOF grasps from a single RGB-D image of the target object, which is…

Robotics · Computer Science 2020-11-09 Daniel Yang , Tarik Tosun , Ben Eisner , Volkan Isler , Daniel Lee

We present a learnt system for multi-view stereopsis. In contrast to recent learning based methods for 3D reconstruction, we leverage the underlying 3D geometry of the problem through feature projection and unprojection along viewing rays.…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Abhishek Kar , Christian Häne , Jitendra Malik

We propose a novel method for 3D object reconstruction from a sparse set of views captured from a 360-degree calibrated camera rig. We represent the object surface through a hybrid model that uses both an MLP-based neural representation and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Llukman Cerkezi , Paolo Favaro

Limited view tomographic reconstruction aims to reconstruct a tomographic image from a limited number of sinogram or projection views arising from sparse view or limited angle acquisitions that reduce radiation dose or shorten scanning…

Image and Video Processing · Electrical Eng. & Systems 2020-09-04 Bo Zhou , S. Kevin Zhou , James S. Duncan , Chi Liu

We present a novel face reconstruction method capable of reconstructing detailed face geometry, spatially varying face reflectance from a single monocular image. We build our work upon the recent advances of DNN-based auto-encoders with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Abdallah Dib , Junghyun Ahn , Cedric Thebault , Philippe-Henri Gosselin , Louis Chevallier

In this paper, we propose a novel approach, 3D-RecGAN++, which reconstructs the complete 3D structure of a given object from a single arbitrary depth view using generative adversarial networks. Unlike existing work which typically requires…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Bo Yang , Stefano Rosa , Andrew Markham , Niki Trigoni , Hongkai Wen

Learning to reconstruct 3D shapes using 2D images is an active research topic, with benefits of not requiring expensive 3D data. However, most work in this direction requires multi-view images for each object instance as training…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Bo Peng , Wei Wang , Jing Dong , Tieniu Tan

We study the problem of symmetry detection of 3D shapes from single-view RGB-D images, where severely missing data renders geometric detection approach infeasible. We propose an end-to-end deep neural network which is able to predict both…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Yifei Shi , Junwen Huang , Hongjia Zhang , Xin Xu , Szymon Rusinkiewicz , Kai Xu

We present a learning framework for recovering the 3D shape, camera, and texture of an object from a single image. The shape is represented as a deformable 3D mesh model of an object category where a shape is parameterized by a learned mean…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Angjoo Kanazawa , Shubham Tulsiani , Alexei A. Efros , Jitendra Malik

Recently, deep learning based 3D face reconstruction methods have shown promising results in both quality and efficiency.However, training deep neural networks typically requires a large volume of data, whereas face images with ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Yu Deng , Jiaolong Yang , Sicheng Xu , Dong Chen , Yunde Jia , Xin Tong

Learning non-rigid registration in an end-to-end manner is challenging due to the inherent high degrees of freedom and the lack of labeled training data. In this paper, we resolve these two challenges simultaneously. First, we propose to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Wanquan Feng , Juyong Zhang , Hongrui Cai , Haofei Xu , Junhui Hou , Hujun Bao