English
Related papers

Related papers: Single Image 3D Hand Reconstruction with Mesh Conv…

200 papers

We present a new approach to 3D object representation where a neural network encodes the geometry of an object directly into the weights and biases of a second 'mapping' network. This mapping network can be used to reconstruct an object by…

Machine Learning · Computer Science 2020-04-07 Eric Mitchell , Selim Engin , Volkan Isler , Daniel D Lee

Nonparametric approaches have shown promising results on reconstructing 3D human mesh from a single monocular image. Unlike previous approaches that use a parametric human model like skinned multi-person linear model (SMPL), and attempt to…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Kevin Lin , Lijuan Wang , Ying Jin , Zicheng Liu , Ming-Ting Sun

Estimating 3D mesh of the human body from a single 2D image is an important task with many applications such as augmented reality and Human-Robot interaction. However, prior works reconstructed 3D mesh from global image feature extracted by…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Wang Zeng , Wanli Ouyang , Ping Luo , Wentao Liu , Xiaogang Wang

Mask-based lensless imagers are smaller and lighter than traditional lensed cameras. In these imagers, the sensor does not directly record an image of the scene; rather, a computational algorithm reconstructs it. Typically, mask-based…

Image and Video Processing · Electrical Eng. & Systems 2019-09-27 Kristina Monakhova , Joshua Yurtsever , Grace Kuo , Nick Antipa , Kyrollos Yanny , Laura Waller

Recent generative models can create visually plausible 3D representations of objects. However, the generation process often allows for implicit control signals, such as contextual descriptions, and rarely supports bold geometric distortions…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Changwoon Choi , Hyunsoo Lee , Clément Jambon , Yael Vinker , Young Min Kim

Learned progressive image compression is gaining momentum as it allows improved image reconstruction as more bits are decoded at the receiver. We propose a progressive image compression method in which an image is first represented as a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Alberto Presta , Enzo Tartaglione , Attilio Fiandrotti , Marco Grangetto , Pamela Cosman

Shape priors learned from data are commonly used to reconstruct 3D objects from partial or noisy data. Yet no such shape priors are available for indoor scenes, since typical 3D autoencoders cannot handle their scale, complexity, or…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Chiyu Max Jiang , Avneesh Sud , Ameesh Makadia , Jingwei Huang , Matthias Nießner , Thomas Funkhouser

Prior works for reconstructing hand-held objects from a single image train models on images paired with 3D shapes. Such data is challenging to gather in the real world at scale. Consequently, these approaches do not generalize well when…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Aditya Prakash , Matthew Chang , Matthew Jin , Ruisen Tu , Saurabh Gupta

With the recent advances in hardware and rendering techniques, 3D models have emerged everywhere in our life. Yet creating 3D shapes is arduous and requires significant professional knowledge. Meanwhile, Deep learning has enabled…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Zhiqin Chen

Polygon meshes are an efficient representation of 3D geometry, and are of central importance in computer graphics, robotics and games development. Existing learning-based approaches have avoided the challenges of working with 3D meshes,…

Graphics · Computer Science 2020-02-26 Charlie Nash , Yaroslav Ganin , S. M. Ali Eslami , Peter W. Battaglia

We study the problem of shape generation in 3D mesh representation from a few color images with known camera poses. While many previous works learn to hallucinate the shape directly from priors, we resort to further improving the shape…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Chao Wen , Yinda Zhang , Zhuwen Li , Yanwei Fu

With the rapid advancement of technologies such as virtual reality, augmented reality, and gesture control, users expect interactions with computer interfaces to be more natural and intuitive. Existing visual algorithms often struggle to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Haonan Li , Patrick P. K. Chen , Yitong Zhou

Face reenactment aims to animate a source face image to a different pose and expression provided by a driving image. Existing approaches are either designed for a specific identity, or suffer from the identity preservation problem in the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Guangming Yao , Yi Yuan , Tianjia Shao , Kun Zhou

The question of representation of 3D geometry is of vital importance when it comes to leveraging the recent advances in the field of machine learning for geometry processing tasks. For common unstructured surface meshes state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2018-09-28 Isaak Lim , Alexander Dielen , Marcel Campen , Leif Kobbelt

This paper proposes the use of an end-to-end Convolutional Neural Network for direct reconstruction of the 3D geometry of humans via volumetric regression. The proposed method does not require the fitting of a shape model and can be trained…

Computer Vision and Pattern Recognition · Computer Science 2018-09-12 Aaron S. Jackson , Chris Manafas , Georgios Tzimiropoulos

3D reconstruction of hand-object manipulations is important for emulating human actions. Most methods dealing with challenging object manipulation scenarios, focus on hands reconstruction in isolation, ignoring physical and kinematic…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Ahmed Tawfik Aboukhadra , Jameel Malik , Nadia Robertini , Ahmed Elhayek , Didier Stricker

Reconstructing high-fidelity 3D hands from egocentric monocular videos remains a challenge due to the limitations in capturing high-resolution geometry, hand-object interactions, and complex objects on hands. Additionally, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Haoyu Zhu , Yi Zhang , Lei Yao , Lap-pui Chau , Yi Wang

We describe an end-to-end method for recovering 3D human body mesh from single images and monocular videos. Different from the existing methods try to obtain all the complex 3D pose, shape, and camera parameters from one coupling feature,…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Sun Yu , Ye Yun , Liu Wu , Gao Wenpeng , Fu YiLi , Mei Tao

3D shape reconstruction from a single image is a highly ill-posed problem. Modern deep learning based systems try to solve this problem by learning an end-to-end mapping from image to shape via a deep network. In this paper, we aim to solve…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Kejie Li , Ravi Garg , Ming Cai , Ian Reid

Much progress has been made in the supervised learning of 3D reconstruction of rigid objects from multi-view images or a video. However, it is more challenging to reconstruct severely deformed objects from a single-view RGB image in an…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Jie Mei , Jingxi Yu , Suzanne Romain , Craig Rose , Kelsey Magrane , Graeme LeeSon , Jenq-Neng Hwang