English
Related papers

Related papers: Deep Meta Functionals for Shape Representation

200 papers

We present a simple yet effective general-purpose framework for modeling 3D shapes by leveraging recent advances in 2D image generation using CNNs. Using just a single depth image of the object, we can output a dense multi-view depth map…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Kamal Gupta , Susmija Jabbireddy , Ketul Shah , Abhinav Shrivastava , Matthias Zwicker

Reconstructing the 3D mesh of a general object from a single image is now possible thanks to the latest advances of deep learning technologies. However, due to the nontrivial difficulty of generating a feasible mesh structure, the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Junyi Pan , Xiaoguang Han , Weikai Chen , Jiapeng Tang , Kui Jia

Implicit surface representations, such as signed-distance functions, combined with deep learning have led to impressive models which can represent detailed shapes of objects with arbitrary topology. Since a continuous function is learned,…

Computer Vision and Pattern Recognition · Computer Science 2021-02-08 Edgar Tretschk , Ayush Tewari , Vladislav Golyanik , Michael Zollhöfer , Carsten Stoll , Christian Theobalt

3D shape models are naturally parameterized using vertices and faces, \ie, composed of polygons forming a surface. However, current 3D learning paradigms for predictive and generative tasks using convolutional neural networks focus on a…

Computer Vision and Pattern Recognition · Computer Science 2017-03-14 Ayan Sinha , Asim Unmesh , Qixing Huang , Karthik Ramani

Inverse rendering in a 3D format denoted to recovering the 3D properties of a scene given 2D input image(s) and is typically done using 3D Morphable Model (3DMM) based methods from single view images. These models formulate each face as a…

Computer Vision and Pattern Recognition · Computer Science 2017-09-01 Shima Kamyab , Ali Ghodsi , S. Zohreh Azimifar

We represent 3D shape by structured 2D representations of fixed length making it feasible to apply well investigated 2D convolutional neural networks (CNN) for both discriminative and geometric tasks on 3D shapes. We first provide a general…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Kripasindhu Sarkar , Elizabeth Mathews , Didier Stricker

We propose a data-driven method for recovering miss-ing parts of 3D shapes. Our method is based on a new deep learning architecture consisting of two sub-networks: a global structure inference network and a local geometry refinement…

Computer Vision and Pattern Recognition · Computer Science 2017-09-26 Xiaoguang Han , Zhen Li , Haibin Huang , Evangelos Kalogerakis , Yizhou Yu

Researchers have now achieved great success on dealing with 2D images using deep learning. In recent years, 3D computer vision and Geometry Deep Learning gain more and more attention. Many advanced techniques for 3D shapes have been…

Graphics · Computer Science 2020-04-16 Yun-Peng Xiao , Yu-Kun Lai , Fang-Lue Zhang , Chunpeng Li , Lin Gao

Human shape estimation is an important task for video editing, animation and fashion industry. Predicting 3D human body shape from natural images, however, is highly challenging due to factors such as variation in human bodies, clothing and…

Computer Vision and Pattern Recognition · Computer Science 2018-08-21 Gül Varol , Duygu Ceylan , Bryan Russell , Jimei Yang , Ersin Yumer , Ivan Laptev , Cordelia Schmid

We propose a novel deep reinforcement learning-based approach for 3D object reconstruction from monocular images. Prior works that use mesh representations are template based. Thus, they are limited to the reconstruction of objects that…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Tarek Ben Charrada , Hedi Tabia , Aladine Chetouani , Hamid Laga

Generative models that produce point clouds have emerged as a powerful tool to represent 3D surfaces, and the best current ones rely on learning an ensemble of parametric representations. Unfortunately, they offer no control over the…

Computer Vision and Pattern Recognition · Computer Science 2019-11-27 Jan Bednarik , Shaifali Parashar , Erhan Gundogdu , Mathieu Salzmann , Pascal Fua

In this paper, we introduce 3D-GMNet, a deep neural network for 3D object shape reconstruction from a single image. As the name suggests, 3D-GMNet recovers 3D shape as a Gaussian mixture. In contrast to voxels, point clouds, or meshes, a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Kohei Yamashita , Shohei Nobuhara , Ko Nishino

Reconstructing the detailed geometric structure of a face from a given image is a key to many computer vision and graphics applications, such as motion capture and reenactment. The reconstruction task is challenging as human faces vary…

Computer Vision and Pattern Recognition · Computer Science 2017-04-07 Elad Richardson , Matan Sela , Roy Or-El , Ron Kimmel

We study end-to-end learning strategies for 3D shape inference from images, in particular from a single image. Several approaches in this direction have been investigated that explore different shape representations and suitable learning…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Roman Klokov , Jakob Verbeek , Edmond Boyer

Many robotic tasks involving some form of 3D visual perception greatly benefit from a complete knowledge of the working environment. However, robots often have to tackle unstructured environments and their onboard visual sensors can only…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Andrea Rosasco , Stefano Berti , Fabrizio Bottarel , Michele Colledanchise , Lorenzo Natale

We propose a novel method to reconstruct the 3D shapes of transparent objects using hand-held captured images under natural light conditions. It combines the advantage of explicit mesh and multi-layer perceptron (MLP) network, a hybrid…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Jiamin Xu , Zihan Zhu , Hujun Bao , Weiwei Xu

This paper proposes the use of an end-to-end Convolutional Neural Network for direct reconstruction of the 3D geometry of humans via volumetric regression. The proposed method does not require the fitting of a shape model and can be trained…

Computer Vision and Pattern Recognition · Computer Science 2018-09-12 Aaron S. Jackson , Chris Manafas , Georgios Tzimiropoulos

We tackle the problem of automatically reconstructing a complete 3D model of a scene from a single RGB image. This challenging task requires inferring the shape of both visible and occluded surfaces. Our approach utilizes viewer-centered,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Daeyun Shin , Zhile Ren , Erik B. Sudderth , Charless C. Fowlkes

Recovering 3D human body shape and pose from 2D images is a challenging task due to high complexity and flexibility of human body, and relatively less 3D labeled data. Previous methods addressing these issues typically rely on predicting…

Computer Vision and Pattern Recognition · Computer Science 2019-03-29 Pengfei Yao , Zheng Fang , Fan Wu , Yao Feng , Jiwei Li

3D reconstruction from 2D images is a central problem in computer vision. Recent works have been focusing on reconstruction directly from a single image. It is well known however that only one image cannot provide enough information for…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Jhony K. Pontes , Chen Kong , Anders Eriksson , Clinton Fookes , Sridha Sridharan , Simon Lucey