English
Related papers

Related papers: Self-supervised Learning of Implicit Shape Represe…

200 papers

Much progress has been made in the supervised learning of 3D reconstruction of rigid objects from multi-view images or a video. However, it is more challenging to reconstruct severely deformed objects from a single-view RGB image in an…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Jie Mei , Jingxi Yu , Suzanne Romain , Craig Rose , Kelsey Magrane , Graeme LeeSon , Jenq-Neng Hwang

We propose 3Deformer, a general-purpose framework for interactive 3D shape editing. Given a source 3D mesh with semantic materials, and a user-specified semantic image, 3Deformer can accurately edit the source mesh following the shape…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Hao Su , Xuefeng Liu , Jianwei Niu , Ji Wan , Xinghao Wu

Shape deformation is an important component in any geometry processing toolbox. The goal is to enable intuitive deformations of single or multiple shapes or to transfer example deformations to new shapes while preserving the plausibility of…

Graphics · Computer Science 2020-09-04 Minhyuk Sung , Zhenyu Jiang , Panos Achlioptas , Niloy J. Mitra , Leonidas J. Guibas

This work explores how to use self-supervised learning on videos to learn a class-specific image embedding that encodes pose and shape information. At train time, two frames of the same video of an object class (e.g. human upper body) are…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Olivia Wiles , A. Sophia Koepke , Andrew Zisserman

We present a new self-supervised pre-training of Vision Transformers for dense prediction tasks. It is based on a contrastive loss across views that compares pixel-level representations to global image representations. This strategy…

Computer Vision and Pattern Recognition · Computer Science 2022-06-08 Jaonary Rabarisoa , Valentin Belissen , Florian Chabot , Quoc-Cuong Pham

3D Shape representation has substantial effects on 3D shape reconstruction. Primitive-based representations approximate a 3D shape mainly by a set of simple implicit primitives, but the low geometrical complexity of the primitives limits…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Mohsen Yavartanoo , JaeYoung Chung , Reyhaneh Neshatavar , Kyoung Mu Lee

We propose a novel unsupervised learning approach to 3D shape correspondence that builds a multiscale matching pipeline into a deep neural network. This approach is based on smooth shells, the current state-of-the-art axiomatic…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Marvin Eisenberger , Aysim Toker , Laura Leal-Taixé , Daniel Cremers

Implicit functions represented as deep learning approximations are powerful for reconstructing 3D surfaces. However, they can only produce static surfaces that are not controllable, which provides limited ability to modify the resulting…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Bharat Lal Bhatnagar , Cristian Sminchisescu , Christian Theobalt , Gerard Pons-Moll

Animating a newly designed character using motion capture (mocap) data is a long standing problem in computer animation. A key consideration is the skeletal structure that should correspond to the available mocap data, and the shape…

Graphics · Computer Science 2021-05-07 Peizhuo Li , Kfir Aberman , Rana Hanocka , Libin Liu , Olga Sorkine-Hornung , Baoquan Chen

Impressive progress in 3D shape extraction led to representations that can capture object geometries with high fidelity. In parallel, primitive-based methods seek to represent objects as semantically consistent part arrangements. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Despoina Paschalidou , Angelos Katharopoulos , Andreas Geiger , Sanja Fidler

This paper presents a novel framework to recover detailed human body shapes from a single image. It is a challenging task due to factors such as variations in human shapes, body poses, and viewpoints. Prior methods typically attempt to…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Hao Zhu , Xinxin Zuo , Sen Wang , Xun Cao , Ruigang Yang

Statistical shape modeling is the computational process of discovering significant shape parameters from segmented anatomies captured by medical images (such as MRI and CT scans), which can fully describe subject-specific anatomy in the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Krithika Iyer , Shireen Elhabian

Perceiving accurate 3D object shape is important for robots to interact with the physical world. Current research along this direction has been primarily relying on visual observations. Vision, however useful, has inherent limitations due…

Computer Vision and Pattern Recognition · Computer Science 2018-08-10 Shaoxiong Wang , Jiajun Wu , Xingyuan Sun , Wenzhen Yuan , William T. Freeman , Joshua B. Tenenbaum , Edward H. Adelson

Current state-of-the-art methods cast monocular 3D human pose estimation as a learning problem by training neural networks on large data sets of images and corresponding skeleton poses. In contrast, we propose an approach that can exploit…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Simon Jenni , Paolo Favaro

Choosing the right representation for geometry is crucial for making 3D models compatible with existing applications. Focusing on piecewise-smooth man-made shapes, we propose a new representation that is usable in conventional CAD modeling…

Graphics · Computer Science 2021-02-11 Dmitriy Smirnov , Mikhail Bessmeltsev , Justin Solomon

Robotic manipulation systems operating in complex environments rely on perception systems that provide information about the geometry (pose and 3D shape) of the objects in the scene along with other semantic information such as object…

Robotics · Computer Science 2023-05-17 Shubham Agrawal , Nikhil Chavan-Dafle , Isaac Kasahara , Selim Engin , Jinwook Huh , Volkan Isler

We present Deep Shape-from-Template (DeepSfT), a novel Deep Neural Network (DNN) method for solving real-time automatic registration and 3D reconstruction of a deformable object viewed in a single monocular image.DeepSfT advances the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 David Fuentes-Jimenez , David Casillas-Perez , Daniel Pizarro , Toby Collins , Adrien Bartoli

Humans make extensive use of vision and touch as complementary senses, with vision providing global information about the scene and touch measuring local information during manipulation without suffering from occlusions. While prior work…

Robotics · Computer Science 2023-08-01 Justin Kerr , Huang Huang , Albert Wilcox , Ryan Hoque , Jeffrey Ichnowski , Roberto Calandra , Ken Goldberg

Implicit neural representations are a promising new avenue of representing general signals by learning a continuous function that, parameterized as a neural network, maps the domain of a signal to its codomain; the mapping from spatial…

Machine Learning · Computer Science 2021-11-09 Jaeho Lee , Jihoon Tack , Namhoon Lee , Jinwoo Shin

We address the problem of inferring self-supervised dense semantic correspondences between objects in multi-object scenes. The method introduces learning of class-aware dense object descriptors by providing either unsupervised discrete…

Robotics · Computer Science 2021-10-06 Denis Hadjivelichkov , Dimitrios Kanoulas