English
Related papers

Related papers: BodyMap: Learning Full-Body Dense Correspondence M…

200 papers

Grasping and manipulating objects is an important human skill. Since hand-object contact is fundamental to grasping, capturing it can lead to important insights. However, observing contact through external sensors is challenging because of…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Samarth Brahmbhatt , Cusuh Ham , Charles C. Kemp , James Hays

Establishing dense correspondence between two images is a fundamental computer vision problem, which is typically tackled by matching local feature descriptors. However, without global awareness, such local features are often insufficient…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Zhengfei Kuang , Jiaman Li , Mingming He , Tong Wang , Yajie Zhao

Many real-world applications require the estimation of human body joints for higher-level tasks as, for example, human behaviour understanding. In recent years, depth sensors have become a popular approach to obtain three-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Manuel J. Marin-Jimenez , Francisco J. Romero-Ramirez , Rafael Muñoz-Salinas , Rafael Medina-Carnicer

Estimating correspondences between pairs of deformable shapes remains a challenging problem. Despite substantial progress, existing methods lack broad generalization capabilities and require category-specific training data. To address these…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Aleksei Zhuravlev , Zorah Lähner , Vladislav Golyanik

We propose a novel framework for finding correspondences in images based on a deep neural network that, given two images and a query point in one of them, finds its correspondence in the other. By doing so, one has the option to query only…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Wei Jiang , Eduard Trulls , Jan Hosang , Andrea Tagliasacchi , Kwang Moo Yi

Correspondences emerge from large-scale vision models trained for generative and discriminative tasks. This has been revealed and benchmarked by computing correspondence maps between pairs of images, using nearest neighbors on the feature…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Xinle Cheng , Congyue Deng , Adam Harley , Yixin Zhu , Leonidas Guibas

Statistical shape modeling is an essential tool for the quantitative analysis of anatomical populations. Point distribution models (PDMs) represent the anatomical surface via a dense set of correspondences, an intuitive and easy-to-use…

Image and Video Processing · Electrical Eng. & Systems 2022-01-11 Wenzheng Tao , Riddhish Bhalodia , Shireen Elhabian

Estimating 3D human pose and shape from 2D images is a crucial yet challenging task. While prior methods with model-based representations can perform reasonably well on whole-body images, they often fail when parts of the body are occluded…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Chun-Han Yao , Jimei Yang , Duygu Ceylan , Yi Zhou , Yang Zhou , Ming-Hsuan Yang

This article presents a method for grasping novel objects by learning from experience. Successful attempts are remembered and then used to guide future grasps such that more reliable grasping is achieved over time. To generalise the learned…

Robotics · Computer Science 2020-09-18 Timothy Patten , Kiru Park , Markus Vincze

We investigate the problem of pixelwise correspondence for deformable objects, namely cloth and rope, by comparing both classical and learning-based methods. We choose cloth and rope because they are traditionally some of the most difficult…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Priya Sundaresan , Aditya Ganapathi , Harry Zhang , Shivin Devgon

Learning 3D shape representation with dense correspondence for deformable objects is a fundamental problem in computer vision. Existing approaches often need additional annotations of specific semantic domain, e.g., skeleton poses for human…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Baowen Zhang , Jiahe Li , Xiaoming Deng , Yinda Zhang , Cuixia Ma , Hongan Wang

Recent advances in 3D human shape estimation build upon parametric representations that model very well the shape of the naked body, but are not appropriate to represent the clothing geometry. In this paper, we present an approach to model…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Albert Pumarola , Jordi Sanchez , Gary P. T. Choi , Alberto Sanfeliu , Francesc Moreno-Noguer

We present a novel learning-based approach for computing correspondences between non-rigid 3D shapes. Unlike previous methods that either require extensive training data or operate on handcrafted input descriptors and thus generalize poorly…

Machine Learning · Statistics 2020-04-01 Nicolas Donati , Abhishek Sharma , Maks Ovsjanikov

Recent advances show that Generative Adversarial Networks (GANs) can synthesize images with smooth variations along semantically meaningful latent directions, such as pose, expression, layout, etc. While this indicates that GANs implicitly…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Jiteng Mu , Shalini De Mello , Zhiding Yu , Nuno Vasconcelos , Xiaolong Wang , Jan Kautz , Sifei Liu

The proliferation of 3D scanning technology has driven a need for methods to interpret geometric data, particularly for human subjects. In this paper we propose an elegant fusion of regression (bottom-up) and generative (top-down) methods…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Benjamin Groisser , Alon Wolf , Ron Kimmel

We seek a practical method for establishing dense correspondences between two images with similar content, but possibly different 3D scenes. One of the challenges in designing such a system is the local scale differences of objects…

Computer Vision and Pattern Recognition · Computer Science 2016-04-20 Moria Tau , Tal Hassner

This paper introduces a novel pipeline to reconstruct the geometry of interacting multi-person in clothing on a globally coherent scene space from a single image. The main challenge arises from the occlusion: a part of a human body is not…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Junuk Cha , Hansol Lee , Jaewon Kim , Nhat Nguyen Bao Truong , Jae Shin Yoon , Seungryul Baek

We present a simple yet effective method to infer detailed full human body shape from only a single photograph. Our model can infer full-body shape including face, hair, and clothing including wrinkles at interactive frame-rates. Results…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Thiemo Alldieck , Gerard Pons-Moll , Christian Theobalt , Marcus Magnor

Statistical shape modeling (SSM) is a powerful computational framework for quantifying and analyzing the geometric variability of anatomical structures, facilitating advancements in medical research, diagnostics, and treatment planning.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Krithika Iyer , Jadie Adams , Shireen Y. Elhabian

Knowledge of 3-D object shape is of great importance to robot manipulation tasks, but may not be readily available in unstructured environments. While vision is often occluded during robot-object interaction, high-resolution tactile sensors…

Robotics · Computer Science 2022-03-11 Sudharshan Suresh , Zilin Si , Joshua G. Mangelson , Wenzhen Yuan , Michael Kaess