English
Related papers

Related papers: Topology-Preserved Human Reconstruction with Detai…

200 papers

We present a novel method for temporal coherent reconstruction and tracking of clothed humans. Given a monocular RGB-D sequence, we learn a person-specific body model which is based on a dynamic surface function network. To this end, we…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Andrei Burov , Matthias Nießner , Justus Thies

We propose an end-to-end deep learning architecture that produces a 3D shape in triangular mesh from a single color image. Limited by the nature of deep neural network, previous methods usually represent a 3D shape in volume or point cloud,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-06 Nanyang Wang , Yinda Zhang , Zhuwen Li , Yanwei Fu , Wei Liu , Yu-Gang Jiang

Constructing and animating humans is an important component for building virtual worlds in a wide variety of applications such as virtual reality or robotics testing in simulation. As there are exponentially many variations of humans with…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Ze Yang , Shenlong Wang , Sivabalan Manivasagam , Zeng Huang , Wei-Chiu Ma , Xinchen Yan , Ersin Yumer , Raquel Urtasun

This paper presents a novel framework to recover \emph{detailed} avatar from a single image. It is a challenging task due to factors such as variations in human shapes, body poses, texture, and viewpoints. Prior methods typically attempt to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-21 Hao Zhu , Xinxin Zuo , Haotian Yang , Sen Wang , Xun Cao , Ruigang Yang

Human body parsing remains a challenging problem in natural scenes due to multi-instance and inter-part semantic confusions as well as occlusions. This paper proposes a novel approach to decomposing multiple human bodies into semantic part…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Tinghuai Wang , Huiling Wang

Despite recent research advancements in reconstructing clothed humans from a single image, accurately restoring the "unseen regions" with high-level details remains an unsolved challenge that lacks attention. Existing methods often generate…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yangyi Huang , Hongwei Yi , Yuliang Xiu , Tingting Liao , Jiaxiang Tang , Deng Cai , Justus Thies

Meshes are widely used in 3D computer vision and graphics, but their irregular topology poses challenges in applying them to existing neural network architectures. Recent advances in mesh neural networks turn to remeshing and push the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Shengchao Yuan , Yishun Dou , Rui Shi , Bingbing Ni , Zhong Zheng

We present an approach to generating 3D human models from images. The key to our framework is that we predict double-sided orthographic depth maps and color images from a single perspective projected image. Our framework consists of three…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Min-Gyu Park , Ju-Mi Kang , Je Woo Kim , Ju Hong Yoon

3D human pose estimation errors would propagate along the human body topology and accumulate at the end joints of limbs. Inspired by the backtracking mechanism in automatic control systems, we design an Intra-Part Constraint module that…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Jialun Cai , Hong Liu , Runwei Ding , Wenhao Li , Jianbing Wu , Miaoju Ban

Skin cancer is one of the most common cancers in the United States. As technological advancements are made, algorithmic diagnosis of skin lesions is becoming more important. In this paper, we develop algorithms for segmenting the actual…

Computer Vision and Pattern Recognition · Computer Science 2019-05-22 Yu-Min Chung , Chuan-Shen Hu , Austin Lawson , Clifford Smyth

We introduce a method for training neural networks to perform image or volume segmentation in which prior knowledge about the topology of the segmented object can be explicitly provided and then incorporated into the training process. By…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 James R. Clough , Nicholas Byrne , Ilkay Oksuz , Veronika A. Zimmer , Julia A. Schnabel , Andrew P. King

High-quality 3D garment reconstruction plays a crucial role in mitigating the sim-to-real gap in applications such as digital avatars, virtual try-on and robotic manipulation. However, existing garment reconstruction methods typically rely…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Ming Li , Hui Shan , Kai Zheng , Chentao Shen , Siyu Liu , Yanwei Fu , Zhen Chen , Xiangru Huang

Accurate delineation of fine-scale structures is a very important yet challenging problem. Existing methods use topological information as an additional training loss, but are ultimately making pixel-wise predictions. In this paper, we…

Image and Video Processing · Electrical Eng. & Systems 2022-10-04 Xiaoling Hu , Dimitris Samaras , Chao Chen

3D human segmentation has seen noticeable progress in re-cent years. It, however, still remains a challenge to date. In this paper, weintroduce a deep patch-based method for 3D human segmentation. Wefirst extract a local surface patch for…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Dongbo Zhang , Zheng Fang , Xuequan Lu , Hong Qin , Antonio Robles-Kelly , Chao Zhang , Ying He

We introduce a new silhouette-based representation for modeling clothed human bodies using deep generative models. Our method can reconstruct a complete and textured 3D model of a person wearing clothes from a single input picture. Inspired…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Ryota Natsume , Shunsuke Saito , Zeng Huang , Weikai Chen , Chongyang Ma , Hao Li , Shigeo Morishima

From an image of a person, we can easily infer the natural 3D pose and shape of the person even if ambiguity exists. This is because we have a mental model that allows us to imagine a person's appearance at different viewing directions from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Hanbyel Cho , Yooshin Cho , Jaesung Ahn , Junmo Kim

We propose a novel deep reinforcement learning-based approach for 3D object reconstruction from monocular images. Prior works that use mesh representations are template based. Thus, they are limited to the reconstruction of objects that…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Tarek Ben Charrada , Hedi Tabia , Aladine Chetouani , Hamid Laga

With the recent advances in hardware and rendering techniques, 3D models have emerged everywhere in our life. Yet creating 3D shapes is arduous and requires significant professional knowledge. Meanwhile, Deep learning has enabled…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Zhiqin Chen

We describe Human Mesh Recovery (HMR), an end-to-end framework for reconstructing a full 3D mesh of a human body from a single RGB image. In contrast to most current methods that compute 2D or 3D joint locations, we produce a richer and…

Computer Vision and Pattern Recognition · Computer Science 2018-06-26 Angjoo Kanazawa , Michael J. Black , David W. Jacobs , Jitendra Malik

While conventional computer vision emphasizes pixel-level and feature-based objectives, medical image analysis of intricate biological structures necessitates explicit representation of their complex topological properties. Despite their…

Image and Video Processing · Electrical Eng. & Systems 2024-12-31 Yousef Yeganeh , Rui Xiao , Goktug Guvercin , Nassir Navab , Azade Farshad