English
Related papers

Related papers: Fine-Grained Multi-View Hand Reconstruction Using …

200 papers

This paper presents a novel method for the reconstruction of images from samples located at non-integer positions, called mesh. This is a common scenario for many image processing applications, such as super-resolution, warping or virtual…

Computer Vision and Pattern Recognition · Computer Science 2022-05-23 Ján Koloda , Jürgen Seiler , André Kaup

Very recently neural implicit rendering techniques have been rapidly evolved and shown great advantages in novel view synthesis and 3D scene reconstruction. However, existing neural rendering methods for editing purposes offer limited…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Bangbang Yang , Chong Bao , Junyi Zeng , Hujun Bao , Yinda Zhang , Zhaopeng Cui , Guofeng Zhang

We present a method for reconstructing accurate and consistent 3D hands from a monocular video. We observe that detected 2D hand keypoints and the image texture provide important cues about the geometry and texture of the 3D hand, which can…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Zhigang Tu , Zhisheng Huang , Yujin Chen , Di Kang , Linchao Bao , Bisheng Yang , Junsong Yuan

Despite recent advances in 3D pose estimation of human hands, especially thanks to the advent of CNNs and depth cameras, this task is still far from being solved. This is mainly due to the highly non-linear dynamics of fingers, which make…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Meysam Madadi , Sergio Escalera , Xavier Baro , Jordi Gonzalez

We propose an analysis-by-synthesis method for fast multi-view 3D reconstruction of opaque objects with arbitrary materials and illumination. State-of-the-art methods use both neural surface representations and neural rendering. While…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Markus Worchel , Rodrigo Diaz , Weiwen Hu , Oliver Schreer , Ingo Feldmann , Peter Eisert

We propose the first approach to the problem of inferring the depth map of a human hand based on a single RGB image. We achieve this with a Convolutional Neural Network (CNN) that employs a stacked hourglass model as its main building…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 Vassilis C. Nicodemou , Iason Oikonomidis , Georgios Tzimiropoulos , Antonis Argyros

We propose a novel 3D neural network architecture for 3D hand pose estimation from a single depth image. Different from previous works that mostly run on 2D depth image domain and require intermediate or post process to bring in the…

Computer Vision and Pattern Recognition · Computer Science 2017-04-10 Xiaoming Deng , Shuo Yang , Yinda Zhang , Ping Tan , Liang Chang , Hongan Wang

Neural Radiance Fields (NeRF) have constituted a remarkable breakthrough in image-based 3D reconstruction. However, their implicit volumetric representations differ significantly from the widely-adopted polygonal meshes and lack support…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jiaxiang Tang , Hang Zhou , Xiaokang Chen , Tianshu Hu , Errui Ding , Jingdong Wang , Gang Zeng

We introduce and evaluate several architectures for Convolutional Neural Networks to predict the 3D joint locations of a hand given a depth map. We first show that a prior on the 3D pose can be easily introduced and significantly improves…

Computer Vision and Pattern Recognition · Computer Science 2016-12-05 Markus Oberweger , Paul Wohlhart , Vincent Lepetit

We study the problem of shape generation in 3D mesh representation from a small number of color images with or without camera poses. While many previous works learn to hallucinate the shape directly from priors, we adopt to further improve…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Chao Wen , Yinda Zhang , Chenjie Cao , Zhuwen Li , Xiangyang Xue , Yanwei Fu

Analyzing and understanding hand information from multimedia materials like images or videos is important for many real world applications and remains active in research community. There are various works focusing on recovering hand…

Computer Vision and Pattern Recognition · Computer Science 2021-07-29 Xiong Zhang , Hongsheng Huang , Jianchao Tan , Hongmin Xu , Cheng Yang , Guozhu Peng , Lei Wang , Ji Liu

Image alignment by mesh warps, such as meshflow, is a fundamental task which has been widely applied in various vision applications(e.g., multi-frame HDR/denoising, video stabilization). Traditional mesh warp methods detect and match image…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Nianjin Ye , Chuan Wang , Shuaicheng Liu , Lanpeng Jia , Jue Wang , Yongqing Cui

4D reconstruction of human-object interaction is critical for immersive VR/AR experience and human activity understanding. Recent advances still fail to recover fine geometry and texture results from sparse RGB inputs, especially under…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Guoxing Sun , Xin Chen , Yizhang Chen , Anqi Pang , Pei Lin , Yuheng Jiang , Lan Xu , Jingya Wang , Jingyi Yu

Estimating the poses of both a hand and an object has become an important area of research due to the growing need for advanced vision computing. The primary challenge involves understanding and reconstructing how hands and objects…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Taeyun Woo , Tae-Kyun Kim , Jinah Park

Synthesizing realistic videos of humans using neural networks has been a popular alternative to the conventional graphics-based rendering pipeline due to its high efficiency. Existing works typically formulate this as an image-to-image…

Reconstructing 3D hand meshes from monocular RGB images has attracted increasing amount of attention due to its enormous potential applications in the field of AR/VR. Most state-of-the-art methods attempt to tackle this task in an anonymous…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Deying Kong , Linguang Zhang , Liangjian Chen , Haoyu Ma , Xiangyi Yan , Shanlin Sun , Xingwei Liu , Kun Han , Xiaohui Xie

Hand gesture is one of the most important means of touchless communication between human and machines. There is a great interest for commanding electronic equipment in surgery rooms by hand gesture for reducing the time of surgery and the…

Computer Vision and Pattern Recognition · Computer Science 2017-10-24 Ebrahim Nasr-Esfahani , Nader Karimi , S. M. Reza Soroushmehr , M. Hossein Jafari , M. Amin Khorsandi , Shadrokh Samavi , Kayvan Najarian

With the rising popularity of virtual worlds, the importance of data-driven parametric models of 3D meshes has grown rapidly. Numerous applications, such as computer vision, procedural generation, and mesh editing, vastly rely on these…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Robert Kosk , Richard Southern , Lihua You , Shaojun Bian , Willem Kokke , Greg Maguire

Direct mesh fitting for 3D hand shape reconstruction is highly accurate. However, the reconstructed meshes are prone to artifacts and do not appear as plausible hand shapes. Conversely, parametric models like MANO ensure plausible hand…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Ziwei Yu , Chen Li , Linlin Yang , Xiaoxu Zheng , Michael Bi Mi , Gim Hee Lee , Angela Yao

With the growth in capabilities of generative models, there has been growing interest in using photo-realistic renders of common 3D food items to improve downstream tasks such as food printing, nutrition prediction, or management of food…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Chi-en Amy Tai , Jason Li , Sriram Kumar , Saeejith Nair , Yuhao Chen , Pengcheng Xi , Alexander Wong