English
Related papers

Related papers: Using Hand Pose Estimation To Automate Open Surger…

200 papers

We present ActionXPose, a novel 2D pose-based algorithm for posture-level Human Action Recognition (HAR). The proposed approach exploits 2D human poses provided by OpenPose detector from RGB videos. ActionXPose aims to process poses data to…

Image and Video Processing · Electrical Eng. & Systems 2018-10-30 Federico Angelini , Zeyu Fu , Yang Long , Ling Shao , Syed Mohsen Naqvi

For in-hand manipulation, estimation of the object pose inside the hand is one of the important functions to manipulate objects to the target pose. Since in-hand manipulation tends to cause occlusions by the hand or the object itself, image…

Robotics · Computer Science 2020-08-04 Tomoki Anzai , Kuniyuki Takahashi

Segmenting and recognizing surgical operation trajectories into distinct, meaningful gestures is a critical preliminary step in surgical workflow analysis for robot-assisted surgery. This step is necessary for facilitating learning from…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Zhili Yuan , Jialin Lin , Dandan Zhang

State estimation from measured data is crucial for robotic applications as autonomous systems rely on sensors to capture the motion and localize in the 3D world. Among sensors that are designed for measuring a robot's pose, or for soft…

Robotics · Computer Science 2023-02-28 Jingpei Lu , Fei Liu , Cedric Girerd , Michael C. Yip

We focus on the task of everyday hand pose estimation from egocentric viewpoints. For this task, we show that depth sensors are particularly informative for extracting near-field interactions of the camera wearer with his/her environment.…

Computer Vision and Pattern Recognition · Computer Science 2014-12-02 Gregory Rogez , James S. Supancic , Maryam Khademi , Jose Maria Martinez Montiel , Deva Ramanan

We consider the task of estimating 3D human pose and shape from videos. While existing frame-based approaches have made significant progress, these methods are independently applied to each image, thereby often leading to inconsistent…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Yun-Chun Chen , Marco Piccirilli , Robinson Piramuthu , Ming-Hsuan Yang

3D hand shape and pose estimation from a single depth map is a new and challenging computer vision problem with many applications. The state-of-the-art methods directly regress 3D hand meshes from 2D depth images via 2D convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Jameel Malik , Ibrahim Abdelaziz , Ahmed Elhayek , Soshi Shimada , Sk Aziz Ali , Vladislav Golyanik , Christian Theobalt , Didier Stricker

In the context of future manufacturing lines, removing fixtures will be a fundamental step to increase the flexibility of autonomous systems in assembly and logistic operations. Vision-based 3D pose estimation is a necessity to accurately…

Robotics · Computer Science 2020-10-05 Bjarne Grossmann , Francesco Rovida , Volker Krueger

We study how well different types of approaches generalise in the task of 3D hand pose estimation under single hand scenarios and hand-object interaction. We show that the accuracy of state-of-the-art methods can drop, and that they fail…

3D human pose estimation and mesh recovery have attracted widespread research interest in many areas, such as computer vision, autonomous driving, and robotics. Deep learning on 3D human pose estimation and mesh recovery has recently…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Yang Liu , Changzhen Qiu , Zhiyong Zhang

State-of-the-art object pose estimation handles multiple instances in a test image by using multi-model formulations: detection as a first stage and then separately trained networks per object for 2D-3D geometric correspondence prediction…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Stefan Thalhammer , Timothy Patten , Markus Vincze

We propose a Bayesian approximation to a deep learning architecture for 3D hand pose estimation. Through this framework, we explore and analyse the two types of uncertainties that are influenced either by data or by the learning capability.…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Razvan Caramalau , Binod Bhattarai , Tae-Kyun Kim

We present a simple and effective method for 3D hand pose estimation from a single depth frame. As opposed to previous state-of-the-art methods based on holistic 3D regression, our method works on dense pixel-wise estimation. This is…

Computer Vision and Pattern Recognition · Computer Science 2017-11-27 Chengde Wan , Thomas Probst , Luc Van Gool , Angela Yao

We present a method for reconstructing accurate and consistent 3D hands from a monocular video. We observe that detected 2D hand keypoints and the image texture provide important cues about the geometry and texture of the 3D hand, which can…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Zhigang Tu , Zhisheng Huang , Yujin Chen , Di Kang , Linchao Bao , Bisheng Yang , Junsong Yuan

Robotic-assisted surgeries benefit both surgeons and patients, however, surgeons frequently need to adjust the endoscopic camera to achieve good viewpoints. Simultaneously controlling the camera and the surgical instruments is impossible,…

Machine Learning · Computer Science 2022-02-08 Hanna Kossowsky , Ilana Nisky

Pose estimation commonly refers to computer vision methods that recognize people's body postures in images or videos. With recent advancements in deep learning, we now have compelling models to tackle the problem in real-time. Since these…

Robotics · Computer Science 2021-07-07 Arash Amini , Hafez Farazi , Sven Behnke

In robotic surgery, tool tracking is important for providing safe tool-tissue interaction and facilitating surgical skills assessment. Despite recent advances in tool tracking, existing approaches are faced with major difficulties in…

Computer Vision and Pattern Recognition · Computer Science 2016-11-01 Menglong Ye , Lin Zhang , Stamatia Giannarou , Guang-Zhong Yang

We propose a new dataset and a novel approach to learning hand-object interaction priors for hand and articulated object pose estimation. We first collect a dataset using visual teleoperation, where the human operator can directly play…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Zehao Zhu , Jiashun Wang , Yuzhe Qin , Deqing Sun , Varun Jampani , Xiaolong Wang

This paper presents a comprehensive review on regression-based method for human pose estimation. The problem of human pose estimation has been intensively studied and enabled many application from entertainment to training. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2017-09-08 Wenye He

The process of tracking human anatomy in computer vision is referred to pose estimation, and it is used in fields ranging from gaming to surveillance. Three-dimensional pose estimation traditionally requires advanced equipment, such as…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Alice Ruget , Max Tyler , Germán Mora Martín , Stirling Scholes , Feng Zhu , Istvan Gyongy , Brent Hearn , Steve McLaughlin , Abderrahim Halimi , Jonathan Leach