English
Related papers

Related papers: Temporal-Aware Self-Supervised Learning for 3D Han…

200 papers

Accurate 6D object pose estimation is fundamental to robotic manipulation and grasping. Previous methods follow a local optimization approach which minimizes the distance between closest point pairs to handle the rotation ambiguity of…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Meng Tian , Liang Pan , Marcelo H Ang , Gim Hee Lee

We present a large-scale study on unsupervised spatiotemporal representation learning from videos. With a unified perspective on four recent image-based frameworks, we study a simple objective that can easily generalize all these methods to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Christoph Feichtenhofer , Haoqi Fan , Bo Xiong , Ross Girshick , Kaiming He

Although various image-based domain adaptation (DA) techniques have been proposed in recent years, domain shift in videos is still not well-explored. Most previous works only evaluate performance on small-scale datasets which are saturated.…

Computer Vision and Pattern Recognition · Computer Science 2019-06-10 Min-Hung Chen , Zsolt Kira , Ghassan AlRegib

Quantifying motion in 3D is important for studying the behavior of humans and other animals, but manual pose annotations are expensive and time-consuming to obtain. Self-supervised keypoint discovery is a promising strategy for estimating…

Estimating the remaining surgery duration (RSD) during surgical procedures can be useful for OR planning and anesthesia dose estimation. With the recent success of deep learning-based methods in computer vision, several neural network…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 Dominik Rivoir , Sebastian Bodenstedt , Felix von Bechtolsheim , Marius Distler , Jürgen Weitz , Stefanie Speidel

We present a method that can recognize new objects and estimate their 3D pose in RGB images even under partial occlusions. Our method requires neither a training phase on these objects nor real images depicting them, only their CAD models.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Van Nguyen Nguyen , Yinlin Hu , Yang Xiao , Mathieu Salzmann , Vincent Lepetit

Self-attention has been successfully applied to video representation learning due to the effectiveness of modeling long range dependencies. Existing approaches build the dependencies merely by computing the pairwise correlations along…

Computer Vision and Pattern Recognition · Computer Science 2021-05-28 Xudong Guo , Xun Guo , Yan Lu

This work tackles Weakly Supervised Anomaly detection, in which a predictor is allowed to learn not only from normal examples but also from a few labeled anomalies made available during training. In particular, we deal with the localization…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Aniello Panariello , Angelo Porrello , Simone Calderara , Rita Cucchiara

This paper proposes a method for hand pose estimation from RGB images that uses both external large-scale depth image datasets and paired depth and RGB images as privileged information at training time. We show that providing depth…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Shanxin Yuan , Bjorn Stenger , Tae-Kyun Kim

Understanding the camera wearer's activity is central to egocentric vision, yet one key facet of that activity is inherently invisible to the camera--the wearer's body pose. Prior work focuses on estimating the pose of hands and arms when…

Computer Vision and Pattern Recognition · Computer Science 2016-03-28 Hao Jiang , Kristen Grauman

Modern deep learning-based 3D pose estimation approaches require plenty of 3D pose annotations. However, existing 3D datasets lack diversity, which limits the performance of current methods and their generalization ability. Although…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Zhongwei Qiu , Kai Qiu , Jianlong Fu , Dongmei Fu

Hand pose estimation is difficult due to different environmental conditions, object- and self-occlusion as well as diversity in hand shape and appearance. Exhaustively covering this wide range of factors in fully annotated datasets has…

Computer Vision and Pattern Recognition · Computer Science 2021-06-11 Adrian Spurr , Pavlo Molchanov , Umar Iqbal , Jan Kautz , Otmar Hilliges

Recovering 3D human pose from 2D joints is still a challenging problem, especially without any 3D annotation, video information, or multi-view information. In this paper, we present an unsupervised GAN-based model consisting of multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Yicheng Deng , Cheng Sun , Jiahui Zhu , Yongqi Sun

Monocular 3D object detection continues to attract attention due to the cost benefits and wider availability of RGB cameras. Despite the recent advances and the ability to acquire data at scale, annotation cost and complexity still limit…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Issa Mouawad , Nikolas Brasch , Fabian Manhardt , Federico Tombari , Francesca Odone

We propose a general self-supervised learning approach for spatial perception tasks, such as estimating the pose of an object relative to the robot, from onboard sensor readings. The model is learned from training episodes, by relying on: a…

Robotics · Computer Science 2021-07-20 Mirko Nava , Antonio Paolillo , Jérôme Guzzi , Luca Maria Gambardella , Alessandro Giusti

Understanding the 3D world without supervision is currently a major challenge in computer vision as the annotations required to supervise deep networks for tasks in this domain are expensive to obtain on a large scale. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Octave Mariotti , Oisin Mac Aodha , Hakan Bilen

In recent years, 2D Convolutional Networks-based video action recognition has encouragingly gained wide popularity; However, constrained by the lack of long-range non-linear temporal relation modeling and reverse motion information…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Yongkang Zhang , Jun Li , Guoming Wu , Han Zhang , Zhiping Shi , Zhaoxun Liu , Zizhang Wu

Articulated hand pose and shape estimation is an important problem for vision-based applications such as augmented reality and animation. In contrast to the existing methods which optimize only for joint positions, we propose a fully…

Computer Vision and Pattern Recognition · Computer Science 2018-08-29 Jameel Malik , Ahmed Elhayek , Fabrizio Nunnari , Kiran Varanasi , Kiarash Tamaddon , Alexis Heloir , Didier Stricker

Existing 3D human pose estimation algorithms trained on distortion-free datasets suffer performance drop when applied to new scenarios with a specific camera distortion. In this paper, we propose a simple yet effective model for 3D human…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Hanbyel Cho , Yooshin Cho , Jaemyung Yu , Junmo Kim

Estimating 3D hand pose from single RGB images is a highly ambiguous problem that relies on an unbiased training dataset. In this paper, we analyze cross-dataset generalization when training on existing datasets. We find that approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-09-16 Christian Zimmermann , Duygu Ceylan , Jimei Yang , Bryan Russell , Max Argus , Thomas Brox