English
Related papers

Related papers: Learning Scene Flow With Skeleton Guidance For 3D …

200 papers

Skeleton-based action recognition has made great progress recently, but many problems still remain unsolved. For example, most of the previous methods model the representations of skeleton sequences without abundant spatial structure…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Chenyang Si , Ya Jing , Wei Wang , Liang Wang , Tieniu Tan

Human action recognition from well-segmented 3D skeleton data has been intensively studied and has been attracting an increasing attention. Online action detection goes one step further and is more challenging, which identifies the action…

Computer Vision and Pattern Recognition · Computer Science 2016-07-27 Yanghao Li , Cuiling Lan , Junliang Xing , Wenjun Zeng , Chunfeng Yuan , Jiaying Liu

Scene flow represents the 3D motion of every point in the dynamic environments. Like the optical flow that represents the motion of pixels in 2D images, 3D motion representation of scene flow benefits many applications, such as autonomous…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Guangming Wang , Xinrui Wu , Zhe Liu , Hesheng Wang

In the last years, the computer vision research community has studied on how to model temporal dynamics in videos to employ 3D human action recognition. To that end, two main baseline approaches have been researched: (i) Recurrent Neural…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Carlos Caetano , François Brémond , William Robson Schwartz

Learning robust visuomotor policies that generalize across diverse objects and interaction dynamics remains a central challenge in robotic manipulation. Most existing approaches rely on direct observation-to-action mappings or compress…

Robotics · Computer Science 2025-09-24 Sangjun Noh , Dongwoo Nam , Kangmin Kim , Geonhyup Lee , Yeonguk Yu , Raeyoung Kang , Kyoobin Lee

We present a method for decomposing the 3D scene flow observed from a moving stereo rig into stationary scene elements and dynamic object motion. Our unsupervised learning framework jointly reasons about the camera motion, optical flow, and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Seokju Lee , Sunghoon Im , Stephen Lin , In So Kweon

Autonomous vehicles operate in highly dynamic environments necessitating an accurate assessment of which aspects of a scene are moving and where they are moving to. A popular approach to 3D motion estimation, termed scene flow, is to employ…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Philipp Jund , Chris Sweeney , Nichola Abdo , Zhifeng Chen , Jonathon Shlens

Understanding the flow in 3D space of sparsely sampled points between two consecutive time frames is the core stone of modern geometric-driven systems such as VR/AR, Robotics, and Autonomous driving. The lack of real, non-simulated, labeled…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Bojun Ouyang , Dan Raviv

Feature matching across video streams remains a cornerstone challenge in computer vision. Increasingly, robust multimodal matching has garnered interest in robotics, surveillance, remote sensing, and medical imaging. While traditional rely…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Jie Wang , Chen Ye Gan , Caoqi Wei , Jiangtao Wen , Yuxing Han

In this paper we address the problem of human action recognition from video sequences. Inspired by the exemplary results obtained via automatic feature learning and deep learning approaches in computer vision, we focus our attention towards…

Computer Vision and Pattern Recognition · Computer Science 2017-04-06 Harshala Gammulle , Simon Denman , Sridha Sridharan , Clinton Fookes

Skeleton-based human action recognition has attracted great interest thanks to the easy accessibility of the human skeleton data. Recently, there is a trend of using very deep feedforward neural networks to model the 3D coordinates of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Pengfei Zhang , Cuiling Lan , Wenjun Zeng , Junliang Xing , Jianru Xue , Nanning Zheng

Skeleton-based human action recognition is a powerful approach for understanding human behaviour from pose data, but collecting large-scale, diverse, and well-annotated 3D skeleton datasets is both expensive and labor-intensive. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Xu Dong , Wanqing Li , Anthony Adeyemi-Ejeye , Andrew Gilbert

The gesture recognition using motion capture data and depth sensors has recently drawn more attention in vision recognition. Currently most systems only classify dataset with a couple of dozens different actions. Moreover, feature…

Computer Vision and Pattern Recognition · Computer Science 2014-09-02 Kyunghyun Cho , Xi Chen

Skeleton-based human action recognition has achieved a great interest in recent years, as skeleton data has been demonstrated to be robust to illumination changes, body scales, dynamic camera views, and complex background. Nevertheless, an…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Chiara Plizzari , Marco Cannici , Matteo Matteucci

The video and action classification have extremely evolved by deep neural networks specially with two stream CNN using RGB and optical flow as inputs and they present outstanding performance in terms of video analysis. One of the…

Computer Vision and Pattern Recognition · Computer Science 2016-09-05 Ali Diba , Ali Mohammad Pazandeh , Luc Van Gool

This article proposes a novel attention-based body pose encoding for human activity recognition that presents a enriched representation of body-pose that is learned. The enriched data complements the 3D body joint position data and improves…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 B Debnath , M O'brien , S Kumar , A Behera

One-shot skeleton action recognition, which aims to learn a skeleton action recognition model with a single training sample, has attracted increasing interest due to the challenge of collecting and annotating large-scale skeleton action…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Siyuan Yang , Jun Liu , Shijian Lu , Er Meng Hwa , Alex C. Kot

In this paper, we propose to improve the traditional use of RNNs by employing a many to many model for video classification. We analyze the importance of modeling spatial layout and temporal encoding for daily living action recognition.…

Computer Vision and Pattern Recognition · Computer Science 2018-06-18 Srijan Das , Michal Koperski , Francois Bremond , Gianpiero Francesca

We study the problem of self-supervised 3D scene flow estimation from real large-scale raw point cloud sequences, which is crucial to various tasks like trajectory prediction or instance segmentation. In the absence of ground truth scene…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Patrik Vacek , David Hurych , Tomáš Svoboda , Karel Zimmermann

We propose a data-driven scene flow estimation algorithm exploiting the observation that many 3D scenes can be explained by a collection of agents moving as rigid bodies. At the core of our method lies a deep architecture able to reason at…

Computer Vision and Pattern Recognition · Computer Science 2021-02-18 Zan Gojcic , Or Litany , Andreas Wieser , Leonidas J. Guibas , Tolga Birdal