English
Related papers

Related papers: Learning Scene Flow With Skeleton Guidance For 3D …

200 papers

This paper focuses on the challenging task of learning 3D object surface reconstructions from single RGB images. Existing methods achieve varying degrees of success by using different geometric representations. However, they all have their…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Jiapeng Tang , Xiaoguang Han , Junyi Pan , Kui Jia , Xin Tong

Recent advances in imitation learning for 3D robotic manipulation have shown promising results with diffusion-based policies. However, achieving human-level dexterity requires seamless integration of geometric precision and semantic…

Human action recognition from skeletal data is a hot research topic and important in many open domain applications of computer vision, thanks to recently introduced 3D sensors. In the literature, naive methods simply transfer off-the-shelf…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Jacopo Cavazza , Pietro Morerio , Vittorio Murino

This paper simultaneously addresses three limitations associated with conventional skeleton-based action recognition; skeleton detection and tracking errors, poor variety of the targeted actions, as well as person-wise and frame-wise action…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Ryo Hachiuma , Fumiaki Sato , Taiki Sekii

We propose a novel method for 3D point cloud action recognition. Understanding human actions in RGB videos has been widely studied in recent years, however, its 3D point cloud counterpart remains under-explored. This is mostly due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Yizhak Ben-Shabat , Oren Shrout , Stephen Gould

Spatio-temporal feature learning is of central importance for action recognition in videos. Existing deep neural network models either learn spatial and temporal features independently (C2D) or jointly with unconstrained parameters (C3D).…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Chao Li , Qiaoyong Zhong , Di Xie , Shiliang Pu

For pursuing accurate skeleton-based action recognition, most prior methods use the strategy of combining Graph Convolution Networks (GCNs) with attention-based methods in a serial way. However, they regard the human skeleton as a complete…

Computer Vision and Pattern Recognition · Computer Science 2023-01-30 Chen Pang , Xuequan Lu , Lei Lyu

3D Multi-Object Tracking (MOT) is an important part of the unmanned vehicle perception module. Most methods optimize object detection and data association independently. These methods make the network structure complicated and limit the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Yueling Shen , Guangming Wang , Hesheng Wang

Scene flow prediction is a crucial underlying task in understanding dynamic scenes as it offers fundamental motion information. However, contemporary scene flow methods encounter three major challenges. Firstly, flow estimation solely based…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Zhiyang Lu , Qinghan Chen , Ming Cheng

Capturing the dependencies between joints is critical in skeleton-based action recognition task. Transformer shows great potential to model the correlation of important joints. However, the existing Transformer-based methods cannot capture…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Helei Qiu , Biao Hou , Bo Ren , Xiaohua Zhang

Scene flow, which provides the 3D motion field of the first frame from two consecutive point clouds, is vital for dynamic scene perception. However, contemporary scene flow methods face three major challenges. Firstly, they lack global flow…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Zhiyang Lu , Qinghan Chen , Zhimin Yuan , Ming Cheng

Research on depth-based human activity analysis achieved outstanding performance and demonstrated the effectiveness of 3D representation for action recognition. The existing depth-based and RGB+D-based action recognition benchmarks have a…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Jun Liu , Amir Shahroudy , Mauricio Perez , Gang Wang , Ling-Yu Duan , Alex C. Kot

We present a method, Neural Radiance Flow (NeRFlow),to learn a 4D spatial-temporal representation of a dynamic scene from a set of RGB images. Key to our approach is the use of a neural implicit representation that learns to capture the 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Yilun Du , Yinan Zhang , Hong-Xing Yu , Joshua B. Tenenbaum , Jiajun Wu

In skeleton-based action recognition, graph convolutional networks (GCNs), which model human body skeletons using graphical components such as nodes and connections, have achieved remarkable performance recently. However, current…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Jongmin Yu , Yongsang Yoon , Moongu Jeon

Existing work on scene flow estimation focuses on autonomous driving and mobile robotics, while automated solutions are lacking for motion in nature, such as that exhibited by debris flows. We propose DEFLOW, a model for 3D motion…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Liyuan Zhu , Yuru Jia , Shengyu Huang , Nicholas Meyer , Andreas Wieser , Konrad Schindler , Jordan Aaron

We present Seen2Scene, the first flow matching-based approach that trains directly on incomplete, real-world 3D scans for scene completion and generation. Unlike prior methods that rely on complete and hence synthetic 3D data, our approach…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Quan Meng , Yujin Chen , Lei Li , Matthias Nießner , Angela Dai

It is a significant problem to predict the 2D LiDAR map at next moment for robotics navigation and path-planning. To tackle this problem, we resort to the motion flow between adjacent maps, as motion flow is a powerful tool to process and…

Robotics · Computer Science 2019-02-20 Yafei Song , Yonghong Tian , Gang Wang , Mingyang Li

Spatiotemporal and motion features are two complementary and crucial information for video action recognition. Recent state-of-the-art methods adopt a 3D CNN stream to learn spatiotemporal features and another flow stream to learn motion…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Boyuan Jiang , Mengmeng Wang , Weihao Gan , Wei Wu , Junjie Yan

Accurate and real-time traffic state prediction is of great practical importance for urban traffic control and web mapping services. With the support of massive data, deep learning methods have shown their powerful capability in capturing…

Machine Learning · Computer Science 2023-09-07 Xunlian Luo , Chunjiang Zhu , Detian Zhang , Qing Li

In recent years, a number of approaches based on 2D or 3D convolutional neural networks (CNN) have emerged for video action recognition, achieving state-of-the-art results on several large-scale benchmark datasets. In this paper, we carry…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Chun-Fu Chen , Rameswar Panda , Kandan Ramakrishnan , Rogerio Feris , John Cohn , Aude Oliva , Quanfu Fan