English
Related papers

Related papers: ContrastMotion: Self-supervised Scene Motion Learn…

200 papers

The unsupervised 3D object detection is to accurately detect objects in unstructured environments with no explicit supervisory signals. This task, given sparse LiDAR point clouds, often results in compromised performance for detecting…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Ruiyang Zhang , Hu Zhang , Hang Yu , Zhedong Zheng

Despite significant progress in image-based 3D scene flow estimation, the performance of such approaches has not yet reached the fidelity required by many applications. Simultaneously, these applications are often not restricted to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-08 Aseem Behl , Despoina Paschalidou , Simon Donné , Andreas Geiger

The perception of motion behavior in a dynamic environment holds significant importance for autonomous driving systems, wherein class-agnostic motion prediction methods directly predict the motion of the entire point cloud. While most…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Kewei Wang , Yizheng Wu , Jun Cen , Zhiyu Pan , Xingyi Li , Zhe Wang , Zhiguo Cao , Guosheng Lin

Unsupervised contrastive learning for indoor-scene point clouds has achieved great successes. However, unsupervised learning point clouds in outdoor scenes remains challenging because previous methods need to reconstruct the whole scene and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Runjian Chen , Yao Mu , Runsen Xu , Wenqi Shao , Chenhan Jiang , Hang Xu , Zhenguo Li , Ping Luo

In the realm of autonomous driving, accurate 3D perception is the foundation. However, developing such models relies on extensive human annotations -- a process that is both costly and labor-intensive. To address this challenge from a data…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Xiang Xu , Lingdong Kong , Hui Shuai , Wenwei Zhang , Liang Pan , Kai Chen , Ziwei Liu , Qingshan Liu

Learning 3D scene flow from LiDAR point clouds presents significant difficulties, including poor generalization from synthetic datasets to real scenes, scarcity of real-world 3D labels, and poor performance on real sparse LiDAR point…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Chaokang Jiang , Guangming Wang , Jiuming Liu , Hesheng Wang , Zhuang Ma , Zhenqiang Liu , Zhujin Liang , Yi Shan , Dalong Du

In this paper, we present a new self-supervised scene flow estimation approach for a pair of consecutive point clouds. The key idea of our approach is to represent discrete point clouds as continuous probability density functions using…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Pan He , Patrick Emami , Sanjay Ranka , Anand Rangarajan

Exploiting past 3D LiDAR scans to predict future point clouds is a promising method for autonomous mobile systems to realize foresighted state estimation, collision avoidance, and planning. In this paper, we address the problem of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Benedikt Mersch , Xieyuanli Chen , Jens Behley , Cyrill Stachniss

The ability to reliably perceive the environmental states, particularly the existence of objects and their motion behavior, is crucial for autonomous driving. In this work, we propose an efficient deep model, called MotionNet, to jointly…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Pengxiang Wu , Siheng Chen , Dimitris Metaxas

In this paper, we study the problem of unsupervised object detection from 3D point clouds in self-driving scenes. We present a simple yet effective method that exploits (i) point clustering in near-range areas where the point clouds are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Lunjun Zhang , Anqi Joyce Yang , Yuwen Xiong , Sergio Casas , Bin Yang , Mengye Ren , Raquel Urtasun

Due to the lack of depth cues in images, multi-frame inputs are important for the success of vision-based perception, prediction, and planning in autonomous driving. Observations from different angles enable the recovery of 3D object states…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Yichen Xie , Hongge Chen , Gregory P. Meyer , Yong Jae Lee , Eric M. Wolff , Masayoshi Tomizuka , Wei Zhan , Yuning Chai , Xin Huang

Identifying moving objects is an essential capability for autonomous systems, as it provides critical information for pose estimation, navigation, collision avoidance, and static map construction. In this paper, we present MotionBEV, a fast…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Bo Zhou , Jiapeng Xie , Yan Pan , Jiajie Wu , Chuanzhao Lu

Object detection and motion parameters estimation are crucial tasks for self-driving vehicle safe navigation in a complex urban environment. In this work we propose a novel real-time approach of temporal context aggregation for motion…

Computer Vision and Pattern Recognition · Computer Science 2020-04-27 Artem Filatov , Andrey Rykov , Viacheslav Murashkin

An effective framework for learning 3D representations for perception tasks is distilling rich self-supervised image features via contrastive learning. However, image-to point representation learning for autonomous driving datasets faces…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Anas Mahmoud , Jordan S. K. Hu , Tianshu Kuai , Ali Harakeh , Liam Paull , Steven L. Waslander

Manual annotation of large-scale point cloud dataset for varying tasks such as 3D object classification, segmentation and detection is often laborious owing to the irregular structure of point clouds. Self-supervised learning, which…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Mohamed Afham , Isuru Dissanayake , Dinithi Dissanayake , Amaya Dharmasiri , Kanchana Thilakarathna , Ranga Rodrigo

Efficient data utilization is crucial for advancing 3D scene understanding in autonomous driving, where reliance on heavily human-annotated LiDAR point clouds challenges fully supervised methods. Addressing this, our study extends into…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Lingdong Kong , Xiang Xu , Jiawei Ren , Wenwei Zhang , Liang Pan , Kai Chen , Wei Tsang Ooi , Ziwei Liu

We propose a new self-supervised approach to image feature learning from motion cue. This new approach leverages recent advances in deep learning in two directions: 1) the success of training deep neural network in estimating optical flow…

Computer Vision and Pattern Recognition · Computer Science 2019-01-10 Bin Ma , Shubao Liu , Yingxuan Zhi , Qi Song

Manually annotating complex scene point cloud datasets is both costly and error-prone. To reduce the reliance on labeled data, a new model called SnapshotNet is proposed as a self-supervised feature learning approach, which directly works…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Xingye Li , Ling Zhang , Zhigang Zhu

One central question for video action recognition is how to model motion. In this paper, we present hierarchical contrastive motion learning, a new self-supervised learning framework to extract effective motion representations from raw…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Xitong Yang , Xiaodong Yang , Sifei Liu , Deqing Sun , Larry Davis , Jan Kautz

Understanding human motion is crucial for accurate pedestrian trajectory prediction. Conventional methods typically rely on supervised learning, where ground-truth labels are directly optimized against predicted trajectories. This amplifies…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yizhou Huang , Yihua Cheng , Kezhi Wang