English
Related papers

Related papers: ContrastMotion: Self-supervised Scene Motion Learn…

200 papers

We present a new approach to instill 4D dynamic object priors into learned 3D representations by unsupervised pre-training. We observe that dynamic movement of an object through an environment provides important cues about its objectness,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Yujin Chen , Matthias Nießner , Angela Dai

This paper presents a fully unsupervised deep change detection approach for mobile robots with 3D LiDAR. In unstructured environments, it is infeasible to define a closed set of semantic classes. Instead, semantic segmentation is…

Robotics · Computer Science 2024-05-01 Alexander Krawciw , Jordy Sehn , Timothy D. Barfoot

LiDAR scene flow is the task of estimating per-point 3D motion between consecutive point clouds. Recent methods achieve centimeter-level accuracy on popular autonomous vehicle (AV) datasets, but are typically only trained and evaluated on a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Siyi Li , Qingwen Zhang , Ishan Khatri , Kyle Vedder , Eric Eaton , Deva Ramanan , Neehar Peri

Though a number of point cloud learning methods have been proposed to handle unordered points, most of them are supervised and require labels for training. By contrast, unsupervised learning of point cloud data has received much less…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Jincen Jiang , Xuequan Lu , Wanli Ouyang , Meili Wang

Scene flow is the task of estimating 3D motion vectors to individual points of a dynamic 3D scene. Motion vectors have shown to be beneficial for downstream tasks such as action classification and collision avoidance. However, data…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Victor Zuanazzi

Image and Point Clouds provide different information for robots. Finding the correspondences between data from different sensors is crucial for various tasks such as localization, mapping, and navigation. Learning-based descriptors have…

Computer Vision and Pattern Recognition · Computer Science 2022-06-27 Peng Jiang , Srikanth Saripalli

Existing approaches for unsupervised point cloud pre-training are constrained to either scene-level or point/voxel-level instance discrimination. Scene-level methods tend to lose local details that are crucial for recognizing the road…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Junbo Yin , Dingfu Zhou , Liangjun Zhang , Jin Fang , Cheng-Zhong Xu , Jianbing Shen , Wenguan Wang

In this paper we introduce a novel way to predict semantic information from sparse, single-shot LiDAR measurements in the context of autonomous driving. In particular, we fuse learned features from complementary representations. The…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Frank Bieder , Maximilian Link , Simon Romanski , Haohao Hu , Christoph Stiller

LiDAR point clouds collected from a moving vehicle are functions of its trajectories, because the sensor motion needs to be compensated to avoid distortions. When autonomous vehicles are sending LiDAR point clouds to deep networks for…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Yiming Li , Congcong Wen , Felix Juefei-Xu , Chen Feng

Predicting the future can significantly improve the safety of intelligent vehicles, which is a key component in autonomous driving. 3D point clouds accurately model 3D information of surrounding environment and are crucial for intelligent…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Fan Lu , Guang Chen , Yinlong Liu , Zhijun Li , Sanqing Qu , Tianpei Zou

Determining accurate bird's eye view (BEV) positions of objects and tracks in a scene is vital for various perception tasks including object interactions mapping, scenario extraction etc., however, the level of supervision required to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Paridhi Singh , Gaurav Singh , Arun Kumar

LiDAR sensors are widely used in autonomous driving due to the reliable 3D spatial information. However, the data of LiDAR is sparse and the frequency of LiDAR is lower than that of cameras. To generate denser point clouds spatially and…

Computer Vision and Pattern Recognition · Computer Science 2021-12-09 Xudong Huang , Chunyu Lin , Haojie Liu , Lang Nie , Yao Zhao

Human skeleton point clouds are commonly used to automatically classify and predict the behaviour of others. In this paper, we use a contrastive self-supervised learning method, SimCLR, to learn representations that capture the semantics of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Nico Lingg , Miguel Sarabia , Luca Zappella , Barry-John Theobald

Due to the scarcity of annotated scene flow data, self-supervised scene flow learning in point clouds has attracted increasing attention. In the self-supervised manner, establishing correspondences between two point clouds to approximate…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Ruibo Li , Guosheng Lin , Lihua Xie

Autonomous vehicles operate in highly dynamic environments necessitating an accurate assessment of which aspects of a scene are moving and where they are moving to. A popular approach to 3D motion estimation, termed scene flow, is to employ…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Philipp Jund , Chris Sweeney , Nichola Abdo , Zhifeng Chen , Jonathon Shlens

3D scene flow characterizes how the points at the current time flow to the next time in the 3D Euclidean space, which possesses the capacity to infer autonomously the non-rigid motion of all objects in the scene. The previous methods for…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Chaokang Jiang , Guangming Wang , Yanzi Miao , Hesheng Wang

LiDAR representation learning has emerged as a promising approach to reducing reliance on costly and labor-intensive human annotations. While existing methods primarily focus on spatial alignment between LiDAR and camera sensors, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Xiang Xu , Lingdong Kong , Hui Shuai , Wenwei Zhang , Liang Pan , Kai Chen , Ziwei Liu , Qingshan Liu

Bird's-Eye View (BEV) features are popular intermediate scene representations shared by the 3D backbone and the detector head in LiDAR-based object detectors. However, little research has been done to investigate how to incorporate…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Haitao Yang , Zaiwei Zhang , Xiangru Huang , Min Bai , Chen Song , Bo Sun , Li Erran Li , Qixing Huang

The ability to detect and segment moving objects in a scene is essential for building consistent maps, making future state predictions, avoiding collisions, and planning. In this paper, we address the problem of moving object segmentation…

Accurate perception and scene understanding in complex urban environments is a critical challenge for ensuring safe and efficient autonomous navigation. In this paper, we present Co-Win, a novel bird's eye view (BEV) perception framework…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Haichuan Li , Tomi Westerlund