English
Related papers

Related papers: ContrastMotion: Self-supervised Scene Motion Learn…

200 papers

We present a self-supervised learning approach for the semantic segmentation of lidar frames. Our method is used to train a deep point cloud segmentation architecture without any human annotation. The annotation process is automated with…

Robotics · Computer Science 2020-12-11 Hugues Thomas , Ben Agro , Mona Gridseth , Jian Zhang , Timothy D. Barfoot

Part mobility analysis is a significant aspect required to achieve a functional understanding of 3D objects. It would be natural to obtain part mobility from the continuous part motion of 3D objects. In this study, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-03 Yahao Shi , Xinyu Cao , Bin Zhou

We propose a novel method for learning convolutional neural image representations without manual supervision. We use motion cues in the form of optical flow, to supervise representations of static images. The obvious approach of training a…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Aravindh Mahendran , James Thewlis , Andrea Vedaldi

This paper describes recent developments in object specific pose and shape prediction from single images. The main contribution is a new approach to camera pose prediction by self-supervised learning of keypoints corresponding to locations…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Zahra Gharaee , Felix Järemo Lawin , Per-Erik Forssén

Self-supervised learning (SSL) has the potential to benefit many applications, particularly those where manually annotating data is cumbersome. One such situation is the semantic segmentation of point clouds. In this context, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Yanhao Wu , Tong Zhang , Wei Ke , Sabine Süsstrunk , Mathieu Salzmann

This paper proposes a self-supervised learning approach for video features that results in significantly improved performance on downstream tasks (such as video classification, captioning and segmentation) compared to existing methods. Our…

Machine Learning · Computer Science 2019-10-01 Chen Sun , Fabien Baradel , Kevin Murphy , Cordelia Schmid

We present an end-to-end method for object detection and trajectory prediction utilizing multi-view representations of LiDAR returns and camera images. In this work, we recognize the strengths and weaknesses of different view…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Sudeep Fadadu , Shreyash Pandey , Darshan Hegde , Yi Shi , Fang-Chieh Chou , Nemanja Djuric , Carlos Vallespi-Gonzalez

We present a self-supervised learning framework to estimate the individual object motion and monocular depth from video. We model the object motion as a 6 degree-of-freedom rigid-body transformation. The instance segmentation mask is…

Computer Vision and Pattern Recognition · Computer Science 2020-05-14 Qi Dai , Vaishakh Patil , Simon Hecker , Dengxin Dai , Luc Van Gool , Konrad Schindler

Lidar point cloud distortion from moving object is an important problem in autonomous driving, and recently becomes even more demanding with the emerging of newer lidars, which feature back-and-forth scanning patterns. Accurately estimating…

Robotics · Computer Science 2022-07-05 Wen Yang , Zheng Gong , Baifu Huang , Xiaoping Hong

Autonomous driving stands as a pivotal domain in computer vision, shaping the future of transportation. Within this paradigm, the backbone of the system plays a crucial role in interpreting the complex environment. However, a notable…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Chenbin Pan , Burhaneddin Yaman , Senem Velipasalar , Liu Ren

Accurate 3D object detection in LiDAR point clouds is crucial for autonomous driving systems. To achieve state-of-the-art performance, the supervised training of detectors requires large amounts of human-annotated data, which is expensive…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Christian Fruhwirth-Reisinger , Wei Lin , Dušan Malić , Horst Bischof , Horst Possegger

Beam prediction is critical for reducing beam-training overhead in millimeter-wave (mmWave) systems, especially in high-mobility vehicular scenarios. This paper presents a BEV-Fusion based framework that unifies camera, LiDAR, radar, and…

Signal Processing · Electrical Eng. & Systems 2026-04-08 Jiaming Zeng , Cunhua Pan , Haoyang Weng , Ruijing Liu , Hong Ren , Jiangzhou Wang

3D scene flow estimation aims to estimate point-wise motions between two consecutive frames of point clouds. Superpoints, i.e., points with similar geometric features, are usually employed to capture similar motions of local regions in 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Yaqi Shen , Le Hui , Jin Xie , Jian Yang

In this work, we present LaserFlow, an efficient method for 3D object detection and motion forecasting from LiDAR. Unlike the previous work, our approach utilizes the native range view representation of the LiDAR, which enables our method…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Gregory P. Meyer , Jake Charland , Shreyash Pandey , Ankit Laddha , Shivam Gautam , Carlos Vallespi-Gonzalez , Carl K. Wellington

Object detection through either RGB images or the LiDAR point clouds has been extensively explored in autonomous driving. However, it remains challenging to make these two data sources complementary and beneficial to each other. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Zehui Chen , Zhenyu Li , Shiquan Zhang , Liangji Fang , Qinghong Jiang , Feng Zhao , Bolei Zhou , Hang Zhao

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

3D LiDAR point cloud data is crucial for scene perception in computer vision, robotics, and autonomous driving. Geometric and semantic scene understanding, involving 3D point clouds, is essential for advancing autonomous driving…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Li Li

Self-supervised contrastive learning frameworks have progressed rapidly over the last few years. In this paper, we propose a novel loss function for contrastive learning. We model our pre-training task as a binary classification problem to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Siladittya Manna , Umapada Pal , Saumik Bhattacharya

Integrating LiDAR and camera information into Bird's-Eye-View (BEV) representation has emerged as a crucial aspect of 3D object detection in autonomous driving. However, existing methods are susceptible to the inaccurate calibration…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Ziying Song , Lei Yang , Shaoqing Xu , Lin Liu , Dongyang Xu , Caiyan Jia , Feiyang Jia , Li Wang

Wasserstein autoencoder (WAE) shows that matching two distributions is equivalent to minimizing a simple autoencoder (AE) loss under the constraint that the latent space of this AE matches a pre-specified prior distribution. This latent…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Devansh Arpit , Aadyot Bhatnagar , Huan Wang , Caiming Xiong