English
Related papers

Related papers: Cross-Modal Self-Supervised Learning with Effectiv…

200 papers

The 3D contrastive learning paradigm has demonstrated remarkable performance in downstream tasks through pretraining on point cloud data. Recent advances involve additional 2D image priors associated with 3D point clouds for further…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Jiahua Dong , Tong Wu , Rui Qian , Jiaqi Wang

Autonomous driving can benefit from motion behavior comprehension when interacting with diverse traffic participants in highly dynamic environments. Recently, there has been a growing interest in estimating class-agnostic motion directly…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Chenxu Luo , Xiaodong Yang , Alan Yuille

Recent advancements in vision-language pre-training (e.g. CLIP) have shown that vision models can benefit from language supervision. While many models using language modality have achieved great success on 2D vision tasks, the joint…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Rui Huang , Xuran Pan , Henry Zheng , Haojun Jiang , Zhifeng Xie , Shiji Song , Gao Huang

LiDAR point cloud semantic segmentation is essential for interpreting 3D environments in applications such as autonomous driving and robotics. Recent methods achieve strong performance by exploiting different point cloud representations or…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Simone Mosco , Daniel Fusaro , Wanmeng Li , Emanuele Menegatti , Alberto Pretto

3D point cloud semantic segmentation (PCSS) is a cornerstone for environmental perception in robotic systems and autonomous driving, enabling precise scene understanding through point-wise classification. While unsupervised domain…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Junjie Chen , Yuecong Xu , Haosheng Li , Kemi Ding

The perception of motion behavior in a dynamic environment holds significant importance for autonomous driving systems, wherein class-agnostic motion prediction methods directly predict the motion of the entire point cloud. While most…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Kewei Wang , Yizheng Wu , Jun Cen , Zhiyu Pan , Xingyi Li , Zhe Wang , Zhiguo Cao , Guosheng Lin

Learning local descriptors is an important problem in computer vision. While there are many techniques for learning local patch descriptors for 2D images, recently efforts have been made for learning local descriptors for 3D points. The…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Siddharth Srivastava , Brejesh Lall

Training image-based object detectors presents formidable challenges, as it entails not only the complexities of object detection but also the added intricacies of precisely localizing objects within potentially diverse and noisy…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Chandan Kumar , Jansel Herrera-Gerena , John Just , Matthew Darr , Ali Jannesari

3D LiDAR scanners are playing an increasingly important role in autonomous driving as they can generate depth information of the environment. However, creating large 3D LiDAR point cloud datasets with point-level labels requires a…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Xiangyu Yue , Bichen Wu , Sanjit A. Seshia , Kurt Keutzer , Alberto L. Sangiovanni-Vincentelli

Depth perception is considered an invaluable source of information in the context of 3D mapping and various robotics applications. However, point cloud maps acquired using consumer-level light detection and ranging sensors (lidars) still…

Robotics · Computer Science 2024-05-24 Ruslan Agishev , Tomáš Pětříček , Karel Zimmermann

The scale and quality of point cloud datasets constrain the advancement of point cloud learning. Recently, with the development of multi-modal learning, the incorporation of domain-agnostic prior knowledge from other modalities, such as…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Yanmin Wu , Qiankun Gao , Renrui Zhang , Jian Zhang

Point cloud segmentation is fundamental in understanding 3D environments. However, current 3D point cloud segmentation methods usually perform poorly on scene boundaries, which degenerates the overall segmentation performance. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Liyao Tang , Yibing Zhan , Zhe Chen , Baosheng Yu , Dacheng Tao

Lidar-based sensing drives current autonomous vehicles. Despite rapid progress, current Lidar sensors still lag two decades behind traditional color cameras in terms of resolution and cost. For autonomous driving, this means that large…

Computer Vision and Pattern Recognition · Computer Science 2021-11-15 Tianwei Yin , Xingyi Zhou , Philipp Krähenbühl

Recent advancements in camera-based 3D object detection have introduced cross-modal knowledge distillation to bridge the performance gap with LiDAR 3D detectors, leveraging the precise geometric information in LiDAR point clouds. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Sanmin Kim , Youngseok Kim , Sihwan Hwang , Hyeonjun Jeong , Dongsuk Kum

This paper addresses the challenges in representation learning of 3D shape features by investigating state-of-the-art backbones paired with both contrastive supervised and self-supervised learning objectives. Computer vision methods…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Márcus Vinícius Lobo Costa , Sherlon Almeida da Silva , Bárbara Caroline Benato , Leo Sampaio Ferraz Ribeiro , Moacir Antonelli Ponti

Current state-of-the-art point cloud-based perception methods usually rely on large-scale labeled data, which requires expensive manual annotations. A natural option is to explore the unsupervised methodology for 3D perception tasks.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Jingyu Zhang , Huitong Yang , Dai-Jie Wu , Jacky Keung , Xuesong Li , Xinge Zhu , Yuexin Ma

As a promising scheme of self-supervised learning, masked autoencoding has significantly advanced natural language processing and computer vision. Inspired by this, we propose a neat scheme of masked autoencoders for point cloud…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yatian Pang , Wenxiao Wang , Francis E. H. Tay , Wei Liu , Yonghong Tian , Li Yuan

Our study assesses the adversarial robustness of LiDAR-camera fusion models in 3D object detection. We introduce an attack technique that, by simply adding a limited number of physically constrained adversarial points above a car, can make…

Robotics · Computer Science 2024-01-10 Bo Yang , Xiaoyu Ji , Zizhi Jin , Yushi Cheng , Wenyuan Xu

Contrastive Language-Image Pre-training (CLIP) has shown impressive performance in aligning visual and textual representations. Recent studies have extended this paradigm to 3D vision to improve scene understanding for autonomous driving. A…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Ximeng Tao , Dimitar Filev , Gaurav Pandey

Pre-training is crucial in 3D-related fields such as autonomous driving where point cloud annotation is costly and challenging. Many recent studies on point cloud pre-training, however, have overlooked the issue of incompleteness, where…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Hao Yang , Haiyang Wang , Di Dai , Liwei Wang