English
Related papers

Related papers: Cross-Modal Self-Supervised Learning with Effectiv…

200 papers

Annotating 3D LiDAR point clouds for perception tasks is fundamental for many applications e.g., autonomous driving, yet it still remains notoriously labor-intensive. Pretraining-finetuning approach can alleviate the labeling burden by…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Xiangchao Yan , Runjian Chen , Bo Zhang , Hancheng Ye , Renqiu Xia , Jiakang Yuan , Hongbin Zhou , Xinyu Cai , Botian Shi , Wenqi Shao , Ping Luo , Yu Qiao , Tao Chen , Junchi Yan

In this paper, we study the problem of unsupervised object detection from 3D point clouds in self-driving scenes. We present a simple yet effective method that exploits (i) point clustering in near-range areas where the point clouds are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Lunjun Zhang , Anqi Joyce Yang , Yuwen Xiong , Sergio Casas , Bin Yang , Mengye Ren , Raquel Urtasun

Perception is crucial in the realm of autonomous driving systems, where bird's eye view (BEV)-based architectures have recently reached state-of-the-art performance. The desirability of self-supervised representation learning stems from the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Jiachen Sun , Haizhong Zheng , Qingzhao Zhang , Atul Prakash , Z. Morley Mao , Chaowei Xiao

The combination of LiDAR and camera modalities is proven to be necessary and typical for 3D object detection according to recent studies. Existing fusion strategies tend to overly rely on the LiDAR modal in essence, which exploits the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Yang Yang , Weijie Ma , Hao Chen , Linlin Ou , Xinyi Yu

Point cloud data plays an essential role in robotics and self-driving applications. Yet, annotating point cloud data is time-consuming and nontrivial while they enable learning discriminative 3D representations that empower downstream…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Srikanth Malla , Yi-Ting Chen

Recent LiDAR-based 3D Object Detection (3DOD) methods show promising results, but they often do not generalize well to target domains outside the source (or training) data distribution. To reduce such domain gaps and thus to make 3DOD…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Gyusam Chang , Wonseok Roh , Sujin Jang , Dongwook Lee , Daehyun Ji , Gyeongrok Oh , Jinsun Park , Jinkyu Kim , Sangpil Kim

Addressing performance degradation in 3D LiDAR semantic segmentation due to domain shifts (e.g., sensor type, geographical location) is crucial for autonomous systems, yet manual annotation of target data is prohibitive. This study…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Abhishek Kaushik , Norbert Haala , Uwe Soergel

Reducing the quantity of annotations required for supervised training is vital when labels are scarce and costly. This reduction is especially important for semantic segmentation tasks involving 3D datasets that are often significantly…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Andrej Janda , Brandon Wagstaff , Edwin G. Ng , Jonathan Kelly

Multimodal learning aims to imitate human beings to acquire complementary information from multiple modalities for various downstream tasks. However, traditional aggregation-based multimodal fusion methods ignore the inter-modality…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Heqing Zou , Meng Shen , Chen Chen , Yuchen Hu , Deepu Rajan , Eng Siong Chng

LiDAR-based 3D object detection is an indispensable task in advanced autonomous driving systems. Though impressive detection results have been achieved by superior 3D detectors, they suffer from significant performance degeneration when…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Yan Wang , Junbo Yin , Wei Li , Pascal Frossard , Ruigang Yang , Jianbing Shen

In this paper, we propose a simple and general framework for self-supervised point cloud representation learning. Human beings understand the 3D world by extracting two levels of information and establishing the relationship between them.…

Computer Vision and Pattern Recognition · Computer Science 2022-02-10 Kexue Fu , Peng Gao , Renrui Zhang , Hongsheng Li , Yu Qiao , Manning Wang

3D object detection plays a fundamental role in enabling autonomous driving, which is regarded as the significant key to unlocking the bottleneck of contemporary transportation systems from the perspectives of safety, mobility, and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Zhengwei Bai , Guoyuan Wu , Matthew J. Barth , Yongkang Liu , Emrah Akin Sisbot , Kentaro Oguchi

We study the problem of efficient object detection of 3D LiDAR point clouds. To reduce the memory and computational cost, existing point-based pipelines usually adopt task-agnostic random sampling or farthest point sampling to progressively…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Yifan Zhang , Qingyong Hu , Guoquan Xu , Yanxin Ma , Jianwei Wan , Yulan Guo

It is laborious to manually label point cloud data for training high-quality 3D object detectors. This work proposes a weakly supervised approach for 3D object detection, only requiring a small set of weakly annotated scenes, associated…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Qinghao Meng , Wenguan Wang , Tianfei Zhou , Jianbing Shen , Luc Van Gool , Dengxin Dai

Recent advances in multi-modal pre-training methods have shown promising effectiveness in learning 3D representations by aligning multi-modal features between 3D shapes and their corresponding 2D counterparts. However, existing multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Liwen Liu , Weidong Yang , Lipeng Ma , Ben Fei

Multi-modal fusion has emerged as a promising paradigm for accurate 3D object detection. However, performance degrades substantially when deployed in target domains different from training. In this work, focusing on dual-branch…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Yuchen Wu , Kun Wang , Yining Pan , Na Zhao

Arguably one of the top success stories of deep learning is transfer learning. The finding that pre-training a network on a rich source set (eg., ImageNet) can help boost performance once fine-tuned on a usually much smaller target set, has…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Saining Xie , Jiatao Gu , Demi Guo , Charles R. Qi , Leonidas J. Guibas , Or Litany

To achieve reliable and precise scene understanding, autonomous vehicles typically incorporate multiple sensing modalities to capitalize on their complementary attributes. However, existing cross-modal 3D detectors do not fully utilize the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Yifan Zhang , Qijian Zhang , Junhui Hou , Yixuan Yuan , Guoliang Xing

Detecting lane markings in road scenes poses a challenge due to their intricate nature, which is susceptible to unfavorable conditions. While lane markings have strong shape priors, their visibility is easily compromised by lighting…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Ali Zoljodi , Sadegh Abadijou , Mina Alibeigi , Masoud Daneshtalab

Monocular image-based 3D perception has become an active research area in recent years owing to its applications in autonomous driving. Approaches to monocular 3D perception including detection and tracking, however, often yield inferior…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Longlong Jing , Ruichi Yu , Henrik Kretzschmar , Kang Li , Charles R. Qi , Hang Zhao , Alper Ayvaci , Xu Chen , Dillon Cower , Yingwei Li , Yurong You , Han Deng , Congcong Li , Dragomir Anguelov