English
Related papers

Related papers: Cross-Modal Self-Supervised Learning with Effectiv…

200 papers

Large-scale vision 2D vision language models, such as CLIP can be aligned with a 3D encoder to learn generalizable (open-vocabulary) 3D vision models. However, current methods require supervised pre-training for such alignment, and the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Amaya Dharmasiri , Muzammal Naseer , Salman Khan , Fahad Shahbaz Khan

We present a new self-supervised paradigm on point cloud sequence understanding. Inspired by the discriminative and generative self-supervised methods, we design two tasks, namely point cloud sequence based Contrastive Prediction and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Xiaoxiao Sheng , Zhiqiang Shen , Gang Xiao

Despite recent success of self-supervised based contrastive learning model for 3D point clouds representation, the adversarial robustness of such pre-trained models raised concerns. Adversarial contrastive learning (ACL) is considered an…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Junxuan Huang , Yatong An , Lu cheng , Bai Chen , Junsong Yuan , Chunming Qiao

The rapid progress in 3D scene understanding has come with growing demand for data; however, collecting and annotating 3D scenes (e.g. point clouds) are notoriously hard. For example, the number of scenes (e.g. indoor rooms) that can be…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Ji Hou , Benjamin Graham , Matthias Nießner , Saining Xie

Three-dimensional (3D) object recognition is crucial for intelligent autonomous agents such as autonomous vehicles and robots alike to operate effectively in unstructured environments. Most state-of-art approaches rely on relatively dense…

Robotics · Computer Science 2022-05-10 Prajval Kumar Murali , Cong Wang , Ravinder Dahiya , Mohsen Kaboli

As camera and LiDAR sensors capture complementary information used in autonomous driving, great efforts have been made to develop semantic segmentation algorithms through multi-modality data fusion. However, fusion-based approaches require…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Xu Yan , Jiantao Gao , Chaoda Zheng , Chao Zheng , Ruimao Zhang , Shenghui Cui , Zhen Li

Point cloud data has been extensively studied due to its compact form and flexibility in representing complex 3D structures. The ability of point cloud data to accurately capture and represent intricate 3D geometry makes it an ideal choice…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Ben Fei , Weidong Yang , Liwen Liu , Tianyue Luo , Rui Zhang , Yixuan Li , Ying He

Most of the existing self-supervised feature learning methods for 3D data either learn 3D features from point cloud data or from multi-view images. By exploring the inherent multi-modality attributes of 3D objects, in this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2020-05-29 Longlong Jing , Yucheng Chen , Ling Zhang , Mingyi He , Yingli Tian

Masked autoencoding has achieved great success for self-supervised learning in the image and language domains. However, mask based pretraining has yet to show benefits for point cloud understanding, likely due to standard backbones like…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Haotian Liu , Mu Cai , Yong Jae Lee

There has been significant progress made in the field of autonomous vehicles. Object detection and tracking are the primary tasks for any autonomous vehicle. The task of object detection in autonomous vehicles relies on a variety of sensors…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Gaurav Raut , Advait Patole

Contrastive Language-Image Pre-training, benefiting from large-scale unlabeled text-image pairs, has demonstrated great performance in open-world vision understanding tasks. However, due to the limited Text-3D data pairs, adapting the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yihan Zeng , Chenhan Jiang , Jiageng Mao , Jianhua Han , Chaoqiang Ye , Qingqiu Huang , Dit-Yan Yeung , Zhen Yang , Xiaodan Liang , Hang Xu

LiDAR point clouds are widely used in autonomous driving and consist of large numbers of 3D points captured at high frequency to represent surrounding objects such as vehicles, pedestrians, and traffic signs. While this dense data enables…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Z. Rozsa , Á. Madaras , Q. Wei , X. Lu , M. Golarits , H. Yuan , T. Sziranyi , R. Hamzaoui

Point clouds provide a compact and efficient representation of 3D shapes. While deep neural networks have achieved impressive results on point cloud learning tasks, they require massive amounts of manually labeled data, which can be costly…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Omid Poursaeed , Tianxing Jiang , Han Qiao , Nayun Xu , Vladimir G. Kim

Self-supervised representation learning has shown significant improvement in Natural Language Processing and 2D Computer Vision. However, existing methods face difficulties in representing 3D data because of its unordered and uneven…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Pengbo Li , Yiding Sun , Haozhe Cheng

3D point clouds are a crucial type of data collected by LiDAR sensors and widely used in transportation applications due to its concise descriptions and accurate localization. Deep neural networks (DNNs) have achieved remarkable success in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Changyu Zeng , Wei Wang , Anh Nguyen , Yutao Yue

Moving object segmentation is a crucial task for safe and reliable autonomous mobile systems like self-driving cars, improving the reliability and robustness of subsequent tasks like SLAM or path planning. While the segmentation of camera…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Leon Schwarzer , Matthias Zeller , Daniel Casado Herraez , Simon Dierl , Michael Heidingsfeld , Cyrill Stachniss

Recent developments and the beginning market introduction of high-resolution imaging 4D (3+1D) radar sensors have initialized deep learning-based radar perception research. We investigate deep learning-based models operating on radar point…

Robotics · Computer Science 2023-08-11 Patrick Palmer , Martin Krueger , Richard Altendorfer , Ganesh Adam , Torsten Bertram

Recently Transformer-based models have advanced point cloud understanding by leveraging self-attention mechanisms, however, these methods often overlook latent information in less prominent regions, leading to increased sensitivity to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Yi Wang , Jiaze Wang , Ziyu Guo , Renrui Zhang , Donghao Zhou , Guangyong Chen , Anfeng Liu , Pheng-Ann Heng

In recent years, much progress has been made in LiDAR-based 3D object detection mainly due to advances in detector architecture designs and availability of large-scale LiDAR datasets. Existing 3D object detectors tend to perform well on the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Eduardo R. Corral-Soto , Alaap Grandhi , Yannis Y. He , Mrigank Rochan , Bingbing Liu

Three dimensional (3D) object recognition is becoming a key desired capability for many computer vision systems such as autonomous vehicles, service robots and surveillance drones to operate more effectively in unstructured environments.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Chenxi Xiao , Juan Wachs