English
Related papers

Related papers: Self-supervised Feature Learning by Cross-modality…

200 papers

Large-scale vision 2D vision language models, such as CLIP can be aligned with a 3D encoder to learn generalizable (open-vocabulary) 3D vision models. However, current methods require supervised pre-training for such alignment, and the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Amaya Dharmasiri , Muzammal Naseer , Salman Khan , Fahad Shahbaz Khan

3D perception in LiDAR point clouds is crucial for a self-driving vehicle to properly act in 3D environment. However, manually labeling point clouds is hard and costly. There has been a growing interest in self-supervised pre-training of 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Mu Cai , Chenxu Luo , Yong Jae Lee , Xiaodong Yang

Manually annotating complex scene point cloud datasets is both costly and error-prone. To reduce the reliance on labeled data, a new model called SnapshotNet is proposed as a self-supervised feature learning approach, which directly works…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Xingye Li , Ling Zhang , Zhigang Zhu

When classifying point clouds, a large amount of time is devoted to the process of engineering a reliable set of features which are then passed to a classifier of choice. Generally, such features - usually derived from the 3D-covariance…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Mohammed Yousefhussien , David J. Kelbe , Emmett J. Ientilucci , Carl Salvaggio

Reducing the quantity of annotations required for supervised training is vital when labels are scarce and costly. This reduction is especially important for semantic segmentation tasks involving 3D datasets that are often significantly…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Andrej Janda , Brandon Wagstaff , Edwin G. Ng , Jonathan Kelly

Learning to generate 3D point clouds without 3D supervision is an important but challenging problem. Current solutions leverage various differentiable renderers to project the generated 3D point clouds onto a 2D image plane, and train deep…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Chen Chao , Zhizhong Han , Yu-Shen Liu , Matthias Zwicker

Combining the respective advantages of cross-modality images can compensate for the lack of information in the single modality, which has attracted increasing attention of researchers into multi-modal image matching tasks. Meanwhile, due to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shasha Mei

Self-supervised learning methods have witnessed a recent surge of interest after proving successful in multiple application fields. In this work, we leverage these techniques, and we propose 3D versions for five different self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Aiham Taleb , Winfried Loetzsch , Noel Danz , Julius Severin , Thomas Gaertner , Benjamin Bergner , Christoph Lippert

Self-supervised learning on point clouds has gained a lot of attention recently, since it addresses the label-efficiency and domain-gap problems on point cloud tasks. In this paper, we propose a novel self-supervised framework to learn…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Meng-Shiun Tsai , Pei-Ze Chiang , Yi-Hsuan Tsai , Wei-Chen Chiu

Recently, self-supervised learning has attracted attention due to its remarkable ability to acquire meaningful representations for classification tasks without using semantic labels. This paper introduces a self-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Hyungtae Lee , Heesung Kwon

This paper presents a self-supervised feature learning method for hyperspectral image classification. Our method tries to construct two different views of the raw hyperspectral image through a cross-representation learning method. And then…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Anyu Zhang , Haotian Wu , Zeyu Cao

In recent years, semi-supervised learning has been widely explored and shows excellent data efficiency for 2D data. There is an emerging need to improve data efficiency for 3D tasks due to the scarcity of labeled 3D data. This paper…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zhimin Chen , Longlong Jing , Yang Liang , YingLi Tian , Bing Li

How do humans learn to acquire a powerful, flexible and robust representation of objects? While much of this process remains unknown, it is clear that humans do not require millions of object labels. Excitingly, recent algorithmic…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Robert Geirhos , Kantharaju Narayanappa , Benjamin Mitzkus , Matthias Bethge , Felix A. Wichmann , Wieland Brendel

End-to-end training from scratch of current deep architectures for new computer vision problems would require Imagenet-scale datasets, and this is not always possible. In this paper we present a method that is able to take advantage of…

Computer Vision and Pattern Recognition · Computer Science 2017-05-25 Lluis Gomez , Yash Patel , Marçal Rusiñol , Dimosthenis Karatzas , C. V. Jawahar

We introduce an unsupervised multi-task model to jointly learn point and shape features on point clouds. We define three unsupervised tasks including clustering, reconstruction, and self-supervised classification to train a multi-scale…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Kaveh Hassani , Mike Haley

Point cloud data has been extensively studied due to its compact form and flexibility in representing complex 3D structures. The ability of point cloud data to accurately capture and represent intricate 3D geometry makes it an ideal choice…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Ben Fei , Weidong Yang , Liwen Liu , Tianyue Luo , Rui Zhang , Yixuan Li , Ying He

We witnessed a massive growth in the supervised learning paradigm in the past decade. Supervised learning requires a large amount of labeled data to reach state-of-the-art performance. However, labeling the samples requires a lot of human…

Computer Vision and Pattern Recognition · Computer Science 2021-11-04 Mrinal Anand , Aditya Garg

This work proposes a self-supervised learning system for segmenting rigid objects in RGB images. The proposed pipeline is trained on unlabeled RGB-D videos of static objects, which can be captured with a camera carried by a mobile robot. A…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Shiyang Lu , Yunfu Deng , Abdeslam Boularias , Kostas Bekris

Self-supervised tasks have been utilized to build useful representations that can be used in downstream tasks when the annotation is unavailable. In this paper, we introduce a self-supervised video representation learning method based on…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Duc Quang Vu , Ngan T. H. Le , Jia-Ching Wang

With the recent growth of urban mapping and autonomous driving efforts, there has been an explosion of raw 3D data collected from terrestrial platforms with lidar scanners and color cameras. However, due to high labeling costs, ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Kyle Genova , Xiaoqi Yin , Abhijit Kundu , Caroline Pantofaru , Forrester Cole , Avneesh Sud , Brian Brewington , Brian Shucker , Thomas Funkhouser