English
Related papers

Related papers: Spatio-temporal Self-Supervised Representation Lea…

200 papers

Self-supervised tasks such as colorization, inpainting and zigsaw puzzle have been utilized for visual representation learning for still images, when the number of labeled images is limited or absent at all. Recently, this worthwhile stream…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Dahun Kim , Donghyeon Cho , In So Kweon

Zero-shot learning on 3D point cloud data is a related underexplored problem compared to its 2D image counterpart. 3D data brings new challenges for ZSL due to the unavailability of robust pre-trained feature extraction models. To address…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Majid Nasiri , Ali Cheraghian , Townim Faisal Chowdhury , Sahar Ahmadi , Morteza Saberi , Shafin Rahman

Real-time 3D object detection from point clouds is essential for dynamic scene understanding in applications such as augmented reality, robotics and navigation. We introduce a novel Spatial-prioritized and Rank-aware 3D object detection…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Chenyu Zhao , Xianwei Zheng , Zimin Xia , Linwei Yue , Nan Xue

Self-supervised learning on point clouds has gained a lot of attention recently, since it addresses the label-efficiency and domain-gap problems on point cloud tasks. In this paper, we propose a novel self-supervised framework to learn…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Meng-Shiun Tsai , Pei-Ze Chiang , Yi-Hsuan Tsai , Wei-Chen Chiu

The field of self-supervised 3D representation learning has emerged as a promising solution to alleviate the challenge presented by the scarcity of extensive, well-annotated datasets. However, it continues to be hindered by the lack of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yunsong Wang , Na Zhao , Gim Hee Lee

Reducing the quantity of annotations required for supervised training is vital when labels are scarce and costly. This reduction is particularly important for semantic segmentation tasks involving 3D datasets, which are often significantly…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Andrej Janda , Brandon Wagstaff , Edwin G. Ng , Jonathan Kelly

The rapid progress in 3D scene understanding has come with growing demand for data; however, collecting and annotating 3D scenes (e.g. point clouds) are notoriously hard. For example, the number of scenes (e.g. indoor rooms) that can be…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Ji Hou , Benjamin Graham , Matthias Nießner , Saining Xie

The recent success of implicit neural scene representations has presented a viable new method for how we capture and store 3D scenes. Unlike conventional 3D representations, such as point clouds, which explicitly store scene properties in…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Amit Kohli , Vincent Sitzmann , Gordon Wetzstein

Recent advances in self-supervised learning (SSL) for point clouds have substantially improved 3D scene understanding without human annotations. Existing approaches emphasize semantic awareness by enforcing feature consistency across…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Bin Yang , Mohamed Abdelsamad , Miao Zhang , Alexandru Paul Condurache

In this article, we investigate self-supervised 3D scene flow estimation and class-agnostic motion prediction on point clouds. A realistic scene can be well modeled as a collection of rigidly moving parts, therefore its scene flow can be…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Ruibo Li , Chi Zhang , Zhe Wang , Chunhua Shen , Guosheng Lin

We present a self-supervised Contrastive Video Representation Learning (CVRL) method to learn spatiotemporal visual representations from unlabeled videos. Our representations are learned using a contrastive loss, where two augmented clips…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Rui Qian , Tianjian Meng , Boqing Gong , Ming-Hsuan Yang , Huisheng Wang , Serge Belongie , Yin Cui

Unsupervised representation learning has significantly advanced various machine learning tasks. In the computer vision domain, state-of-the-art approaches utilize transformations like random crop and color jitter to achieve invariant…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Jaemyung Yu , Jaehyun Choi , Dong-Jae Lee , HyeongGwon Hong , Junmo Kim

In this paper, we demonstrate an end-to-end spatiotemporal gesture learning approach for 3D point cloud data using a new gestures dataset of point clouds acquired from a 3D sensor. Nine classes of gestures were learned from gestures sample…

Computer Vision and Pattern Recognition · Computer Science 2018-04-25 Joshua Owoyemi , Koichi Hashimoto

Point cloud processing and 3D shape understanding are very challenging tasks for which deep learning techniques have demonstrated great potentials. Still further progresses are essential to allow artificial intelligent agents to interact…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Antonio Alliegro , Davide Boscaini , Tatiana Tommasi

Unsupervised learning on 3D point clouds has undergone a rapid evolution, especially thanks to data augmentation-based contrastive methods. However, data augmentation is not ideal as it requires a careful selection of the type of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Guofeng Mei , Cristiano Saltori , Fabio Poiesi , Jian Zhang , Elisa Ricci , Nicu Sebe , Qiang Wu

We present a new approach to instill 4D dynamic object priors into learned 3D representations by unsupervised pre-training. We observe that dynamic movement of an object through an environment provides important cues about its objectness,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Yujin Chen , Matthias Nießner , Angela Dai

Human skeleton point clouds are commonly used to automatically classify and predict the behaviour of others. In this paper, we use a contrastive self-supervised learning method, SimCLR, to learn representations that capture the semantics of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Nico Lingg , Miguel Sarabia , Luca Zappella , Barry-John Theobald

We propose a unified point cloud video self-supervised learning framework for object-centric and scene-centric data. Previous methods commonly conduct representation learning at the clip or frame level and cannot well capture fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Xiaoxiao Sheng , Zhiqiang Shen , Gang Xiao , Longguang Wang , Yulan Guo , Hehe Fan

Annotating 3D LiDAR point clouds for perception tasks is fundamental for many applications e.g., autonomous driving, yet it still remains notoriously labor-intensive. Pretraining-finetuning approach can alleviate the labeling burden by…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Xiangchao Yan , Runjian Chen , Bo Zhang , Hancheng Ye , Renqiu Xia , Jiakang Yuan , Hongbin Zhou , Xinyu Cai , Botian Shi , Wenqi Shao , Ping Luo , Yu Qiao , Tao Chen , Junchi Yan

Self-supervised learning (SSL) on 3D point clouds has the potential to learn feature representations that can transfer to diverse sensors and multiple downstream perception tasks. However, recent SSL approaches fail to define pretext tasks…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Barza Nisar , Steven L. Waslander