English
Related papers

Related papers: Spatio-temporal Self-Supervised Representation Lea…

200 papers

Large and rich data is a prerequisite for effective training of deep neural networks. However, the irregularity of point cloud data makes manual annotation time-consuming and laborious. Self-supervised representation learning, which…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Xin Cao , Xinxin Han , Yifan Wang , Mengna Yang , Kang Li

Self-supervised learning (SSL) for point cloud pre-training has become a cornerstone for many 3D vision tasks, enabling effective learning from large-scale unannotated data. At the scene level, existing SSL methods often incorporate volume…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Keyi Liu , Weidong Yang , Ben Fei , Ying He

Anomaly identification is highly dependent on the relationship between the object and the scene, as different/same object actions in same/different scenes may lead to various degrees of normality and anomaly. Therefore, object-scene…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Hui Lv , Zhen Cui , Biao Wang , Jian Yang

Self-supervised learning (SSL) is a technique for learning useful representations from unlabeled data. It has been applied effectively to domain adaptation (DA) on images and videos. It is still unknown if and how it can be leveraged for…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Idan Achituve , Haggai Maron , Gal Chechik

Existing approaches for unsupervised point cloud pre-training are constrained to either scene-level or point/voxel-level instance discrimination. Scene-level methods tend to lose local details that are crucial for recognizing the road…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Junbo Yin , Dingfu Zhou , Liangjun Zhang , Jin Fang , Cheng-Zhong Xu , Jianbing Shen , Wenguan Wang

The success of supervised learning requires large-scale ground truth labels which are very expensive, time-consuming, or may need special skills to annotate. To address this issue, many self- or un-supervised methods are developed. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Longlong Jing , Yucheng Chen , Ling Zhang , Mingyi He , Yingli Tian

Promising performance has been achieved for visual perception on the point cloud. However, the current methods typically rely on labour-extensive annotations on the scene scans. In this paper, we explore how synthetic models alleviate the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Runnan Chen , Xinge Zhu , Nenglun Chen , Dawei Wang , Wei Li , Yuexin Ma , Ruigang Yang , Wenping Wang

Spatio-temporal predictive learning is a learning paradigm that enables models to learn spatial and temporal patterns by predicting future frames from given past frames in an unsupervised manner. Despite remarkable progress in recent years,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Cheng Tan , Siyuan Li , Zhangyang Gao , Wenfei Guan , Zedong Wang , Zicheng Liu , Lirong Wu , Stan Z. Li

We address the problem of unsupervised semantic segmentation of outdoor LiDAR point clouds in diverse traffic scenarios. The key idea is to leverage the spatiotemporal nature of a dynamic point cloud sequence and introduce drastically…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Xiao Li , Pan He , Aotian Wu , Sanjay Ranka , Anand Rangarajan

In the field of 3D scene understanding, 3D scene graphs have emerged as a new scene representation that combines geometric and semantic information about objects and their relationships. However, learning semantic 3D scene graphs in a fully…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Sebastian Koch , Pedro Hermosilla , Narunas Vaskevicius , Mirco Colosi , Timo Ropinski

Exploiting past 3D LiDAR scans to predict future point clouds is a promising method for autonomous mobile systems to realize foresighted state estimation, collision avoidance, and planning. In this paper, we address the problem of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Benedikt Mersch , Xieyuanli Chen , Jens Behley , Cyrill Stachniss

Self-supervised learning of point cloud aims to leverage unlabeled 3D data to learn meaningful representations without reliance on manual annotations. However, current approaches face challenges such as limited data diversity and inadequate…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Keyi Liu , Yeqi Luo , Weidong Yang , Jingyi Xu , Zhijun Li , Wen-Ming Chen , Ben Fei

Trajectory Representation Learning (TRL) is a powerful tool for spatial-temporal data analysis and management. TRL aims to convert complicated raw trajectories into low-dimensional representation vectors, which can be applied to various…

Machine Learning · Computer Science 2024-03-08 Jiawei Jiang , Dayan Pan , Houxing Ren , Xiaohan Jiang , Chao Li , Jingyuan Wang

Recent advancements in vision-language pre-training (e.g. CLIP) have shown that vision models can benefit from language supervision. While many models using language modality have achieved great success on 2D vision tasks, the joint…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Rui Huang , Xuran Pan , Henry Zheng , Haojun Jiang , Zhifeng Xie , Shiji Song , Gao Huang

Skeleton-based human action recognition has attracted increasing attention in recent years. However, most of the existing works focus on supervised learning which requiring a large number of annotated action sequences that are often…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Siyuan Yang , Jun Liu , Shijian Lu , Meng Hwa Er , Alex C. Kot

Spatio-Temporal predictive Learning is a self-supervised learning paradigm that enables models to identify spatial and temporal patterns by predicting future frames based on past frames. Traditional methods, which use recurrent neural…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Andrea Alfarano , Alberto Alfarano , Linda Friso , Andrea Bacciu , Irene Amerini , Fabrizio Silvestri

Effective learning of spatial-temporal information within a point cloud sequence is highly important for many down-stream tasks such as 4D semantic segmentation and 3D action recognition. In this paper, we propose a novel framework named…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Yimin Wei , Hao Liu , Tingting Xie , Qiuhong Ke , Yulan Guo

In low-level video analyses, effective representations are important to derive the correspondences between video frames. These representations have been learned in a self-supervised fashion from unlabeled images or videos, using carefully…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Rui Li , Dong Liu

The recent success of pre-trained 2D vision models is mostly attributable to learning from large-scale datasets. However, compared with 2D image datasets, the current pre-training data of 3D point cloud is limited. To overcome this…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Yuan Yao , Yuanhan Zhang , Zhenfei Yin , Jiebo Luo , Wanli Ouyang , Xiaoshui Huang

Continual learning aims to improve the ability of modern learning systems to deal with non-stationary distributions, typically by attempting to learn a series of tasks sequentially. Prior art in the field has largely considered supervised…

Machine Learning · Computer Science 2019-11-01 Dushyant Rao , Francesco Visin , Andrei A. Rusu , Yee Whye Teh , Razvan Pascanu , Raia Hadsell