English
Related papers

Related papers: Masked Discrimination for Self-Supervised Learning…

200 papers

This paper proposes an adaptive margin contrastive learning method for 3D semantic segmentation on point clouds. Most existing methods use equally penalized objectives, which ignore the per-point ambiguities and less discriminated features…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Yang Chen , Yueqi Duan , Haowen Sun , Jiwen Lu , Yap-Peng Tan

Recently, pre-trained language models mostly follow the pre-train-then-fine-tuning paradigm and have achieved great performance on various downstream tasks. However, since the pre-training stage is typically task-agnostic and the…

Computation and Language · Computer Science 2020-10-08 Yuxian Gu , Zhengyan Zhang , Xiaozhi Wang , Zhiyuan Liu , Maosong Sun

We are interested in reconstructing the mesh representation of object surfaces from point clouds. Surface reconstruction is a prerequisite for downstream applications such as rendering, collision avoidance for planning, animation, etc.…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Minghua Liu , Xiaoshuai Zhang , Hao Su

Self-supervised representation learning has shown significant improvement in Natural Language Processing and 2D Computer Vision. However, existing methods face difficulties in representing 3D data because of its unordered and uneven…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Pengbo Li , Yiding Sun , Haozhe Cheng

A crucial task in scene understanding is 3D object detection, which aims to detect and localize the 3D bounding boxes of objects belonging to specific classes. Existing 3D object detectors heavily rely on annotated 3D bounding boxes during…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Zengyi Qin , Jinglu Wang , Yan Lu

Recent progress of semantic point clouds analysis is largely driven by synthetic data (e.g., the ModelNet and the ShapeNet), which are typically complete, well-aligned and noisy free. Therefore, representations of those ideal synthetic…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Li Yu , Hongchao Zhong , Longkun Zou , Ke Chen , Pan Gao

Self-supervised learning is attracting large attention in point cloud understanding. However, exploring discriminative and transferable features still remains challenging due to their nature of irregularity and sparsity. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Yun Liu , Xuefeng Yan , Zhilei Chen , Zhiqi Li , Zeyong Wei , Mingqiang Wei

Representation learning from 3D point clouds is challenging due to their inherent nature of permutation invariance and irregular distribution in space. Existing deep learning methods follow a hierarchical feature extraction paradigm in…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Rahul Chakwate , Arulkumar Subramaniam , Anurag Mittal

Self-supervised learning on point clouds has gained a lot of attention recently, since it addresses the label-efficiency and domain-gap problems on point cloud tasks. In this paper, we propose a novel self-supervised framework to learn…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Meng-Shiun Tsai , Pei-Ze Chiang , Yi-Hsuan Tsai , Wei-Chen Chiu

Detailed structural and species information on individual tree level is increasingly important to support precision forestry, biodiversity conservation, and provide reference data for biomass and carbon mapping. Point clouds from airborne…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Aldino Rizaldy , Fabian Ewald Fassnacht , Ahmed Jamal Afifi , Hua Jiang , Richard Gloaguen , Pedram Ghamisi

We present a novel approach to learning a point-wise, meaningful embedding for point-clouds in an unsupervised manner, through the use of neural-networks. The domain of point-cloud processing via neural-networks is rapidly evolving, with…

Graphics · Computer Science 2019-03-12 Matan Shoef , Sharon Fogel , Daniel Cohen-Or

The self-supervised objective of masking-and-predicting has led to promising performance gains on a variety of downstream tasks. However, while most approaches randomly mask tokens, there is strong intuition that deciding what to mask can…

3D point clouds are often perturbed by noise due to the inherent limitation of acquisition equipments, which obstructs downstream tasks such as surface reconstruction, rendering and so on. Previous works mostly infer the displacement of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Shitong Luo , Wei Hu

Self-attention networks have revolutionized natural language processing and are making impressive strides in image analysis tasks such as image classification and object detection. Inspired by this success, we investigate the application of…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Hengshuang Zhao , Li Jiang , Jiaya Jia , Philip Torr , Vladlen Koltun

As a fundamental yet challenging problem in intelligent transportation systems, point cloud registration attracts vast attention and has been attained with various deep learning-based algorithms. The unsupervised registration algorithms…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Dongrui Liu , Chuanchuan Chen , Changqing Xu , Robert Qiu , Lei Chu

Existing deep learning algorithms for point cloud analysis mainly concern discovering semantic patterns from global configuration of local geometries in a supervised learning manner. However, very few explore geometric properties revealing…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Lulu Tang , Ke Chen , Chaozheng Wu , Yu Hong , Kui Jia , Zhixin Yang

We present a new self-supervised paradigm on point cloud sequence understanding. Inspired by the discriminative and generative self-supervised methods, we design two tasks, namely point cloud sequence based Contrastive Prediction and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Xiaoxiao Sheng , Zhiqiang Shen , Gang Xiao

While image data starts to enjoy the simple-but-effective self-supervised learning scheme built upon masking and self-reconstruction objective thanks to the introduction of tokenization procedure and vision transformer backbone,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Zhi-Yi Chin , Chieh-Ming Jiang , Ching-Chun Huang , Pin-Yu Chen , Wei-Chen Chiu

Deep learning is increasingly being used to perform machine vision tasks such as classification, object detection, and segmentation on 3D point cloud data. However, deep learning inference is computationally expensive. The limited…

Image and Video Processing · Electrical Eng. & Systems 2023-08-14 Mateen Ulhaq , Ivan V. Bajić

Fully-supervised category-level pose estimation aims to determine the 6-DoF poses of unseen instances from known categories, requiring expensive mannual labeling costs. Recently, various self-supervised category-level pose estimation…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Jingtao Sun , Yaonan Wang , Mingtao Feng , Chao Ding , Mike Zheng Shou , Ajmal Saeed Mian