English
Related papers

Related papers: A Cross Branch Fusion-Based Contrastive Learning F…

200 papers

Self-supervised representation learning is a critical problem in computer vision, as it provides a way to pretrain feature extractors on large unlabeled datasets that can be used as an initialization for more efficient and effective…

Computer Vision and Pattern Recognition · Computer Science 2020-12-25 Yunze Liu , Li Yi , Shanghang Zhang , Qingnan Fan , Thomas Funkhouser , Hao Dong

This paper presents Prototypical Contrastive Learning (PCL), an unsupervised representation learning method that addresses the fundamental limitations of instance-wise contrastive learning. PCL not only learns low-level features for the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Junnan Li , Pan Zhou , Caiming Xiong , Steven C. H. Hoi

With the rapid advancement of technology, 3D data acquisition and utilization have become increasingly prevalent across various fields, including computer vision, robotics, and geospatial analysis. 3D data, captured through methods such as…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Siming Yan

Self-supervised learning has achieved a great success in the representation learning of visual and textual data. However, the current methods are mainly validated on the well-curated datasets, which do not exhibit the real-world long-tailed…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Zhihan Zhou , Jiangchao Yao , Yanfeng Wang , Bo Han , Ya Zhang

Few-shot learning aims to transfer information from one task to enable generalization on novel tasks given a few examples. This information is present both in the domain and the class labels. In this work we investigate the complementary…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Orchid Majumder , Avinash Ravichandran , Subhransu Maji , Alessandro Achille , Marzia Polito , Stefano Soatto

In this paper, we introduce a contrastive learning framework for keypoint detection (CoKe). Keypoint detection differs from other visual tasks where contrastive learning has been applied because the input is a set of images in which…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Yutong Bai , Angtian Wang , Adam Kortylewski , Alan Yuille

Vision transformers (ViTs) have recently been widely applied to 3D point cloud understanding, with masked autoencoding as the predominant pre-training paradigm. However, the challenge of learning dense and informative semantic features from…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Bin Ren , Xiaoshui Huang , Mengyuan Liu , Hong Liu , Fabio Poiesi , Nicu Sebe , Guofeng Mei

Contrastive learning has demonstrated strong performance in attributed hypergraph clustering. Typically, existing methods based on contrastive learning first learn node embeddings and then apply clustering algorithms, such as k-means, to…

Machine Learning · Computer Science 2026-03-11 Li Ni , Shuaikang Zeng , Lin Mu , Longlong Lin

Object classification using LiDAR 3D point cloud data is critical for modern applications such as autonomous driving. However, labeling point cloud data is labor-intensive as it requires human annotators to visualize and inspect the 3D data…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Ziwei Wang , Reza Arablouei , Jiajun Liu , Paulo Borges , Greg Bishop-Hurley , Nicholas Heaney

Pre-training on large-scale unlabeled datasets contribute to the model achieving powerful performance on 3D vision tasks, especially when annotations are limited. However, existing rendering-based self-supervised frameworks are…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Hao Liu , Minglin Chen , Yanni Ma , Haihong Xiao , Ying He

Contrastive learning is among the most successful methods for visual representation learning, and its performance can be further improved by jointly performing clustering on the learned representations. However, existing methods for joint…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Shunjie-Fabian Zheng , JaeEun Nam , Emilio Dorigatti , Bernd Bischl , Shekoofeh Azizi , Mina Rezaei

Self-supervised pretraining has been shown to yield powerful representations for transfer learning. These performance gains come at a large computational cost however, with state-of-the-art methods requiring an order of magnitude more…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Olivier J. Hénaff , Skanda Koppula , Jean-Baptiste Alayrac , Aaron van den Oord , Oriol Vinyals , João Carreira

Contrastive self-supervised learning based on point-wise comparisons has been widely studied for vision tasks. In the visual cortex of the brain, neuronal responses to distinct stimulus classes are organized into geometric structures known…

Machine Learning · Computer Science 2026-01-06 Guanming Zhang , David J. Heeger , Stefano Martiniani

Contrastive self-supervised learning has outperformed supervised pretraining on many downstream tasks like segmentation and object detection. However, current methods are still primarily applied to curated datasets like ImageNet. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Wouter Van Gansbeke , Simon Vandenhende , Stamatios Georgoulis , Luc Van Gool

Federated Learning (FL) is a machine learning paradigm that allows decentralized clients to learn collaboratively without sharing their private data. However, excessive computation and communication demands pose challenges to current FL…

Cryptography and Security · Computer Science 2022-09-22 Yue Tan , Guodong Long , Jie Ma , Lu Liu , Tianyi Zhou , Jing Jiang

Recently, contrastive self-supervised learning has become a key component for learning visual representations across many computer vision tasks and benchmarks. However, contrastive learning in the context of domain adaptation remains…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Mamatha Thota , Georgios Leontidis

This paper proposes an adaptive margin contrastive learning method for 3D semantic segmentation on point clouds. Most existing methods use equally penalized objectives, which ignore the per-point ambiguities and less discriminated features…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Yang Chen , Yueqi Duan , Haowen Sun , Jiwen Lu , Yap-Peng Tan

In real-world scenarios, scanned point clouds are often incomplete due to occlusion issues. The tasks of self-supervised and weakly-supervised point cloud completion involve reconstructing missing regions of these incomplete objects without…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Lintai Wu , Xianjing Cheng , Yong Xu , Huanqiang Zeng , Junhui Hou

Learning discriminative image representations plays a vital role in long-tailed image classification because it can ease the classifier learning in imbalanced cases. Given the promising performance contrastive learning has shown recently in…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Peng Wang , Kai Han , Xiu-Shen Wei , Lei Zhang , Lei Wang

This article proposes a novel unsupervised learning framework for detecting the number of tunnel junctions in subterranean environments based on acquired 2D point clouds. The implementation of the framework provides valuable information for…