English
Related papers

Related papers: GroupContrast: Semantic-aware Self-supervised Repr…

200 papers

We propose a combined generative and contrastive neural architecture for learning latent representations of 3D volumetric shapes. The architecture uses two encoder branches for voxel grids and multi-view images from the same underlying…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Chengzhi Wu , Julius Pfrommer , Mingyuan Zhou , Jürgen Beyerer

Self-supervised representation learning can mitigate the limitations in recognition tasks with few manually labeled data but abundant unlabeled data---a common scenario in sound event research. In this work, we explore unsupervised…

Sound · Computer Science 2020-11-17 Eduardo Fonseca , Diego Ortego , Kevin McGuinness , Noel E. O'Connor , Xavier Serra

This work considers supervised contrastive learning for semantic segmentation. We apply contrastive learning to enhance the discriminative power of the multi-scale features extracted by semantic segmentation networks. Our key methodological…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Theodoros Pissas , Claudio S. Ravasio , Lyndon Da Cruz , Christos Bergeles

Traditionally, algorithms that learn to segment object instances in 2D images have heavily relied on large amounts of human-annotated data. Only recently, novel approaches have emerged tackling this problem in an unsupervised fashion.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Leon Sick , Dominik Engel , Sebastian Hartwig , Pedro Hermosilla , Timo Ropinski

Self-supervised learning is showing great promise for monocular depth estimation, using geometry as the only source of supervision. Depth networks are indeed capable of learning representations that relate visual appearance to 3D properties…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Vitor Guizilini , Rui Hou , Jie Li , Rares Ambrus , Adrien Gaidon

Graph representation learning has attracted lots of attention recently. Existing graph neural networks fed with the complete graph data are not scalable due to limited computation and memory costs. Thus, it remains a great challenge to…

Machine Learning · Computer Science 2020-11-24 Yizhu Jiao , Yun Xiong , Jiawei Zhang , Yao Zhang , Tianqi Zhang , Yangyong Zhu

Unsupervised representation learning techniques, such as learning word embeddings, have had a significant impact on the field of natural language processing. Similar representation learning techniques have not yet become commonplace in the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Joël Bachmann , Kenneth Blomqvist , Julian Förster , Roland Siegwart

We develop a novel learning scheme named Self-Prediction for 3D instance and semantic segmentation of point clouds. Distinct from most existing methods that focus on designing convolutional operators, our method designs a new learning…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Jinxian Liu , Minghui Yu , Bingbing Ni , Ye Chen

Self-supervised learning of point cloud aims to leverage unlabeled 3D data to learn meaningful representations without reliance on manual annotations. However, current approaches face challenges such as limited data diversity and inadequate…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Keyi Liu , Yeqi Luo , Weidong Yang , Jingyi Xu , Zhijun Li , Wen-Ming Chen , Ben Fei

The point cloud representation of an object can have a large geometric variation in view of inconsistent data acquisition procedure, which thus leads to domain discrepancy due to diverse and uncontrollable shape representation cross…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Longkun Zou , Hui Tang , Ke Chen , Kui Jia

Detecting anomalies is one fundamental aspect of a safety-critical software system, however, it remains a long-standing problem. Numerous branches of works have been proposed to alleviate the complication and have demonstrated their…

Machine Learning · Computer Science 2023-01-31 Hyunsoo Cho , Jinseok Seol , Sang-goo Lee

Self-supervised learning can extract representations of good quality from solely unlabeled data, which is appealing for point cloud videos due to their high labelling cost. In this paper, we propose a contrastive mask prediction (PointCMP)…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Zhiqiang Shen , Xiaoxiao Sheng , Longguang Wang , Yulan Guo , Qiong Liu , Xi Zhou

Contrastive representation learning has gained much attention due to its superior performance in learning representations from both image and sequential data. However, the learned representations could potentially lead to performance…

Computation and Language · Computer Science 2022-11-01 Jianfeng Chi , William Shand , Yaodong Yu , Kai-Wei Chang , Han Zhao , Yuan Tian

We consider graph representation learning in a self-supervised manner. Graph neural networks (GNNs) use neighborhood aggregation as a core component that results in feature smoothing among nodes in proximity. While successful in various…

Machine Learning · Computer Science 2021-07-20 Wei Zhuo , Guang Tan

In this paper, we introduce a self-supervised learning method to enhance the graph-level representations with the help of a set of subgraphs. For this purpose, we propose a universal framework to generate subgraphs in an auto-regressive way…

Machine Learning · Computer Science 2021-05-10 Chenguang Wang , Ziwen Liu

Accurate segmentation of retinal fluids in 3D Optical Coherence Tomography images is key for diagnosis and personalized treatment of eye diseases. While deep learning has been successful at this task, trained supervised models often fail…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Alvaro Gomariz , Huanxiang Lu , Yun Yvonna Li , Thomas Albrecht , Andreas Maunz , Fethallah Benmansour , Alessandra M. Valcarcel , Jennifer Luu , Daniela Ferrara , Orcun Goksel

The ability to endow maps of indoor scenes with semantic information is an integral part of robotic agents which perform different tasks such as target driven navigation, object search or object rearrangement. The state-of-the-art methods…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Sulabh Shrestha , Yimeng Li , Jana Kosecka

We pilot a family of stable contrastive losses for learning pixel-level representations that jointly capture semantic and geometric information. Our approach maps each pixel of an image to an overcomplete descriptor that is both…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Leonid Pogorelyuk , Niels Bracher , Aaron Verkleeren , Lars Kühmichel , Stefan T. Radev

Contrastive self-supervised learning has become a prominent technique in representation learning. The main step in these methods is to contrast semantically similar and dissimilar pairs of samples. However, in the domain of Natural Language…

Computation and Language · Computer Science 2022-06-07 Amrita Bhattacharjee , Mansooreh Karami , Huan Liu

Recently, contrastive learning-based image translation methods have been proposed, which contrasts different spatial locations to enhance the spatial correspondence. However, the methods often ignore the diverse semantic relation within the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Chanyong Jung , Gihyun Kwon , Jong Chul Ye