English
Related papers

Related papers: GroupContrast: Semantic-aware Self-supervised Repr…

200 papers

In recent years, contrastive learning achieves impressive results on self-supervised visual representation learning, but there still lacks a rigorous understanding of its learning dynamics. In this paper, we show that if we cast a…

Machine Learning · Computer Science 2023-03-09 Yifei Wang , Qi Zhang , Tianqi Du , Jiansheng Yang , Zhouchen Lin , Yisen Wang

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

Recognizing 3D part instances from a 3D point cloud is crucial for 3D structure and scene understanding. Several learning-based approaches use semantic segmentation and instance center prediction as training tasks and fail to further…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Chunyu Sun , Xin Tong , Yang Liu

Segmenting or detecting objects in sparse Lidar point clouds are two important tasks in autonomous driving to allow a vehicle to act safely in its 3D environment. The best performing methods in 3D semantic segmentation or object detection…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Corentin Sautier , Gilles Puy , Spyros Gidaris , Alexandre Boulch , Andrei Bursuc , Renaud Marlet

Traditional supervised learning with deep neural networks requires a tremendous amount of labelled data to converge to a good solution. For 3D medical images, it is often impractical to build a large homogeneous annotated dataset for a…

Semantic segmentation of remote sensing (RS) images is a challenging yet essential task with broad applications. While deep learning, particularly supervised learning with large-scale labeled datasets, has significantly advanced this field,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Bin Wang , Fei Deng , Shuang Wang , Wen Luo , Zhixuan Zhang , Peifan Jiang

This paper addresses text-supervised semantic segmentation, aiming to learn a model capable of segmenting arbitrary visual concepts within images by using only image-text pairs without dense annotations. Existing methods have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Ji-Jia Wu , Andy Chia-Hao Chang , Chieh-Yu Chuang , Chun-Pei Chen , Yu-Lun Liu , Min-Hung Chen , Hou-Ning Hu , Yung-Yu Chuang , Yen-Yu Lin

Self-supervised graph representation learning has recently shown considerable promise in a range of fields, including bioinformatics and social networks. A large number of graph contrastive learning approaches have shown promising…

Machine Learning · Computer Science 2024-01-30 Wei Ju , Yiyang Gu , Zhengyang Mao , Ziyue Qiao , Yifang Qin , Xiao Luo , Hui Xiong , Ming Zhang

We present Consistent Assignment of Views over Random Partitions (CARP), a self-supervised clustering method for representation learning of visual features. CARP learns prototypes in an end-to-end online fashion using gradient descent…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Thalles Silva , Adín Ramírez Rivera

Contrastive learning has become an important tool in learning representations from unlabeled data mainly relying on the idea of minimizing distance between positive data pairs, e.g., views from the same images, and maximizing distance…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Nina Shvetsova , Felix Petersen , Anna Kukleva , Bernt Schiele , Hilde Kuehne

Multi-view clustering can explore common semantics from multiple views and has attracted increasing attention. However, existing works punish multiple objectives in the same feature space, where they ignore the conflict between learning…

Machine Learning · Computer Science 2022-03-28 Jie Xu , Huayi Tang , Yazhou Ren , Liang Peng , Xiaofeng Zhu , Lifang He

Medical contrastive vision-language pre-training (VLP) has demonstrated significant potential in improving performance on downstream tasks. Traditional approaches typically employ contrastive learning, treating paired image-report samples…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Phuoc-Nguyen Bui , Toan Duc Nguyen , Junghyun Bum , Duc-Tai Le , Hyunseung Choo

Understanding the 3D world without supervision is currently a major challenge in computer vision as the annotations required to supervise deep networks for tasks in this domain are expensive to obtain on a large scale. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Octave Mariotti , Oisin Mac Aodha , Hakan Bilen

Unsupervised contrastive learning for indoor-scene point clouds has achieved great successes. However, unsupervised learning point clouds in outdoor scenes remains challenging because previous methods need to reconstruct the whole scene and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Runjian Chen , Yao Mu , Runsen Xu , Wenqi Shao , Chenhan Jiang , Hang Xu , Zhenguo Li , Ping Luo

Although an object may appear in numerous contexts, we often describe it in a limited number of ways. Language allows us to abstract away visual variation to represent and communicate concepts. Building on this intuition, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Mohamed El Banani , Karan Desai , Justin Johnson

The success of most advanced facial expression recognition works relies heavily on large-scale annotated datasets. However, it poses great challenges in acquiring clean and consistent annotations for facial expression datasets. On the other…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yuxuan Shu , Xiao Gu , Guang-Zhong Yang , Benny Lo

This paper strives for self-supervised learning of a feature space suitable for skeleton-based action recognition. Our proposal is built upon learning invariances to input skeleton representations and various skeleton augmentations via a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Fida Mohammad Thoker , Hazel Doughty , Cees G. M. Snoek

Low-level 3D representations, such as point clouds, meshes, NeRFs and 3D Gaussians, are commonly used for modeling 3D objects and scenes. However, cognitive studies indicate that human perception operates at higher levels and interprets 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Zhirui Gao , Renjiao Yi , Yuhang Huang , Wei Chen , Chenyang Zhu , Kai Xu

Labeling videos at scale is impractical. Consequently, self-supervised visual representation learning is key for efficient video analysis. Recent success in learning image representations suggests contrastive learning is a promising…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Nishant Rai , Ehsan Adeli , Kuan-Hui Lee , Adrien Gaidon , Juan Carlos Niebles

Traditionally, training neural networks to perform semantic segmentation required expensive human-made annotations. But more recently, advances in the field of unsupervised learning have made significant progress on this issue and towards…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Leon Sick , Dominik Engel , Pedro Hermosilla , Timo Ropinski