English
Related papers

Related papers: Exploring internal representation of self-supervis…

200 papers

Self-supervised learning has been successfully applied to pre-train video representations, which aims at efficient adaptation from pre-training domain to downstream tasks. Existing approaches merely leverage contrastive loss to learn…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Yuanze Lin , Xun Guo , Yan Lu

Point clouds have attracted increasing attention. Significant progress has been made in methods for point cloud analysis, which often requires costly human annotation as supervision. To address this issue, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Bi'an Du , Xiang Gao , Wei Hu , Xin Li

Recently, cross domain transfer has been applied for unsupervised image restoration tasks. However, directly applying existing frameworks would lead to domain-shift problems in translated images due to lack of effective supervision.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Wenchao Du , Hu Chen , Hongyu Yang

Self-supervised contrastive learning offers a means of learning informative features from a pool of unlabeled data. In this paper, we delve into another useful approach -- providing a way of selecting a core-set that is entirely unlabeled.…

Machine Learning · Computer Science 2021-04-08 Jeongwoo Ju , Heechul Jung , Yoonju Oh , Junmo Kim

Convolutional Neural Networks have made their mark in various fields of computer vision in recent years. They have achieved state-of-the-art performance in the field of document analysis as well. However, CNNs require a large amount of…

Computer Vision and Pattern Recognition · Computer Science 2018-01-29 Neha Gurjar , Sebastian Sudholt , Gernot A. Fink

Recent self-supervised contrastive methods have been able to produce impressive transferable visual representations by learning to be invariant to different data augmentations. However, these methods implicitly assume a particular set of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Tete Xiao , Xiaolong Wang , Alexei A. Efros , Trevor Darrell

Recently, contrastive learning has largely advanced the progress of unsupervised visual representation learning. Pre-trained on ImageNet, some self-supervised algorithms reported higher transfer learning performance compared to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-18 Longhui Wei , Lingxi Xie , Jianzhong He , Jianlong Chang , Xiaopeng Zhang , Wengang Zhou , Houqiang Li , Qi Tian

Few-shot learning is a challenging problem that has attracted more and more attention recently since abundant training samples are difficult to obtain in practical applications. Meta-learning has been proposed to address this issue, which…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Xian Zhong , Cheng Gu , Wenxin Huang , Lin Li , Shuqin Chen , Chia-Wen Lin

The joint hyperspectral image (HSI) and LiDAR data classification aims to interpret ground objects at more detailed and precise level. Although deep learning methods have shown remarkable success in the multisource data classification task,…

Image and Video Processing · Electrical Eng. & Systems 2023-02-08 Meng Wang , Feng Gao , Junyu Dong , Heng-Chao Li , Qian Du

Graph representation learning received increasing attentions in recent years. Most of existing methods ignore the complexity of the graph structures and restrict graphs in a single constant-curvature representation space, which is only…

Machine Learning · Computer Science 2021-12-13 Li Sun , Zhongbao Zhang , Junda Ye , Hao Peng , Jiawei Zhang , Sen Su , Philip S. Yu

Sample contrastive methods, typically referred to simply as contrastive are the foundation of most unsupervised methods to learn text and sentence embeddings. On the other hand, a different class of self-supervised loss functions and…

Computation and Language · Computer Science 2023-10-30 Marco Farina , Duccio Pappadopulo

Contrastive learning is commonly applied to self-supervised learning, and has been shown to outperform traditional approaches such as the triplet loss and N-pair loss. However, the requirement of large batch sizes and memory banks has made…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Rishab Balasubramanian , Rupashree Dey , Kunal Rathore

Dense correspondence across semantically related images has been extensively studied, but still faces two challenges: 1) large variations in appearance, scale and pose exist even for objects from the same category, and 2) labeling…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Taihong Xiao , Sifei Liu , Shalini De Mello , Zhiding Yu , Jan Kautz , Ming-Hsuan Yang

Contrastive learning has become a key component of self-supervised learning approaches for computer vision. By learning to embed two augmented versions of the same image close to each other and to push the embeddings of different images…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Yannis Kalantidis , Mert Bulent Sariyildiz , Noe Pion , Philippe Weinzaepfel , Diane Larlus

Point cloud data have been widely explored due to its superior accuracy and robustness under various adverse situations. Meanwhile, deep neural networks (DNNs) have achieved very impressive success in various applications such as…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Aoran Xiao , Jiaxing Huang , Dayan Guan , Xiaoqin Zhang , Shijian Lu , Ling Shao

To alleviate the cost of collecting and annotating large-scale point cloud datasets, we propose an unsupervised learning approach to learn features from unlabeled point cloud "3D object" dataset by using part contrasting and object…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Ling Zhang , Zhigang Zhu

Semantic Image Interpretation is the task of extracting a structured semantic description from images. This requires the detection of visual relationships: triples (subject,relation,object) describing a semantic relation between a subject…

Machine Learning · Computer Science 2019-10-02 Ivan Donadello , Luciano Serafini

Self-supervision can dramatically cut back the amount of manually-labelled data required to train deep neural networks. While self-supervision has usually been considered for tasks such as image classification, in this paper we aim at…

Computer Vision and Pattern Recognition · Computer Science 2018-04-06 David Novotny , Samuel Albanie , Diane Larlus , Andrea Vedaldi

The integration of different imaging modalities, such as structural, diffusion tensor, and functional magnetic resonance imaging, with deep learning models has yielded promising outcomes in discerning phenotypic characteristics and…

Image and Video Processing · Electrical Eng. & Systems 2024-10-08 Zhiyuan Li , Hailong Li , Anca L. Ralescu , Jonathan R. Dillman , Mekibib Altaye , Kim M. Cecil , Nehal A. Parikh , Lili He

Self-supervised learning (SSL) has demonstrated its effectiveness in learning representations through comparison methods that align with human intuition. However, mainstream SSL methods heavily rely on high body datasets with single label,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Jiale Chen