English
Related papers

Related papers: Projection Head is Secretly an Information Bottlen…

200 papers

An effective technique for obtaining high-quality representations is adding a projection head on top of the encoder during training, then discarding it and using the pre-projection representations. Despite its proven practical…

Machine Learning · Computer Science 2024-03-19 Yihao Xue , Eric Gan , Jiayi Ni , Siddharth Joshi , Baharan Mirzasoleiman

We investigate the role of projection heads, also known as projectors, within the encoder-projector framework (e.g., SimCLR) used in contrastive learning. We aim to demystify the observed phenomenon where representations learned before…

Machine Learning · Statistics 2023-06-07 Yu Gui , Cong Ma , Yiqiao Zhong

Contrastive Learning (CL) has emerged as a powerful method for training feature extraction models using unlabeled data. Recent studies suggest that incorporating a linear projection head post-backbone significantly enhances model…

Machine Learning · Computer Science 2024-10-08 Huanran Li , Daniel Pimentel-Alarcón

What matters for contrastive learning? We argue that contrastive learning heavily relies on informative features, or "hard" (positive or negative) features. Early works include more informative features by applying complex data…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Jiangmeng Li , Wenwen Qiang , Changwen Zheng , Bing Su , Hui Xiong

Various graph contrastive learning models have been proposed to improve the performance of learning tasks on graph datasets in recent years. While effective and prevalent, these models are usually carefully customized. In particular,…

Machine Learning · Computer Science 2021-11-01 Dongkuan Xu , Wei Cheng , Dongsheng Luo , Haifeng Chen , Xiang Zhang

The superior performance of some of today's state-of-the-art deep learning models is to some extent owed to extensive (self-)supervised contrastive pretraining on large-scale datasets. In contrastive learning, the network is presented with…

Machine Learning · Computer Science 2022-07-20 Shervin Ardeshir , Navid Azizan

Many unsupervised hashing methods are implicitly established on the idea of reconstructing the input data, which basically encourages the hashing codes to retain as much information of original data as possible. However, this requirement…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Zexuan Qiu , Qinliang Su , Zijing Ou , Jianxing Yu , Changyou Chen

Conventionally, during the knowledge distillation process (e.g. feature distillation), an additional projector is often required to perform feature transformation due to the dimension mismatch between the teacher and the student networks.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Yudong Chen , Sen Wang , Jiajun Liu , Xuwei Xu , Frank de Hoog , Brano Kusy , Zi Huang

Self-supervised representation learning (SSRL) methods have shown great success in computer vision. In recent studies, augmentation-based contrastive learning methods have been proposed for learning representations that are invariant or…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Xia Xu , Jochen Triesch

In knowledge distillation, previous feature distillation methods mainly focus on the design of loss functions and the selection of the distilled layers, while the effect of the feature projector between the student and the teacher remains…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Yudong Chen , Sen Wang , Jiajun Liu , Xuwei Xu , Frank de Hoog , Zi Huang

In this paper we revisit the efficacy of knowledge distillation as a function matching and metric learning problem. In doing so we verify three important design decisions, namely the normalisation, soft maximum function, and projection…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Roy Miles , Krystian Mikolajczyk

In this paper, we are interested in understanding self-supervised pretraining through studying the capability that self-supervised representation pretraining methods learn part-aware representations. The study is mainly motivated by that…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Jie Zhu , Jiyang Qi , Mingyu Ding , Xiaokang Chen , Ping Luo , Xinggang Wang , Wenyu Liu , Leye Wang , Jingdong Wang

Despite recent success of self-supervised based contrastive learning model for 3D point clouds representation, the adversarial robustness of such pre-trained models raised concerns. Adversarial contrastive learning (ACL) is considered an…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Junxuan Huang , Yatong An , Lu cheng , Bai Chen , Junsong Yuan , Chunming Qiao

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

In deep learning, transferring information from a pretrained network to a downstream task by finetuning has many benefits. The choice of task head plays an important role in fine-tuning, as the pretrained and downstream tasks are usually…

Machine Learning · Computer Science 2023-02-14 Yi Ren , Shangmin Guo , Wonho Bae , Danica J. Sutherland

Contrastive learning between different views of the data achieves outstanding success in the field of self-supervised representation learning and the learned representations are useful in broad downstream tasks. Since all supervision…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Haoqing Wang , Xun Guo , Zhi-Hong Deng , Yan Lu

Contrastive learning has become a key component of self-supervised learning approaches for computer vision. By learning to embed two augmented versions of the same image close to each other and to push the embeddings of different images…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Yannis Kalantidis , Mert Bulent Sariyildiz , Noe Pion , Philippe Weinzaepfel , Diane Larlus

While deeper and wider neural networks are actively pushing the performance limits of various computer vision and machine learning tasks, they often require large sets of labeled data for effective training and suffer from extremely high…

Computer Vision and Pattern Recognition · Computer Science 2017-10-27 Zhi Zhang , Guanghan Ning , Zhihai He

Contrastive learning is a popular form of self-supervised learning that encourages augmentations (views) of the same input to have more similar representations compared to augmentations of different inputs. Recent attempts to theoretically…

Machine Learning · Computer Science 2022-03-01 Nikunj Saunshi , Jordan Ash , Surbhi Goel , Dipendra Misra , Cyril Zhang , Sanjeev Arora , Sham Kakade , Akshay Krishnamurthy

Recently the surprising discovery of the Bootstrap Your Own Latent (BYOL) method by Grill et al. shows the negative term in contrastive loss can be removed if we add the so-called prediction head to the network. This initiated the research…

Machine Learning · Computer Science 2023-01-18 Zixin Wen , Yuanzhi Li
‹ Prev 1 2 3 10 Next ›