English
Related papers

Related papers: Masking Improves Contrastive Self-Supervised Learn…

200 papers

Recent advances in self-supervised learning (SSL) have largely closed the gap with supervised ImageNet pretraining. Despite their success these methods have been primarily applied to unlabeled ImageNet images, and show marginal gains when…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Ramprasaath R. Selvaraju , Karan Desai , Justin Johnson , Nikhil Naik

Neural network based speech recognition systems suffer from performance degradation due to accented speech, especially unfamiliar accents. In this paper, we study the supervised contrastive learning framework for accented speech…

Sound · Computer Science 2021-07-05 Tao Han , Hantao Huang , Ziang Yang , Wei Han

To improve performance in visual feature representation from photos or videos for practical applications, we generally require large-scale human-annotated labeled data while training deep neural networks. However, the cost of gathering and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Zhenyuan Lu

Self-supervised learning can extract representations of good quality from solely unlabeled data, which is appealing for point cloud videos due to their high labelling cost. In this paper, we propose a contrastive mask prediction (PointCMP)…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Zhiqiang Shen , Xiaoxiao Sheng , Longguang Wang , Yulan Guo , Qiong Liu , Xi Zhou

A key requirement for the success of supervised deep learning is a large labeled dataset - a condition that is difficult to meet in medical image analysis. Self-supervised learning (SSL) can help in this regard by providing a strategy to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Krishna Chaitanya , Ertunc Erdil , Neerav Karani , Ender Konukoglu

In this paper, we are interested in understanding self-supervised pretraining through studying the capability that self-supervised representation pretraining methods learn part-aware representations. The study is mainly motivated by that…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Jie Zhu , Jiyang Qi , Mingyu Ding , Xiaokang Chen , Ping Luo , Xinggang Wang , Wenyu Liu , Leye Wang , Jingdong Wang

Self-supervised learning of deep neural networks has become a prevalent paradigm for learning representations that transfer to a variety of downstream tasks. Similar to proposed models of the ventral stream of biological vision, it is…

Machine Learning · Computer Science 2023-06-26 Kion Fallah , Alec Helbling , Kyle A. Johnsen , Christopher J. Rozell

This work considers supervised contrastive learning for semantic segmentation. We apply contrastive learning to enhance the discriminative power of the multi-scale features extracted by semantic segmentation networks. Our key methodological…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Theodoros Pissas , Claudio S. Ravasio , Lyndon Da Cruz , Christos Bergeles

SARS-CoV-2 has presented direct and indirect challenges to the scientific community. One of the most prominent indirect challenges advents from the mandatory use of face masks in a large number of countries. Face recognition methods…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Pedro C. Neto , Fadi Boutros , João Ribeiro Pinto , Naser Damer , Ana F. Sequeira , Jaime S. Cardoso

Learning discriminative image representations plays a vital role in long-tailed image classification because it can ease the classifier learning in imbalanced cases. Given the promising performance contrastive learning has shown recently in…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Peng Wang , Kai Han , Xiu-Shen Wei , Lei Zhang , Lei Wang

Traditional supervised learning with deep neural networks requires a tremendous amount of labelled data to converge to a good solution. For 3D medical images, it is often impractical to build a large homogeneous annotated dataset for a…

Masked image modelling (e.g., Masked AutoEncoder) and contrastive learning (e.g., Momentum Contrast) have shown impressive performance on unsupervised visual representation learning. This work presents Masked Contrastive Representation…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Yuchong Yao , Nandakishor Desai , Marimuthu Palaniswami

Masked autoencoding has achieved great success for self-supervised learning in the image and language domains. However, mask based pretraining has yet to show benefits for point cloud understanding, likely due to standard backbones like…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Haotian Liu , Mu Cai , Yong Jae Lee

How can neural networks trained by contrastive learning extract features from the unlabeled data? Why does contrastive learning usually need much stronger data augmentations than supervised learning to ensure good representations? These…

Machine Learning · Computer Science 2021-07-06 Zixin Wen , Yuanzhi Li

The discriminability of feature representation is the key to open-set face recognition. Previous methods rely on the learnable weights of the classification layer that represent the identities. However, the evaluation process learns no…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Youzhe Song , Feng Wang

Pre-training with random masked inputs has emerged as a novel trend in self-supervised training. However, supervised learning still faces a challenge in adopting masking augmentations, primarily due to unstable training. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Byeongho Heo , Taekyung Kim , Sangdoo Yun , Dongyoon Han

The prediction of salient areas in images has been traditionally addressed with hand-crafted features based on neuroscience principles. This paper, however, addresses the problem with a completely data-driven approach by training a…

Computer Vision and Pattern Recognition · Computer Science 2016-03-03 Junting Pan , Kevin McGuinness , Elisa Sayrol , Noel O'Connor , Xavier Giro-i-Nieto

Image retargeting is the task of making images capable of being displayed on screens with different sizes. This work should be done so that high-level visual information and low-level features such as texture remain as intact as possible to…

Computer Vision and Pattern Recognition · Computer Science 2019-10-18 Mahdi Ahmadi , Nader Karimi , Shadrokh Samavi

We present a contrasting learning approach with data augmentation techniques to learn document representations in an unsupervised manner. Inspired by recent contrastive self-supervised learning algorithms used for image and NLP pretraining,…

Computation and Language · Computer Science 2021-03-29 Dongsheng Luo , Wei Cheng , Jingchao Ni , Wenchao Yu , Xuchao Zhang , Bo Zong , Yanchi Liu , Zhengzhang Chen , Dongjin Song , Haifeng Chen , Xiang Zhang

In the field of visual representation learning, performance of contrastive learning has been catching up with the supervised method which is commonly a classification convolutional neural network. However, most of the research work focuses…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Xiaoqi Zhuang