English
Related papers

Related papers: Masking Improves Contrastive Self-Supervised Learn…

200 papers

Contrastive self-supervised learning (CSL) has managed to match or surpass the performance of supervised learning in image and video classification. However, it is still largely unknown if the nature of the representations induced by the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Rohit Gupta , Naveed Akhtar , Ajmal Mian , Mubarak Shah

With recent advances in deep learning, neuroimaging studies increasingly rely on convolutional networks (ConvNets) to predict diagnosis based on MR images. To gain a better understanding of how a disease impacts the brain, the studies…

Machine Learning · Computer Science 2021-06-29 Qingyu Zhao , Ehsan Adeli , Adolf Pfefferbaum , Edith V. Sullivan , Kilian M. Pohl

Contrastive learning is one of the fastest growing research areas in machine learning due to its ability to learn useful representations without labeled data. However, contrastive learning is susceptible to feature suppression, i.e., it may…

Machine Learning · Computer Science 2021-11-30 Tianhong Li , Lijie Fan , Yuan Yuan , Hao He , Yonglong Tian , Rogerio Feris , Piotr Indyk , Dina Katabi

Saliency maps that identify the most informative regions of an image for a classifier are valuable for model interpretability. A common approach to creating saliency maps involves generating input masks that mask out portions of an image to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Jason Phang , Jungkyu Park , Krzysztof J. Geras

Anomaly detection (AD) is a fundamental task in computer vision. It aims to identify incorrect image data patterns which deviate from the normal ones. Conventional methods generally address AD by preparing augmented negative samples to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Jianjian Qin , Chunzhi Gu , Jun Yu , Chao Zhang

Learning representations of images that are invariant to sensitive or unwanted attributes is important for many tasks including bias removal and cross domain retrieval. Here, our objective is to learn representations that are invariant to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Jonathan Kahana , Yedid Hoshen

This work explores how human judgement about salient regions of an image can be introduced into deep convolutional neural network (DCNN) training. Traditionally, training of DCNNs is purely data-driven. This often results in learning…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Aidan Boyd , Patrick Tinsley , Kevin W. Bowyer , Adam Czajka

We propose a simple strategy for masking image patches during visual-language contrastive learning that improves the quality of the learned representations and the training speed. During each iteration of training, we randomly mask clusters…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Zihao Wei , Zixuan Pan , Andrew Owens

Deep learning-based recommender systems have achieved remarkable success in recent years. However, these methods usually heavily rely on labeled data (i.e., user-item interactions), suffering from problems such as data sparsity and…

Information Retrieval · Computer Science 2023-10-12 Mengyuan Jing , Yanmin Zhu , Tianzi Zang , Ke Wang

Self-supervised learning can be used for mitigating the greedy needs of Vision Transformer networks for very large fully-annotated datasets. Different classes of self-supervised learning offer representations with either good contextual…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Spyros Gidaris , Andrei Bursuc , Oriane Simeoni , Antonin Vobecky , Nikos Komodakis , Matthieu Cord , Patrick Pérez

Self-supervised representation learning (SSRL) methods have shown great success in computer vision. In recent studies, augmentation-based contrastive learning methods have been proposed for learning representations that are invariant or…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Xia Xu , Jochen Triesch

Multi-view representation learning has developed rapidly over the past decades and has been applied in many fields. However, most previous works assumed that each view is complete and aligned. This leads to an inevitable deterioration in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Yiming Wang , Dongxia Chang , Zhiqiang Fu , Jie Wen , Yao Zhao

Convolutional neural networks are capable of learning powerful representational spaces, which are necessary for tackling complex learning tasks. However, due to the model capacity required to capture such representations, they are often…

Computer Vision and Pattern Recognition · Computer Science 2017-11-30 Terrance DeVries , Graham W. Taylor

Self-supervised contrastive learning is a powerful tool to learn visual representation without labels. Prior work has primarily focused on evaluating the recognition accuracy of various pre-training algorithms, but has overlooked other…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Yuanyi Zhong , Haoran Tang , Junkun Chen , Jian Peng , Yu-Xiong Wang

In this paper, we propose several novel deep learning methods for object saliency detection based on the powerful convolutional neural networks. In our approach, we use a gradient descent method to iteratively modify an input image based on…

Computer Vision and Pattern Recognition · Computer Science 2015-05-07 Hengyue Pan , Bo Wang , Hui Jiang

We introduce CAN, a simple, efficient and scalable method for self-supervised learning of visual representations. Our framework is a minimal and conceptually clean synthesis of (C) contrastive learning, (A) masked autoencoders, and (N) the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Shlok Mishra , Joshua Robinson , Huiwen Chang , David Jacobs , Aaron Sarna , Aaron Maschinot , Dilip Krishnan

Learning robust representations to discriminate cell phenotypes based on microscopy images is important for drug discovery. Drug development efforts typically analyse thousands of cell images to screen for potential treatments. Early works…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Alexis Perakis , Ali Gorji , Samriddhi Jain , Krishna Chaitanya , Simone Rizza , Ender Konukoglu

One of the most promising ways of improving the performance of deep convolutional neural networks is by increasing the number of convolutional layers. However, adding layers makes training more difficult and computationally expensive. In…

Computer Vision and Pattern Recognition · Computer Science 2015-05-12 Liwei Wang , Chen-Yu Lee , Zhuowen Tu , Svetlana Lazebnik

We propose MaskingDepth, a novel semi-supervised learning framework for monocular depth estimation to mitigate the reliance on large ground-truth depth quantities. MaskingDepth is designed to enforce consistency between the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Jongbeom Baek , Gyeongnyeon Kim , Seonghoon Park , Honggyu An , Matteo Poggi , Seungryong Kim

Deep learning architectures are an extremely powerful tool for recognizing and classifying images. However, they require supervised learning and normally work on vectors the size of image pixels and produce the best results when trained on…

Machine Learning · Computer Science 2020-10-20 Ryan Burt , Nina N. Thigpen , Andreas Keil , Jose C. Principe