English
Related papers

Related papers: Feature Augmentation for Self-supervised Contrasti…

200 papers

Recent progress in self-supervised learning has demonstrated promising results in multiple visual tasks. An important ingredient in high-performing self-supervised methods is the use of data augmentation by training models to place…

Computer Vision and Pattern Recognition · Computer Science 2021-11-15 Chaitanya K. Ryali , David J. Schwab , Ari S. Morcos

Contrastive learning has achieved state-of-the-art performance in various self-supervised learning tasks and even outperforms its supervised counterpart. Despite its empirical success, theoretical understanding of the superiority of…

Machine Learning · Computer Science 2023-12-21 Wenlong Ji , Zhun Deng , Ryumei Nakada , James Zou , Linjun Zhang

Self-supervision is recently surging at its new frontier of graph learning. It facilitates graph representations beneficial to downstream tasks; but its success could hinge on domain knowledge for handcraft or the often expensive trials and…

Machine Learning · Computer Science 2022-01-06 Yuning You , Tianlong Chen , Zhangyang Wang , Yang Shen

We propose a self-supervised method to learn feature representations from videos. A standard approach in traditional self-supervised methods uses positive-negative data pairs to train with contrastive learning strategy. In such a case,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Li Tao , Xueting Wang , Toshihiko Yamasaki

With the increasing utilization of deep learning in outdoor settings, its robustness needs to be enhanced to preserve accuracy in the face of distribution shifts, such as compression artifacts. Data augmentation is a widely used technique…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Shohei Enomoto , Monikka Roslianna Busto , Takeharu Eda

Self-supervised learning algorithms (SSL) based on instance discrimination have shown promising results, performing competitively or even outperforming supervised learning counterparts in some downstream tasks. Such approaches employ data…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Mohammad Alkhalefi , Georgios Leontidis , Mingjun Zhong

Convolutional networks have marked their place over the last few years as the best performing model for various visual tasks. They are, however, most suited for supervised learning from large amounts of labeled data. Previous attempts have…

Machine Learning · Computer Science 2018-12-05 Elad Hoffer , Itay Hubara , Nir Ailon

Visual place recognition is a key to unlocking spatial navigation for animals, humans and robots. While state-of-the-art approaches are trained in a supervised manner and therefore hardly capture the information needed for generalizing to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Mohamed Adel Musallam , Vincent Gaudillière , Djamila Aouada

Collaborative learning enables distributed clients to learn a shared model for prediction while keeping the training data local on each client. However, existing collaborative learning methods require fully-labeled data for training, which…

Machine Learning · Computer Science 2022-04-26 Yawen Wu , Zhepeng Wang , Dewen Zeng , Meng Li , Yiyu Shi , Jingtong Hu

Data augmentation is a popular pre-processing trick to improve generalization accuracy. It is believed that by processing augmented inputs in tandem with the original ones, the model learns a more robust set of features which are shared…

Machine Learning · Computer Science 2020-07-10 Vihari Piratla , Shiv Shankar

Recent Self-Supervised Learning (SSL) methods are able to learn feature representations that are invariant to different data augmentations, which can then be transferred to downstream tasks of interest. However, different downstream tasks…

Machine Learning · Computer Science 2023-03-08 Chen Huang , Hanlin Goh , Jiatao Gu , Josh Susskind

Feature selection methods have an important role on the readability of data and the reduction of complexity of learning algorithms. In recent years, a variety of efforts are investigated on feature selection problems based on unsupervised…

Machine Learning · Computer Science 2019-12-12 Mohsen Ghassemi Parsa , Hadi Zare , Mehdi Ghatee

Contrastive learning, which aims at minimizing the distance between positive pairs while maximizing that of negative ones, has been widely and successfully applied in unsupervised feature learning, where the design of positive and negative…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Rui Zhu , Bingchen Zhao , Jingen Liu , Zhenglong Sun , Chang Wen Chen

Contrastive learning (CL), which can extract the information shared between different contrastive views, has become a popular paradigm for vision representation learning. Inspired by the success in computer vision, recent work introduces CL…

Machine Learning · Computer Science 2022-12-15 Xumeng Gong , Cheng Yang , Chuan Shi

Self-supervised learning has proven to be an effective way to learn representations in domains where annotated labels are scarce, such as medical imaging. A widely adopted framework for this purpose is contrastive learning and it has been…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Hugo Figueiras , Helena Aidos , Nuno Cruz Garcia

Self-supervised learning attempts to learn representations from un-labeled data; it does so via a loss function that encourages the embedding of a point to be close to that of its augmentations. This simple idea performs remarkably well,…

Machine Learning · Computer Science 2026-01-30 Parikshit Bansal , Ali Kavis , Sujay Sanghavi

We consider the problem of comparing the similarity of image sets with variable-quantity, quality and un-ordered heterogeneous images. We use feature restructuring to exploit the correlations of both inner$\&$inter-set images. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Xiaofeng Liu , Zhenhua Guo , Site Li , Lingsheng Kong , Ping Jia , Jane You , B. V. K. Kumar

Recently contrastive learning has shown significant progress in learning visual representations from unlabeled data. The core idea is training the backbone to be invariant to different augmentations of an instance. While most methods only…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Xiaoyang Guo , Tianhao Zhao , Yutian Lin , Bo Du

High-dimensional measurements are often correlated which motivates their approximation by factor models. This holds also true when features are engineered via low-dimensional interactions or kernel tricks. This often results in over…

Applications · Statistics 2025-09-03 Xiaonan Zhu , Bingyan Wang , Jianqing Fan

Supervised learning can improve the design of state-of-the-art solvers for combinatorial problems, but labelling large numbers of combinatorial instances is often impractical due to exponential worst-case complexity. Inspired by the recent…

Machine Learning · Computer Science 2022-06-22 Haonan Duan , Pashootan Vaezipoor , Max B. Paulus , Yangjun Ruan , Chris J. Maddison