English
Related papers

Related papers: Integrating Auxiliary Information in Self-supervis…

200 papers

Contrastive learning is a powerful self-supervised learning method, but we have a limited theoretical understanding of how it works and why it works. In this paper, we prove that contrastive learning with the standard InfoNCE loss is…

Machine Learning · Computer Science 2024-02-26 Zhiquan Tan , Yifan Zhang , Jingqin Yang , Yang Yuan

Contrastive representation learning, which aims to learnthe shared information between different views of unlabeled data by maximizing the mutual information between them, has shown its powerful competence in self-supervised learning for…

Machine Learning · Computer Science 2024-08-21 Xuechu Yu

Self-supervised instance discrimination is an effective contrastive pretext task to learn feature representations and address limited medical image annotations. The idea is to make features of transformed versions of the same images similar…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Yejia Zhang , Xinrong Hu , Nishchal Sapkota , Yiyu Shi , Danny Z. Chen

Self-supervised learning (SSL) has demonstrated its effectiveness in learning representations through comparison methods that align with human intuition. However, mainstream SSL methods heavily rely on high body datasets with single label,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Jiale Chen

Supervised classification approaches can predict labels for unknown data because of the supervised training process. The success of classification is heavily dependent on the labeled training data. Differently, clustering is effective in…

Machine Learning · Computer Science 2015-02-19 Fangfang Li , Guandong Xu , Longbing Cao

Incomplete Multi-View Clustering aims to enhance clustering performance by using data from multiple modalities. Despite the fact that several approaches for studying this issue have been proposed, the following drawbacks still persist: 1)…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Jiatai Wang , Zhiwei Xu , Xuewen Yang , Dongjin Guo , Limin Liu

One of the most promising approaches for unsupervised learning is combining deep representation learning and deep clustering. Some recent works propose to simultaneously learn representation using deep neural networks and perform clustering…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Mina Rezaei , Emilio Dorigatti , David Ruegamer , Bernd Bischl

In recent years, several unsupervised, "contrastive" learning algorithms in vision have been shown to learn representations that perform remarkably well on transfer tasks. We show that this family of algorithms maximizes a lower bound on…

Machine Learning · Computer Science 2020-06-08 Mike Wu , Chengxu Zhuang , Milan Mosse , Daniel Yamins , Noah Goodman

Semi-supervised learning (SSL) seeks to enhance task performance by training on both labeled and unlabeled data. Mainstream SSL image classification methods mostly optimize a loss that additively combines a supervised classification…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Zhe Huang , Xiaowei Yu , Dajiang Zhu , Michael C. Hughes

Pre-training convolutional neural networks with weakly-supervised and self-supervised strategies is becoming increasingly popular for several computer vision tasks. However, due to the lack of strong discriminative signals, these learned…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Xueting Yan , Ishan Misra , Abhinav Gupta , Deepti Ghadiyaram , Dhruv Mahajan

Subspace clustering refers to the problem of segmenting high dimensional data drawn from a union of subspaces into the respective subspaces. In some applications, partial side-information to indicate "must-link" or "cannot-link" in…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Chun-Guang Li , Junjian Zhang , Jun Guo

Building accurate and robust artificial intelligence systems for medical image assessment requires not only the research and design of advanced deep learning models but also the creation of large and curated sets of annotated training…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Florin C. Ghesu , Bogdan Georgescu , Awais Mansoor , Youngjin Yoo , Dominik Neumann , Pragneshkumar Patel , R. S. Vishwanath , James M. Balter , Yue Cao , Sasa Grbic , Dorin Comaniciu

Despite significant advances in clustering methods in recent years, the outcome of clustering of a natural image dataset is still unsatisfactory due to two important drawbacks. Firstly, clustering of images needs a good feature…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Dipanjan Das , Ratul Ghosh , Brojeshwar Bhowmick

A Convolutional Neural Network (CNN) is sometimes confronted with objects of changing appearance ( new instances) that exceed its generalization capability. This requires the CNN to incorporate new knowledge, i.e., to learn incrementally.…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Tobias Scheck , Ana Perez Grassi , Gangolf Hirtz

In this paper we propose a strategy for semi-supervised image classification that leverages unsupervised representation learning and co-training. The strategy, that is called CURL from Co-trained Unsupervised Representation Learning,…

Machine Learning · Computer Science 2015-09-14 Simone Bianco , Gianluigi Ciocca , Claudio Cusano

Automatically understanding the contents of an image is a highly relevant problem in practice. In e-commerce and social media settings, for example, a common problem is to automatically categorize user-provided pictures. Nowadays, a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Koby Bibas , Oren Sar Shalom , Dietmar Jannach

The advancement of deep learning has greatly improved supervised image classification. However, labeling data is costly, prompting research into unsupervised learning methods such as contrastive learning. In real-world scenarios, fully…

Artificial Intelligence · Computer Science 2026-01-09 Shogo Nakayama , Masahiro Okuda

Supervised person re-identification methods rely heavily on high-quality cross-camera training label. This significantly hinders the deployment of re-ID models in real-world applications. The unsupervised person re-ID methods can reduce the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-09 Hehan Teng , Tao He , Yuchen Guo , Guiguang Ding

Unsupervised (or self-supervised) graph representation learning is essential to facilitate various graph data mining tasks when external supervision is unavailable. The challenge is to encode the information about the graph structure and…

Machine Learning · Computer Science 2020-09-16 Costas Mavromatis , George Karypis

Recent work on few-shot learning \cite{tian2020rethinking} showed that quality of learned representations plays an important role in few-shot classification performance. On the other hand, the goal of self-supervised learning is to recover…

Machine Learning · Computer Science 2021-01-26 Nathaniel Simard , Guillaume Lagrange