English
Related papers

Related papers: Efficient Unsupervised Visual Representation Learn…

200 papers

Unsupervised Re-ID methods aim at learning robust and discriminative features from unlabeled data. However, existing methods often ignore the relationship between module parameters of Re-ID framework and feature distributions, which may…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Ziqi He , Mengjia Xue , Yunhao Du , Zhicheng Zhao , Fei Su

In view of its power in extracting feature representation, contrastive self-supervised learning has been successfully integrated into the practice of (deep) reinforcement learning (RL), leading to efficient policy learning in various…

Machine Learning · Computer Science 2024-04-16 Shuang Qiu , Lingxiao Wang , Chenjia Bai , Zhuoran Yang , Zhaoran Wang

Gradient-based data influence approximation has been leveraged to select useful data samples in the supervised fine-tuning of large language models. However, the computation of gradients throughout the fine-tuning process requires too many…

Computation and Language · Computer Science 2025-06-13 Zige Wang , Qi Zhu , Fei Mi , Minghui Xu , Ruochun Jin , Wenjing Yang

We present Consistent Assignment of Views over Random Partitions (CARP), a self-supervised clustering method for representation learning of visual features. CARP learns prototypes in an end-to-end online fashion using gradient descent…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Thalles Silva , Adín Ramírez Rivera

Exemplar learning is a powerful paradigm for discovering visual similarities in an unsupervised manner. In this context, however, the recent breakthrough in deep learning could not yet unfold its full potential. With only a single positive…

Computer Vision and Pattern Recognition · Computer Science 2016-09-01 Miguel A. Bautista , Artsiom Sanakoyeu , Ekaterina Sutter , Björn Ommer

Multiview clustering (MVC) aims to reveal the underlying structure of multiview data by categorizing data samples into clusters. Deep learning-based methods exhibit strong feature learning capabilities on large-scale datasets. For most…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Jie Chen , Hua Mao , Wai Lok Woo , Xi Peng

Unsupervised visual representation learning has gained much attention from the computer vision community because of the recent achievement of contrastive learning. Most of the existing contrastive learning frameworks adopt the instance…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Mingkai Zheng , Fei Wang , Shan You , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Collecting large annotated datasets in Remote Sensing is often expensive and thus can become a major obstacle for training advanced machine learning models. Common techniques of addressing this issue, based on the underlying idea of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Rahul Ghosh , Xiaowei Jia , Chenxi Lin , Zhenong Jin , Vipin Kumar

Convolutional networks are at the center of best-in-class computer vision applications for a wide assortment of undertakings. Since 2014, a profound amount of work began to make better convolutional architectures, yielding generous…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Dishant Parikh

In the face of complex natural images, existing deep clustering algorithms fall significantly short in terms of clustering accuracy when compared to supervised classification methods, making them less practical. This paper introduces an…

Machine Learning · Computer Science 2024-08-13 Qiuyu Zhu , Liheng Hu , Sijin Wang

Co-clustering exploits the duality of instances and features to simultaneously uncover meaningful groups in both dimensions, often outperforming traditional clustering in high-dimensional or sparse data settings. Although recent deep…

Machine Learning · Computer Science 2025-04-10 Ashwin Vinod , Chandrajit Bajaj

Recent advances in deep clustering and unsupervised representation learning are based on the idea that different views of an input image (generated through data augmentation techniques) must either be closer in the representation space, or…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Jayanth Reddy Regatti , Aniket Anand Deshmukh , Eren Manavoglu , Urun Dogan

Class-imbalanced datasets are known to cause the problem of model being biased towards the majority classes. In this project, we set up two research questions: 1) when is the class-imbalance problem more prevalent in self-supervised…

Machine Learning · Computer Science 2022-12-23 Hye-min Chang , Sungkyun Chang

Data clustering, the task of grouping observations according to their similarity, is a key component of unsupervised learning -- with real world applications in diverse fields such as biology, medicine, and social science. Often in these…

Machine Learning · Computer Science 2023-09-20 Anne Sophie Riis Damstrup , Sofie Tosti Madsen , Michele Coscia

Image clustering is a very useful technique that is widely applied to various areas, including remote sensing. Recently, visual representations by self-supervised learning have greatly improved the performance of image clustering. To…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Qinglin Li , Guoping Qiu

Traditional image clustering methods take a two-step approach, feature learning and clustering, sequentially. However, recent research results demonstrated that combining the separated phases in a unified framework and training them jointly…

Computer Vision and Pattern Recognition · Computer Science 2017-03-24 Fengfu Li , Hong Qiao , Bo Zhang , Xuanyang Xi

The downfall of many supervised learning algorithms, such as neural networks, is the inherent need for a large amount of training data. Although there is a lot of buzz about big data, there is still the problem of doing classification from…

Machine Learning · Computer Science 2015-09-08 Armen Aghajanyan

Combining clustering and representation learning is one of the most promising approaches for unsupervised learning of deep neural networks. However, doing so naively leads to ill posed learning problems with degenerate solutions. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-02-20 Yuki Markus Asano , Christian Rupprecht , Andrea Vedaldi

Recently, representation learning with contrastive learning algorithms has been successfully applied to challenging unlabeled datasets. However, these methods are unable to distinguish important features from unimportant ones under simply…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Toshiyuki Oshima , Kentaro Takagi , Kouta Nakata

Given a large unlabeled set of images, how to efficiently and effectively group them into clusters based on extracted visual representations remains a challenging problem. To address this problem, we propose a convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2017-08-14 Chih-Chung Hsu , Chia-Wen Lin