English
Related papers

Related papers: Efficient Unsupervised Visual Representation Learn…

200 papers

In this work we used unsupervised machine learning methods in order to find possible clustering structures in superconducting materials data sets. We used the SuperCon database, as well as our own data sets complied from literature, in…

Superconductivity · Physics 2022-07-13 B. Roter , N. Ninkovic , S. V. Dordevic

We propose a self-supervised Gaussian ATtention network for image Clustering (GATCluster). Rather than extracting intermediate features first and then performing the traditional clustering algorithm, GATCluster directly outputs semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Chuang Niu , Jun Zhang , Ge Wang , Jimin Liang

We propose a realistic scenario for the unsupervised video learning where neither task boundaries nor labels are provided when learning a succession of tasks. We also provide a non-parametric learning solution for the under-explored problem…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Nattapong Kurpukdee , Adrian G. Bors

Current generative models, such as autoregressive and diffusion approaches, decompose high-dimensional data distribution learning into a series of simpler subtasks. However, inherent conflicts arise during the joint optimization of these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Ruixiao Dong , Mengde Xu , Zigang Geng , Li Li , Han Hu , Shuyang Gu

We witnessed a massive growth in the supervised learning paradigm in the past decade. Supervised learning requires a large amount of labeled data to reach state-of-the-art performance. However, labeling the samples requires a lot of human…

Computer Vision and Pattern Recognition · Computer Science 2021-11-04 Mrinal Anand , Aditya Garg

As a pioneering work, PointContrast conducts unsupervised 3D representation learning via leveraging contrastive learning over raw RGB-D frames and proves its effectiveness on various downstream tasks. However, the trend of large-scale…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Xiaoyang Wu , Xin Wen , Xihui Liu , Hengshuang Zhao

Face clustering tasks can learn hierarchical semantic information from large-scale data, which has the potential to help facilitate face recognition. However, there are few works on this problem. This paper explores it by proposing a joint…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Zhenduo Zhang

The application of machine learning in the study of phase transitions has achieved remarkable success in both equilibrium and non-equilibrium systems. It is widely recognized that unsupervised learning can retrieve phase transition…

Statistical Mechanics · Physics 2024-12-10 Dian Xu , Shanshan Wang , Weibing Deng , Feng Gao , Wei Li , Jianmin Shen

The advent of large pre-trained models has brought about a paradigm shift in both visual representation learning and natural language processing. However, clustering unlabeled images, as a fundamental and classic machine learning problem,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Tianzhe Chu , Shengbang Tong , Tianjiao Ding , Xili Dai , Benjamin David Haeffele , René Vidal , Yi Ma

Learning from fully-unlabeled data is challenging in Multimedia Forensics problems, such as Person Re-Identification and Text Authorship Attribution. Recent self-supervised learning methods have shown to be effective when dealing with…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Gabriel Bertocco , Antônio Theophilo , Fernanda Andaló , Anderson Rocha

A deep clustering model conceptually consists of a feature extractor that maps data points to a latent space, and a clustering head that groups data points into clusters in the latent space. Although the two components used to be trained…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Xingzhi Zhou , Nevin L. Zhang

An ideal learned representation should display transferability and robustness. Supervised contrastive learning (SupCon) is a promising method for training accurate models, but produces representations that do not capture these properties…

Multi-view clustering can explore common semantics from multiple views and has received increasing attention in recent years. However, current methods focus on learning consistency in representation, neglecting the contribution of each…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Bo Li , Jing Yun

Unsupervised representation learning has significantly advanced various machine learning tasks. In the computer vision domain, state-of-the-art approaches utilize transformations like random crop and color jitter to achieve invariant…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Jaemyung Yu , Jaehyun Choi , Dong-Jae Lee , HyeongGwon Hong , Junmo Kim

Contrastive learning has been frequently investigated to learn effective representations for text clustering tasks. While existing contrastive learning-based text clustering methods only focus on modeling instance-wise semantic similarity…

Computation and Language · Computer Science 2024-08-27 Qian Yong , Chen Chen , Xiabing Zhou

While deep neural networks have become the go-to approach in computer vision, the vast majority of these models fail to properly capture the uncertainty inherent in their predictions. Estimating this predictive uncertainty can be crucial,…

Machine Learning · Computer Science 2020-04-08 Fredrik K. Gustafsson , Martin Danelljan , Thomas B. Schön

Unsupervised feature learning has made great strides with contrastive learning based on instance discrimination and invariant mapping, as benchmarked on curated class-balanced datasets. However, natural data could be highly correlated and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Xudong Wang , Ziwei Liu , Stella X. Yu

Unsupervised learning methods have a soft inspiration in cognition models. To this day, the most successful unsupervised learning methods revolve around clustering samples in a mathematical space. In this paper we propose a primitive-based,…

Artificial Intelligence · Computer Science 2025-07-04 Alfredo Ibias , Hector Antona , Guillem Ramirez-Miranda , Enric Guinovart , Eduard Alarcon

Current supervised cross-domain image retrieval methods can achieve excellent performance. However, the cost of data collection and labeling imposes an intractable barrier to practical deployment in real applications. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Conghui Hu , Gim Hee Lee

Self-supervised learning aims to learn good representations with unlabeled data. Recent works have shown that larger models benefit more from self-supervised learning than smaller models. As a result, the gap between supervised and…

Computer Vision and Pattern Recognition · Computer Science 2020-10-29 Soroush Abbasi Koohpayegani , Ajinkya Tejankar , Hamed Pirsiavash