English
Related papers

Related papers: Efficient Unsupervised Visual Representation Learn…

200 papers

Clustering of hyperspectral images is a fundamental but challenging task. The recent development of hyperspectral image clustering has evolved from shallow models to deep and achieved promising results in many benchmark datasets. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Yaoming Cai , Zijia Zhang , Yan Liu , Pedram Ghamisi , Kun Li , Xiaobo Liu , Zhihua Cai

Subtype Discovery consists in finding interpretable and consistent sub-parts of a dataset, which are also relevant to a certain supervised task. From a mathematical point of view, this can be defined as a clustering task driven by…

Machine Learning · Statistics 2021-07-06 Robin Louiset , Pietro Gori , Benoit Dufumier , Josselin Houenou , Antoine Grigis , Edouard Duchesnay

In supervised deep learning, learning good representations for remote--sensing images (RSI) relies on manual annotations. However, in the area of remote sensing, it is hard to obtain huge amounts of labeled data. Recently, self--supervised…

Machine Learning · Computer Science 2022-09-27 Qinglin Li , Bin Li , Jonathan M Garibaldi , Guoping Qiu

We introduce Consistent Assignment for Representation Learning (CARL), an unsupervised learning method to learn visual representations by combining ideas from self-supervised contrastive learning and deep clustering. By viewing contrastive…

Machine Learning · Computer Science 2023-10-23 Thalles Silva , Adín Ramírez Rivera

The lack of large labeled medical imaging datasets, along with significant inter-individual variability compared to clinically established disease classes, poses significant challenges in exploiting medical imaging information in a…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Matteo Ferrante , Tommaso Boccato , Simeon Spasov , Andrea Duggento , Nicola Toschi

We present a novel approach for unsupervised activity segmentation which uses video frame clustering as a pretext task and simultaneously performs representation learning and online clustering. This is in contrast with prior works where…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Sateesh Kumar , Sanjay Haresh , Awais Ahmed , Andrey Konin , M. Zeeshan Zia , Quoc-Huy Tran

Dataset bias is a critical challenge in machine learning since it often leads to a negative impact on a model due to the unintended decision rules captured by spurious correlations. Although existing works often handle this issue based on…

Machine Learning · Computer Science 2022-04-05 Seonguk Seo , Joon-Young Lee , Bohyung Han

This work presents an unsupervised deep discriminant analysis for clustering. The method is based on deep neural networks and aims to minimize the intra-cluster discrepancy and maximize the inter-cluster discrepancy in an unsupervised…

Machine Learning · Computer Science 2022-06-13 Jinyu Cai , Wenzhong Guo , Jicong Fan

Vision transformers combined with self-supervised learning have enabled the development of models which scale across large datasets for several downstream tasks like classification, segmentation and detection. The low-shot learning…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Srinivasa Rao Nandam , Sara Atito , Zhenhua Feng , Josef Kittler , Muhammad Awais

This paper presents a novel method for face clustering in videos using a video-centralised transformer. Previous works often employed contrastive learning to learn frame-level representation and used average pooling to aggregate the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Yujiang Wang , Mingzhi Dong , Jie Shen , Yiming Luo , Yiming Lin , Pingchuan Ma , Stavros Petridis , Maja Pantic

Self-supervised learning (SSL) is a scalable way to learn general visual representations since it learns without labels. However, large-scale unlabeled datasets in the wild often have long-tailed label distributions, where we know little…

Machine Learning · Computer Science 2022-05-24 Hong Liu , Jeff Z. HaoChen , Adrien Gaidon , Tengyu Ma

Building accurate and robust artificial intelligence systems for medical image assessment requires not only the research and design of advanced deep learning models but also the creation of large and curated sets of annotated training…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Florin C. Ghesu , Bogdan Georgescu , Awais Mansoor , Youngjin Yoo , Dominik Neumann , Pragneshkumar Patel , R. S. Vishwanath , James M. Balter , Yue Cao , Sasa Grbic , Dorin Comaniciu

Clustering is one of the fundamental tasks in computer vision and pattern recognition. Recently, deep clustering methods (algorithms based on deep learning) have attracted wide attention with their impressive performance. Most of these…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Yanhai Gan , Xinghui Dong , Huiyu Zhou , Feng Gao , Junyu Dong

Deep clustering as an important branch of unsupervised representation learning focuses on embedding semantically similar samples into the identical feature space. This core demand inspires the exploration of contrastive learning and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Haifeng Xia , Hai Huang , Zhengming Ding

Self-supervised learning aims to learn representations from the data itself without explicit manual supervision. Existing efforts ignore a crucial aspect of self-supervised learning - the ability to scale to large amount of data because…

Computer Vision and Pattern Recognition · Computer Science 2019-06-07 Priya Goyal , Dhruv Mahajan , Abhinav Gupta , Ishan Misra

Despite significant advances in clustering methods in recent years, the outcome of clustering of a natural image dataset is still unsatisfactory due to two important drawbacks. Firstly, clustering of images needs a good feature…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Dipanjan Das , Ratul Ghosh , Brojeshwar Bhowmick

Joint clustering and feature learning methods have shown remarkable performance in unsupervised representation learning. However, the training schedule alternating between feature clustering and network parameters update leads to unstable…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Xiaohang Zhan , Jiahao Xie , Ziwei Liu , Yew Soon Ong , Chen Change Loy

Image clustering is an important and open-challenging task in computer vision. Although many methods have been proposed to solve the image clustering task, they only explore images and uncover clusters according to the image features, thus…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Shaotian Cai , Liping Qiu , Xiaojun Chen , Qin Zhang , Longteng Chen

Deep clustering outperforms conventional clustering by mutually promoting representation learning and cluster assignment. However, most existing deep clustering methods suffer from two major drawbacks. First, most cluster assignment methods…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Hanxuan Wang , Na Lu , Qinyang Liu

The goal of unsupervised representation learning is to extract a new representation of data, such that solving many different tasks becomes easier. Existing methods typically focus on vectorized data and offer little support for relational…

Machine Learning · Statistics 2017-09-29 Sebastijan Dumancic , Hendrik Blockeel