English
Related papers

Related papers: Semantic-Enhanced Image Clustering

200 papers

We introduce a method that allows to automatically segment images into semantically meaningful regions without human supervision. Derived regions are consistent across different images and coincide with human-defined semantic classes on…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Daniil Pakhomov , Sanchit Hira , Narayani Wagle , Kemar E. Green , Nassir Navab

Automatically discovering image categories in unlabeled natural images is one of the important goals of unsupervised learning. However, the task is challenging and even human beings define visual categories based on a large amount of prior…

Computer Vision and Pattern Recognition · Computer Science 2016-12-06 Yen-Chang Hsu , Zhaoyang Lv , Zsolt Kira

While deep learning strategies achieve outstanding results in computer vision tasks, one issue remains: The current strategies rely heavily on a huge amount of labeled data. In many real-world problems, it is not feasible to create such an…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Lars Schmarje , Monty Santarossa , Simon-Martin Schröder , Reinhard Koch

Contrastive Language-Image Pre-training (CLIP) has recently shown great promise in pixel-level zero-shot learning tasks. However, existing approaches utilizing CLIP's text and patch embeddings to generate semantic masks often misidentify…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Jingyao Li , Pengguang Chen , Shengju Qian , Shu Liu , Jiaya Jia

Recently, CLIP has been applied to pixel-level zero-shot learning tasks via a two-stage scheme. The general idea is to first generate class-agnostic region proposals and then feed the cropped proposal regions to CLIP to utilize its…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Ziqin Zhou , Bowen Zhang , Yinjie Lei , Lingqiao Liu , Yifan Liu

Recent progress has shown that large-scale pre-training using contrastive image-text pairs can be a promising alternative for high-quality visual representation learning from natural language supervision. Benefiting from a broader source of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Yongming Rao , Wenliang Zhao , Guangyi Chen , Yansong Tang , Zheng Zhu , Guan Huang , Jie Zhou , Jiwen Lu

Generalized Category Discovery (GCD) requires a model to both classify known categories and cluster unknown categories in unlabeled data. Prior methods leveraged self-supervised pre-training combined with supervised fine-tuning on the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Rabah Ouldnoughi , Chia-Wen Kuo , Zsolt Kira

Computer vision tasks are traditionally defined and evaluated using semantic categories. However, it is known to the field that semantic classes do not necessarily correspond to a unique visual class (e.g. inside and outside of a car).…

Computer Vision and Pattern Recognition · Computer Science 2014-05-27 Hossein Azizpour , Stefan Carlsson

Contrastive Language-Image Pretraining (CLIP) performs zero-shot image classification by mapping images and textual class representation into a shared embedding space, then retrieving the class closest to the image. This work provides a new…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Fawaz Sammani , Nikos Deligiannis

In computer vision, image segmentation is always selected as a major research topic by researchers. Due to its vital rule in image processing, there always arises the need of a better image segmentation method. Clustering is an unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2015-06-08 Dibya Jyoti Bora , Anil Kumar Gupta

Semantic segmentation is a fundamental task in medical image analysis and autonomous driving and has a problem with the high cost of annotating the labels required in training. To address this problem, semantic segmentation methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Nagito Saito , Shintaro Ito , Koichi Ito , Takafumi Aoki

While convolution and self-attention are extensively used in learned image compression (LIC) for transform coding, this paper proposes an alternative called Contextual Clustering based LIC (CLIC) which primarily relies on clustering…

Image and Video Processing · Electrical Eng. & Systems 2024-01-23 Yichi Zhang , Zhihao Duan , Ming Lu , Dandan Ding , Fengqing Zhu , Zhan Ma

Unsupervised person re-identification (re-ID) has become an important topic due to its potential to resolve the scalability problem of supervised re-ID models. However, existing methods simply utilize pseudo labels from clustering for…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Junhui Yin , Jiayan Qiu , Siqing Zhang , Jiyang Xie , Zhanyu Ma , Jun Guo

Recent developed deep unsupervised methods allow us to jointly learn representation and cluster unlabelled data. These deep clustering methods mainly focus on the correlation among samples, e.g., selecting high precision pairs to gradually…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Jianlong Wu , Keyu Long , Fei Wang , Chen Qian , Cheng Li , Zhouchen Lin , Hongbin Zha

We propose to bridge the gap between semi-supervised and unsupervised image recognition with a flexible method that performs well for both generalized category discovery (GCD) and image clustering. Despite the overlap in motivation between…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Gihan Jayatilaka , Abhinav Shrivastava , Matthew Gwilliam

We introduce Correlational Image Modeling (CIM), a novel and surprisingly effective approach to self-supervised visual pre-training. Our CIM performs a simple pretext task: we randomly crop image regions (exemplars) from an input image…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Wei Li , Jiahao Xie , Chen Change Loy

Contrastive Language-Image Pre-training (CLIP) provides a foundation model by integrating natural language into visual concepts, enabling zero-shot recognition on downstream tasks. It is usually expected that satisfactory overall accuracy…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Jie-Jing Shao , Jiang-Xin Shi , Xiao-Wen Yang , Lan-Zhe Guo , Yu-Feng Li

Unsupervised image clustering methods often introduce alternative objectives to indirectly train the model and are subject to faulty predictions and overconfident results. To overcome these challenges, the current research proposes an…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Sungwon Park , Sungwon Han , Sundong Kim , Danu Kim , Sungkyu Park , Seunghoon Hong , Meeyoung Cha

Hyperspectral image (HSI) clustering is gaining considerable attention owing to recent methods that overcome the inefficiency and misleading results from the absence of supervised information. Contrastive learning methods excel at existing…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Renxiang Guan , Zihao Li , Xianju Li , Chang Tang

Fine-tuning vision-language models (VLMs) like CLIP to downstream tasks is often necessary to optimize their performance. However, a major obstacle is the limited availability of labeled data. We study the use of pseudolabels, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Cristina Menghini , Andrew Delworth , Stephen H. Bach