中文
相关论文

相关论文: Cluster Contrast for Unsupervised Visual Represent…

200 篇论文

This paper presents CLUSTERFORMER, a universal vision model that is based on the CLUSTERing paradigm with TransFORMER. It comprises two novel designs: 1. recurrent cross-attention clustering, which reformulates the cross-attention mechanism…

计算机视觉与模式识别 · 计算机科学 2023-10-09 James C. Liang , Yiming Cui , Qifan Wang , Tong Geng , Wenguan Wang , Dongfang Liu

Medical image analysis using supervised deep learning methods remains problematic because of the reliance of deep learning methods on large amounts of labelled training data. Although medical imaging data repositories continue to expand…

计算机视觉与模式识别 · 计算机科学 2019-06-11 Euijoon Ahn , Ashnil Kumar , Dagan Feng , Michael Fulham , Jinman Kim

We propose Few-Example Clustering (FEC), a novel algorithm that performs contrastive learning to cluster few examples. Our method is composed of the following three steps: (1) generation of candidate cluster assignments, (2) contrastive…

机器学习 · 计算机科学 2022-07-12 Minguk Jang , Sae-Young Chung

Contrastive learning relies on constructing a collection of negative examples that are sufficiently hard to discriminate against positive queries when their representations are self-trained. Existing contrastive learning methods either…

机器学习 · 计算机科学 2021-03-08 Qianjiang Hu , Xiao Wang , Wei Hu , Guo-Jun Qi

Aligning distributions of view representations is a core component of today's state of the art models for deep multi-view clustering. However, we identify several drawbacks with na\"ively aligning representation distributions. We…

计算机视觉与模式识别 · 计算机科学 2021-03-16 Daniel J. Trosten , Sigurd Løkse , Robert Jenssen , Michael Kampffmeyer

Unsupervised visible-infrared person re-identification (USVI-ReID) aims to match specified people in infrared images to visible images without annotations, and vice versa. USVI-ReID is a challenging yet under-explored task. Most existing…

计算机视觉与模式识别 · 计算机科学 2024-10-25 Jiangming Shi , Xiangbo Yin , Yachao Zhang , Zhizhong Zhang , Yuan Xie , Yanyun Qu

Contrastive learning has proven to be highly efficient and adaptable in shaping representation spaces across diverse modalities by pulling similar samples together and pushing dissimilar ones apart. However, two key limitations persist: (1)…

机器学习 · 计算机科学 2025-12-08 Ziwen Wang , Jiajun Fan , Thao Nguyen , Heng Ji , Ge Liu

Unsupervised person re-identification (Re-ID) is a promising and very challenging research problem in computer vision. Learning robust and discriminative features with unlabeled data is of central importance to Re-ID. Recently, more…

计算机视觉与模式识别 · 计算机科学 2022-05-12 Zheng Hu , Chuang Zhu , Gang He

The high efficiency in computation and storage makes hashing (including binary hashing and quantization) a common strategy in large-scale retrieval systems. To alleviate the reliance on expensive annotations, unsupervised deep hashing…

计算机视觉与模式识别 · 计算机科学 2022-03-09 Jinpeng Wang , Ziyun Zeng , Bin Chen , Tao Dai , Shu-Tao Xia

Graph clustering is a crucial task in network analysis with widespread applications, focusing on partitioning nodes into distinct groups with stronger intra-group connections than inter-group ones. Recently, contrastive learning has…

机器学习 · 计算机科学 2024-08-20 Xunlian Wu , Jingqi Hu , Anqi Zhang , Yining Quan , Qiguang Miao , Peng Gang Sun

Contrastive representation learning has been recently proved to be very efficient for self-supervised training. These methods have been successfully used to train encoders which perform comparably to supervised training on downstream…

机器学习 · 计算机科学 2020-12-03 Ibrahim Merad , Yiyang Yu , Emmanuel Bacry , Stéphane Gaïffas

Contrastive learning is a well-established paradigm in representation learning. The standard framework of contrastive learning minimizes the distance between "similar" instances and maximizes the distance between dissimilar ones in the…

机器学习 · 计算机科学 2025-02-06 Naghmeh Ghanooni , Barbod Pajoum , Harshit Rawal , Sophie Fellenz , Vo Nguyen Le Duy , Marius Kloft

Self-supervised learning enables networks to learn discriminative features from massive data itself. Most state-of-the-art methods maximize the similarity between two augmentations of one image based on contrastive learning. By utilizing…

计算机视觉与模式识别 · 计算机科学 2023-07-05 Jidong Ge , Yuxiang Liu , Jie Gui , Lanting Fang , Ming Lin , James Tin-Yau Kwok , LiGuo Huang , Bin Luo

The rapid growth of unlabeled time series data, driven by the Internet of Things (IoT), poses significant challenges in uncovering underlying patterns. Traditional unsupervised clustering methods often fail to capture the complex nature of…

机器学习 · 计算机科学 2025-03-31 Congyu Wang , Mingjing Du , Xiang Jiang , Yongquan Dong

Contrastive learning is a discriminative approach that aims at grouping similar samples closer and diverse samples far from each other. It it an efficient technique to train an encoder generating distinguishable and informative…

计算机视觉与模式识别 · 计算机科学 2021-07-19 Qing Chen , Jian Zhang

State-of-the-art pre-trained image models predominantly adopt a two-stage approach: initial unsupervised pre-training on large-scale datasets followed by task-specific fine-tuning using Cross-Entropy loss~(CE). However, it has been…

计算机视觉与模式识别 · 计算机科学 2024-11-18 Zijun Long , George Killick , Lipeng Zhuang , Gerardo Aragon-Camarasa , Zaiqiao Meng , Richard Mccreadie

We propose a framework for sequence-to-sequence contrastive learning (SeqCLR) of visual representations, which we apply to text recognition. To account for the sequence-to-sequence structure, each feature map is divided into different…

计算机视觉与模式识别 · 计算机科学 2020-12-22 Aviad Aberdam , Ron Litman , Shahar Tsiper , Oron Anschel , Ron Slossberg , Shai Mazor , R. Manmatha , Pietro Perona

Advanced self-supervised visual representation learning methods rely on the instance discrimination (ID) pretext task. We point out that the ID task has an implicit semantic consistency (SC) assumption, which may not hold in unconstrained…

计算机视觉与模式识别 · 计算机科学 2021-08-19 Yucheng Zhao , Guangting Wang , Chong Luo , Wenjun Zeng , Zheng-Jun Zha

Part feature learning is critical for fine-grained semantic understanding in vehicle re-identification. However, existing approaches directly model part features and global features, which can easily lead to serious gradient vanishing…

计算机视觉与模式识别 · 计算机科学 2023-03-17 Fei Shen , Xiaoyu Du , Liyan Zhang , Xiangbo Shu , Jinhui Tang

Multi-view contrastive clustering (MVCC) has gained significant attention for generating consistent clustering structures from multiple views through contrastive learning. However, most existing MVCC methods create cross-views by combining…

计算机视觉与模式识别 · 计算机科学 2025-01-24 Hanning Yuan , Zhihui Zhang , Qi Guo , Lianhua Chi , Sijie Ruan , Jinhui Pang , Xiaoshuai Hao