English
Related papers

Related papers: Center-Oriented Prototype Contrastive Clustering

200 papers

Unsupervised learning has recently made exceptional progress because of the development of more effective contrastive learning methods. However, CNNs are prone to depend on low-level features that humans deem non-semantic. This dependency…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Songwei Ge , Shlok Mishra , Haohan Wang , Chun-Liang Li , David Jacobs

Annotating large-scale point clouds is highly time-consuming and often infeasible for many complex real-world tasks. Point cloud pre-training has therefore become a promising strategy for learning discriminative representations without…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Guofeng Mei , Xiaoshui Huang , Juan Liu , Jian Zhang , Qiang Wu

Self-supervised learning (especially contrastive learning) has attracted great interest due to its huge potential in learning discriminative representations in an unsupervised manner. Despite the acknowledged successes, existing contrastive…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Guangrun Wang , Keze Wang , Guangcong Wang , Philip H. S. Torr , Liang Lin

Weakly Supervised Semantic Segmentation (WSSS) with image-level labels has gained attention for its cost-effectiveness. Most existing methods emphasize inter-class separation, often neglecting the shared semantics among related categories…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Wangyu Wu , Zhenhong Chen , Xiaowen Ma , Wenqiao Zhang , Xianglin Qiu , Siqi Song , Xiaowei Huang , Fei Ma , Jimin Xiao

Representations of events described in text are important for various tasks. In this work, we present SWCC: a Simultaneous Weakly supervised Contrastive learning and Clustering framework for event representation learning. SWCC learns event…

Computation and Language · Computer Science 2022-03-16 Jun Gao , Wei Wang , Changlong Yu , Huan Zhao , Wilfred Ng , Ruifeng Xu

Contrastive approaches to representation learning have recently shown great promise. In contrast to generative approaches, these contrastive models learn a deterministic encoder with no notion of uncertainty or confidence. In this paper, we…

Machine Learning · Computer Science 2020-10-06 Mike Wu , Noah Goodman

We study supervised learning problems using clustering constraints to impose structure on either features or samples, seeking to help both prediction and interpretation. The problem of clustering features arises naturally in text…

Machine Learning · Computer Science 2016-09-20 Vincent Roulet , Fajwel Fogel , Alexandre d'Aspremont , Francis Bach

Unsupervised contrastive learning has become a hot research topic in natural language processing. Existing works usually aim at constraining the orientation distribution of the representations of positive and negative samples in the…

Computation and Language · Computer Science 2025-05-08 Tianyu Zong , Hongzhu Yi , Bingkang Shi , Yuanxiang Wang , Jungang Xu

Contrastive representation learning has proven to be an effective self-supervised learning method. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as positives that should be…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault , Stéphane Canu

Contrastive, self-supervised learning of object representations recently emerged as an attractive alternative to reconstruction-based training. Prior approaches focus on contrasting individual object representations (slots) against one…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Sindy Löwe , Klaus Greff , Rico Jonschkowski , Alexey Dosovitskiy , Thomas Kipf

Transformations in the input space of Deep Neural Networks (DNN) lead to unintended changes in the feature space. Almost perceptually identical inputs, such as adversarial examples, can have significantly distant feature representations. On…

Machine Learning · Computer Science 2022-11-29 Iordanis Fostiropoulos , Laurent Itti

Learning a powerful representation from point clouds is a fundamental and challenging problem in the field of computer vision. Different from images where RGB pixels are stored in the regular grid, for point clouds, the underlying semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-01-28 Feng Yang , Yichao Cao , Qifan Xue , Shuai Jin , Xuanpeng Li , Weigong Zhang

Current state-of-the-art object-centric models use slots and attention-based routing for binding. However, this class of models has several conceptual limitations: the number of slots is hardwired; all slots have equal capacity; training…

Machine Learning · Computer Science 2023-11-10 Aleksandar Stanić , Anand Gopalakrishnan , Kazuki Irie , Jürgen Schmidhuber

Clustering algorithms rely on complex optimisation processes that may be difficult to comprehend, especially for individuals who lack technical expertise. While many explainable artificial intelligence techniques exist for supervised…

Machine Learning · Computer Science 2024-09-20 Aurora Spagnol , Kacper Sokol , Pietro Barbiero , Marc Langheinrich , Martin Gjoreski

In object re-identification (ReID), the development of deep learning techniques often involves model updates and deployment. It is unbearable to re-embedding and re-index with the system suspended when deploying new models. Therefore,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Shengsen Wu , Liang Chen , Yihang Lou , Yan Bai , Tao Bai , Minghua Deng , Lingyu Duan

We propose a novel clustering approach for point-cloud segmentation based on supervised contrastive metric learning (CML). Rather than predicting cluster assignments or object-centric variables, the method learns a latent representation in…

High Energy Physics - Experiment · Physics 2026-03-25 Max Marriott-Clarke , Lazar Novakovic , Elizabeth Ratzer , Robert J. Bainbridge , Loukas Gouskos , Benedikt Maier

Cross-modality distillation arises as an important topic for data modalities containing limited knowledge such as depth maps and high-quality sketches. Such techniques are of great importance, especially for memory and privacy-restricted…

Machine Learning · Computer Science 2024-05-29 Hangyu Lin , Chen Liu , Chengming Xu , Zhengqi Gao , Yanwei Fu , Yuan Yao

Contrastive learning, a dominant self-supervised technique, emphasizes similarity in representations between augmentations of the same input and dissimilarity for different ones. Although low contrastive loss often correlates with high…

Machine Learning · Computer Science 2023-11-22 Yunzhe Zhang , Yao Lu , Qi Xuan

We propose a novel framework for image clustering that incorporates joint representation learning and clustering. Our method consists of two heads that share the same backbone network - a "representation learning" head and a "clustering"…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Kien Do , Truyen Tran , Svetha Venkatesh

Contrastive learning has significantly improved representation quality, enhancing knowledge transfer across tasks in continual learning (CL). However, catastrophic forgetting remains a key challenge, as contrastive based methods primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Trung-Anh Dang , Vincent Nguyen , Ngoc-Son Vu , Christel Vrain