English
Related papers

Related papers: Deep Contrastive Multi-view Clustering under Seman…

200 papers

High-dimensional and complex spectral structures make the clustering of hyperspectral images (HSI) a challenging task. Subspace clustering is an effective approach for addressing this problem. However, current subspace clustering algorithms…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Renxiang Guan , Zihao Li , Xianju Li , Chang Tang , Ruyi Feng

Semi-supervised semantic segmentation needs rich and robust supervision on unlabeled data. Consistency learning enforces the same pixel to have similar features in different augmented views, which is a robust signal but neglects…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Yunzhong Hou , Stephen Gould , Liang Zheng

Prior work has offered evidence for functional localization in the brain; different anatomical regions preferentially activate for certain types of visual input. For example, the fusiform face area preferentially activates for visual…

Machine Learning · Computer Science 2024-10-02 Cory Efird , Alex Murphy , Joel Zylberberg , Alona Fyshe

Contrastive vision-language models continue to be the dominant approach for image and text retrieval. Contrastive Language-Image Pre-training (CLIP) trains two neural networks in contrastive manner to align their image and text embeddings…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Kwun Ho Ngan , Saman Sadeghi Afgeh , Joe Townsend , Artur d'Avila Garcez

Contrastive learning based on instance discrimination trains model to discriminate different transformations of the anchor sample from other samples, which does not consider the semantic similarity among samples. This paper proposes a new…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Hao Li , Xiaopeng Zhang , Hongkai Xiong

Contrastive learning allows us to flexibly define powerful losses by contrasting positive pairs from sets of negative samples. Recently, the principle has also been used to learn cross-modal embeddings for video and text, yet without…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Mohammadreza Zolfaghari , Yi Zhu , Peter Gehler , Thomas Brox

Deep clustering has attracted increasing attention in recent years due to its capability of joint representation learning and clustering via deep neural networks. In its latest developments, the contrastive learning has emerged as an…

Machine Learning · Computer Science 2022-07-15 Xiaozhi Deng , Dong Huang , Ding-Hua Chen , Chang-Dong Wang , Jian-Huang Lai

Multimodal models, such as the Contrastive Language-Image Pre-training (CLIP) model, have demonstrated remarkable success in aligning visual and linguistic representations. However, these models exhibit limitations when applied to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Hiroshi Sasaki

The impressive performance of GPT-3 using natural language prompts and in-context learning has inspired work on better fine-tuning of moderately-sized models under this paradigm. Following this line of work, we present a contrastive…

Computation and Language · Computer Science 2022-05-04 Yiren Jian , Chongyang Gao , Soroush Vosoughi

The field of deep clustering combines deep learning and clustering to learn representations that improve both the learned representation and the performance of the considered clustering method. Most existing deep clustering methods are…

Machine Learning · Computer Science 2023-02-22 Lukas Miklautz , Martin Teuffenbach , Pascal Weber , Rona Perjuci , Walid Durani , Christian Böhm , Claudia Plant

Human Activity Recognition is a field of research where input data can take many forms. Each of the possible input modalities describes human behaviour in a different way, and each has its own strengths and weaknesses. We explore the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Razvan Brinzea , Bulat Khaertdinov , Stylianos Asteriadis

In speaker verification, contrastive learning is gaining popularity as an alternative to the traditionally used classification-based approaches. Contrastive methods can benefit from an effective use of hard negative pairs, which are…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-26 Piotr Masztalski , Michał Romaniuk , Jakub Żak , Mateusz Matuszewski , Konrad Kowalczyk

A good clustering algorithm can discover natural groupings in data. These groupings, if used wisely, provide a form of weak supervision for learning representations. In this work, we present Clustering-based Contrastive Learning (CCL), a…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Vivek Sharma , Makarand Tapaswi , M. Saquib Sarfraz , Rainer Stiefelhagen

Dense correspondence across semantically related images has been extensively studied, but still faces two challenges: 1) large variations in appearance, scale and pose exist even for objects from the same category, and 2) labeling…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Taihong Xiao , Sifei Liu , Shalini De Mello , Zhiding Yu , Jan Kautz , Ming-Hsuan Yang

Contrastive learning (CL) has recently been applied to adversarial learning tasks. Such practice considers adversarial samples as additional positive views of an instance, and by maximizing their agreements with each other, yields better…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Qiying Yu , Jieming Lou , Xianyuan Zhan , Qizhang Li , Wangmeng Zuo , Yang Liu , Jingjing Liu

Unsupervised learning has recently made exceptional progress because of the development of more effective contrastive learning methods. However, CNNs are prone to depend on low-level features that humans deem non-semantic. This dependency…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Songwei Ge , Shlok Mishra , Haohan Wang , Chun-Liang Li , David Jacobs

Hierarchical semantic structures naturally exist in an image dataset, in which several semantically relevant image clusters can be further integrated into a larger cluster with coarser-grained semantics. Capturing such structures with image…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Yuanfan Guo , Minghao Xu , Jiawen Li , Bingbing Ni , Xuanyu Zhu , Zhenbang Sun , Yi Xu

Multi-view Clustering (MVC) has achieved significant progress, with many efforts dedicated to learn knowledge from multiple views. However, most existing methods are either not applicable or require additional steps for incomplete MVC. Such…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Junjie Liu , Junlong Liu , Rongxin Jiang , Yaowu Chen , Chen Shen , Jieping Ye

The clustering of unlabeled raw images is a daunting task, which has recently been approached with some success by deep learning methods. Here we propose an unsupervised clustering framework, which learns a deep neural network in an…

Computer Vision and Pattern Recognition · Computer Science 2020-12-16 Guy Shiran , Daphna Weinshall

Contrastive learning has revolutionized the field of computer vision, learning rich representations from unlabeled data, which generalize well to diverse vision tasks. Consequently, it has become increasingly important to explain these…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Fawaz Sammani , Boris Joukovsky , Nikos Deligiannis