English
Related papers

Related papers: Towards Fine-grained Visual Representations by Com…

200 papers

Convolutional Neural Networks (CNNs) have demonstrated great results for the single-image super-resolution (SISR) problem. Currently, most CNN algorithms promote deep and computationally expensive models to solve SISR. However, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Vandit Jain , Prakhar Bansal , Abhinav Kumar Singh , Rajeev Srivastava

Contrastive learning has emerged as an essential approach for self-supervised learning in visual representation learning. The central objective of contrastive learning is to maximize the similarities between two augmented versions of an…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Hengkui Dong , Xianzhong Long , Yun Li , Lei Chen

Unsupervised cell type identification is crucial for uncovering and characterizing heterogeneous populations in single cell omics studies. Although a range of clustering methods have been developed, most focus exclusively on intrinsic…

Artificial Intelligence · Computer Science 2025-12-12 Liang Peng , Haopeng Liu , Yixuan Ye , Cheng Liu , Wenjun Shen , Si Wu , Hau-San Wong

Colonoscopic video retrieval, which is a critical part of polyp treatment, has great clinical significance for the prevention and treatment of colorectal cancer. However, retrieval models trained on action recognition datasets usually…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Qingzhong Chen , Shilun Cai , Crystal Cai , Zefang Yu , Dahong Qian , Suncheng Xiang

Learning visual representations of medical images (e.g., X-rays) is core to medical image understanding but its progress has been held back by the scarcity of human annotations. Existing work commonly relies on fine-tuning weights…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Yuhao Zhang , Hang Jiang , Yasuhide Miura , Christopher D. Manning , Curtis P. Langlotz

Contrastive self-supervised learning has attracted significant research attention recently. It learns effective visual representations from unlabeled data by embedding augmented views of the same image close to each other while pushing away…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Yichen Zhang , Yifang Yin , Ying Zhang , Roger Zimmermann

Mainstream 3D representation learning approaches are built upon contrastive or generative modeling pretext tasks, where great improvements in performance on various downstream tasks have been achieved. However, we find these two paradigms…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Zekun Qi , Runpei Dong , Guofan Fan , Zheng Ge , Xiangyu Zhang , Kaisheng Ma , Li Yi

Deep clustering has attracted increasing attention in recent years due to its capability of joint representation learning and clustering via deep neural networks. In its latest developments, the contrastive learning has emerged as an…

Machine Learning · Computer Science 2022-07-15 Xiaozhi Deng , Dong Huang , Ding-Hua Chen , Chang-Dong Wang , Jian-Huang Lai

Contrastive Learning (CL) has recently emerged as a powerful technique in recommendation systems, particularly for its capability to harness self-supervised signals from perturbed views to mitigate the persistent challenge of data sparsity.…

Information Retrieval · Computer Science 2025-04-08 Zheyu Chen , Jinfeng Xu , Yutong Wei , Ziyue Peng

Multiview network embedding aims at projecting nodes in the network to low-dimensional vectors, while preserving their multiple relations and attribute information. Contrastive learning approaches have shown promising performance in this…

Machine Learning · Computer Science 2022-08-18 Mengqi Zhang , Yanqiao Zhu , Qiang Liu , Shu Wu , Liang Wang

Recent advances in unsupervised representation learning often rely on knowing the number of classes to improve feature extraction and clustering. However, this assumption raises an important question: is the number of classes always…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Houwang Jiang , Zhuxian Liu , Guodong Liu , Xiaolong Liu , Shihua Zhan

Attention mechanism has demonstrated great potential in fine-grained visual recognition tasks. In this paper, we present a counterfactual attention learning method to learn more effective attention based on causal inference. Unlike most…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Yongming Rao , Guangyi Chen , Jiwen Lu , Jie Zhou

Visual representation based on covariance matrix has demonstrates its efficacy for image classification by characterising the pairwise correlation of different channels in convolutional feature maps. However, pairwise correlation will…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Saimunur Rahman , Piotr Koniusz , Lei Wang , Luping Zhou , Peyman Moghadam , Changming Sun

Fine-grained visual categorization is to recognize hundreds of subcategories belonging to the same basic-level category, which is a highly challenging task due to the quite subtle and local visual distinctions among similar subcategories.…

Computer Vision and Pattern Recognition · Computer Science 2019-02-21 Xiangteng He , Yuxin Peng

Self-supervised learning (SSL) has emerged as a powerful technique for learning visual representations. While recent SSL approaches achieve strong results in global image understanding, they are limited in capturing the structured…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Oussama Hadjerci , Antoine Letienne , Mohamed Abbas Hedjazi , Adel Hafiane

Self-supervised representation learning has made significant leaps fueled by progress in contrastive learning, which seeks to learn transformations that embed positive input pairs nearby, while pushing negative pairs far apart. While…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Tri Huynh , Simon Kornblith , Matthew R. Walter , Michael Maire , Maryam Khademi

Instance-level Image Retrieval (IIR), or simply Instance Retrieval, deals with the problem of finding all the images within an dataset that contain a query instance (e.g. an object). This paper makes the first attempt that tackles this…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Tao Wu , Tie Luo , Donald Wunsch

Relation extraction (RE), which has relied on structurally annotated corpora for model training, has been particularly challenging in low-resource scenarios and domains. Recent literature has tackled low-resource RE by self-supervised…

Computation and Language · Computer Science 2023-06-01 Wenxuan Zhou , Sheng Zhang , Tristan Naumann , Muhao Chen , Hoifung Poon

This paper presents Prototypical Contrastive Learning (PCL), an unsupervised representation learning method that addresses the fundamental limitations of instance-wise contrastive learning. PCL not only learns low-level features for the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Junnan Li , Pan Zhou , Caiming Xiong , Steven C. H. Hoi

Contrastive learning has emerged as a powerful method in deep learning, excelling at learning effective representations through contrasting samples from different distributions. However, dimensional collapse, where embeddings converge into…

Machine Learning · Computer Science 2025-12-10 Huanran Li , Manh Nguyen , Daniel Pimentel-Alarcón