English
Related papers

Related papers: Triplet Contrastive Representation Learning for Un…

200 papers

Recent developed deep unsupervised methods allow us to jointly learn representation and cluster unlabelled data. These deep clustering methods mainly focus on the correlation among samples, e.g., selecting high precision pairs to gradually…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Jianlong Wu , Keyu Long , Fei Wang , Chen Qian , Cheng Li , Zhouchen Lin , Hongbin Zha

Biologically inspired spiking neural networks (SNNs) have garnered considerable attention due to their low-energy consumption and spatio-temporal information processing capabilities. Most existing SNNs training methods first integrate…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Haonan Qiu , Zeyin Song , Yanqi Chen , Munan Ning , Wei Fang , Tao Sun , Zhengyu Ma , Li Yuan , Yonghong Tian

Contrastive learning (CL) has shown impressive advances in image representation learning in whichever supervised multi-class classification or unsupervised learning. However, these CL methods fail to be directly adapted to multi-label image…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Zhongchen Ma , Lisha Li , Qirong Mao , Songcan Chen

Clustering is the task of gathering similar data samples into clusters without using any predefined labels. It has been widely studied in machine learning literature, and recent advancements in deep learning have revived interest in this…

Machine Learning · Computer Science 2023-09-04 Mohammadreza Sadeghi , Hadi Hojjati , Narges Armanfard

Contrastive self-supervised learning (SSL) learns an embedding space that maps similar data pairs closer and dissimilar data pairs farther apart. Despite its success, one issue has been overlooked: the fairness aspect of representations…

While contrastive learning is proven to be an effective training strategy in computer vision, Natural Language Processing (NLP) is only recently adopting it as a self-supervised alternative to Masked Language Modeling (MLM) for improving…

Computation and Language · Computer Science 2021-09-16 Hooman Sedghamiz , Shivam Raval , Enrico Santus , Tuka Alhanai , Mohammad Ghassemi

Real-scene image super-resolution aims to restore real-world low-resolution images into their high-quality versions. A typical RealSR framework usually includes the optimization of multiple criteria which are designed for different image…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Yukai Shi , Hao Li , Sen Zhang , Zhijing Yang , Xiao Wang

Learning effective visual representations without human supervision is a long-standing problem in computer vision. Recent advances in self-supervised learning algorithms have utilized contrastive learning, with methods such as SimCLR, which…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Jansel Herrera-Gerena , Ramakrishnan Sundareswaran , John Just , Matthew Darr , Ali Jannesari

Contrastive learning has shown impressive success in enhancing feature discriminability for various visual tasks in a self-supervised manner, but the standard contrastive paradigm (features+$\ell_{2}$ normalization) has limited benefits…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Junjie Li , Yixin Zhang , Zilei Wang , Saihui Hou , Keyu Tu , Man Zhang

Heterogeneous graphs (HGs) are composed of multiple types of nodes and edges, making it more effective in capturing the complex relational structures inherent in the real world. However, in real-world scenarios, labeled data is often…

Machine Learning · Computer Science 2025-08-20 Ruobing Jiang , Yacong Li , Haobing Liu , Yanwei Yu

Person re-identification (re-ID) under various occlusions has been a long-standing challenge as person images with different types of occlusions often suffer from misalignment in image matching and ranking. Most existing methods tackle this…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Mengxi Jia , Xinhua Cheng , Shijian Lu , Jian Zhang

Recent advancements in self-supervised learning have demonstrated that effective visual representations can be learned from unlabeled images. This has led to increased interest in applying self-supervised learning to the medical domain,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Xiangyi Yan , Junayed Naushad , Chenyu You , Hao Tang , Shanlin Sun , Kun Han , Haoyu Ma , James Duncan , Xiaohui Xie

Recent work has shown that, when integrated with adversarial training, self-supervised pre-training can lead to state-of-the-art robustness In this work, we improve robustness-aware self-supervised pre-training by learning representations…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Ziyu Jiang , Tianlong Chen , Ting Chen , Zhangyang Wang

The recent breakthrough achieved by contrastive learning accelerates the pace for deploying unsupervised training on real-world data applications. However, unlabeled data in reality is commonly imbalanced and shows a long-tail distribution,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Ziyu Jiang , Tianlong Chen , Bobak Mortazavi , Zhangyang Wang

Contrastive learning is an efficient approach to self-supervised representation learning. Although recent studies have made progress in the theoretical understanding of contrastive learning, the investigation of how to characterize the…

Machine Learning · Computer Science 2023-08-21 Hiroki Waida , Yuichiro Wada , Léo Andéol , Takumi Nakagawa , Yuhui Zhang , Takafumi Kanamori

Prohibited item detection based on X-ray images is one of the most effective security inspection methods. However, the foreground-background feature coupling caused by the overlapping phenomenon specific to X-ray images makes general…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Mingyuan Li , Tong Jia , Hao Wang , Bowen Ma , Hui Lu , Shiyi Guo , Da Cai , Dongyue Chen

Learning cross-view consistent feature representation is the key for accurate vehicle Re-identification (ReID), since the visual appearance of vehicles changes significantly under different viewpoints. To this end, most existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Lu Yang , Hongbang Liu , Jinghao Zhou , Lingqiao Liu , Lei Zhang , Peng Wang , Yanning Zhang

Self-supervised learning (SSL) has emerged as a powerful paradigm for Chest X-ray (CXR) analysis under limited annotations. Yet, existing SSL strategies remain suboptimal for medical imaging. Masked image modeling allocates substantial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Wangyu Feng , Shawn Young , Lijian Xu

Contrastive Learning (CL) performances as a rising approach to address the challenge of sparse and noisy recommendation data. Although having achieved promising results, most existing CL methods only perform either hand-crafted data or…

Information Retrieval · Computer Science 2023-11-22 Xiuyuan Qin , Huanhuan Yuan , Pengpeng Zhao , Junhua Fang , Fuzhen Zhuang , Guanfeng Liu , Victor Sheng

Effective protein representation learning is crucial for predicting protein functions. Traditional methods often pretrain protein language models on large, unlabeled amino acid sequences, followed by finetuning on labeled data. While…

Biomolecules · Quantitative Biology 2024-09-05 Jiangbin Zheng , Stan Z. Li