English
Related papers

Related papers: Triplet Contrastive Representation Learning for Un…

200 papers

Cross-modal contrastive learning has led the recent advances in multimodal retrieval with its simplicity and effectiveness. In this work, however, we reveal that cross-modal contrastive learning suffers from incorrect normalization of the…

Information Retrieval · Computer Science 2022-12-23 Yookoon Park , Mahmoud Azab , Bo Xiong , Seungwhan Moon , Florian Metze , Gourab Kundu , Kirmani Ahmed

This paper presents Contrastive Reconstruction, ConRec - a self-supervised learning algorithm that obtains image representations by jointly optimizing a contrastive and a self-reconstruction loss. We showcase that state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Jonas Dippel , Steffen Vogler , Johannes Höhne

Prototypical contrastive learning (PCL) has been widely used to learn class-wise domain-invariant features recently. These methods are based on the assumption that the prototypes, which are represented as the central value of the same class…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Muxin Liao , Shishun Tian , Yuhang Zhang , Guoguang Hua , Wenbin Zou , Xia Li

Task-incremental continual learning refers to continually training a model in a sequence of tasks while overcoming the problem of catastrophic forgetting (CF). The issue arrives for the reason that the learned representations are forgotten…

Machine Learning · Computer Science 2023-05-23 Yun Luo , Xiaotian Lin , Zhen Yang , Fandong Meng , Jie Zhou , Yue Zhang

Hierarchical multi-label text classification (HMTC) aims at utilizing a label hierarchy in multi-label classification. Recent approaches to HMTC deal with the problem of imposing an over-constrained premise on the output space by using…

Computation and Language · Computer Science 2024-06-21 Simon Yu , Jie He , Víctor Gutiérrez-Basulto , Jeff Z. Pan

Recent contrastive learning methods have shown to be effective in various tasks, learning generalizable representations invariant to data augmentation thereby leading to state of the art performances. Regarding the multifaceted nature of…

Machine Learning · Computer Science 2022-05-27 MinGyu Choi , Wonseok Shin , Yijingxiu Lu , Sun Kim

Semi-supervised medical image segmentation has attracted much attention in recent years because of the high cost of medical image annotations. In this paper, we propose a novel Inherent Consistent Learning (ICL) method, aims to learn robust…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Ye Zhu , Jie Yang , Si-Qi Liu , Ruimao Zhang

Semi-supervised learning (SSL) has achieved great success in leveraging a large amount of unlabeled data to learn a promising classifier. A popular approach is pseudo-labeling that generates pseudo labels only for those unlabeled data with…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Qinyi Deng , Yong Guo , Zhibang Yang , Haolin Pan , Jian Chen

Contrastive learning (CL) has become a powerful approach for learning representations from unlabeled images. However, existing CL methods focus predominantly on visual appearance features while neglecting topological characteristics (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Guangyu Meng , Pengfei Gu , Peixian Liang , John P. Lalor , Erin Wolf Chambers , Danny Z. Chen

Supervised contrastive learning (SCL) frameworks treat each class as independent and thus consider all classes to be equally important. This neglects the common scenario in which label hierarchy exists, where fine-grained classes under the…

Machine Learning · Computer Science 2024-02-02 Ruixue Lian , William A. Sethares , Junjie Hu

Unsupervised disentangled representation learning is a long-standing problem in computer vision. This work proposes a novel framework for performing image clustering from deep embeddings by combining instance-level contrastive learning with…

Machine Learning · Computer Science 2021-10-05 Ramakrishnan Sundareswaran , Jansel Herrera-Gerena , John Just , Ali Jannesari

In this paper, we address Novel Class Discovery (NCD), the task of unveiling new classes in a set of unlabeled samples given a labeled dataset with known classes. We exploit the peculiarities of NCD to build a new framework, named…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Zhun Zhong , Enrico Fini , Subhankar Roy , Zhiming Luo , Elisa Ricci , Nicu Sebe

Unsupervised learning algorithms are beginning to achieve accuracies comparable to their supervised counterparts on benchmark computer vision tasks, but their utility for practical applications has not yet been demonstrated. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Jeremiah W. Johnson , Swathi Hari , Donald Hampton , Hyunju K. Connor , Amy Keesee

Cross-modal retrieval (CMR) typically involves learning common representations to directly measure similarities between multimodal samples. Most existing CMR methods commonly assume multimodal samples in pairs and employ joint training to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Ruitao Pu , Yang Qin , Dezhong Peng , Xiaomin Song , Huiming Zheng

Learning from noisy data is a challenging task that significantly degenerates the model performance. In this paper, we present TCL, a novel twin contrastive learning model to learn robust representations and handle noisy labels for…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Zhizhong Huang , Junping Zhang , Hongming Shan

Self-supervised learning (SSL) has recently become the favorite among feature learning methodologies. It is therefore appealing for domain adaptation approaches to consider incorporating SSL. The intuition is to enforce instance-level…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Yang Chen , Yingwei Pan , Yu Wang , Ting Yao , Xinmei Tian , Tao Mei

Contrastive self-supervised learning (CSL) is an approach to learn useful representations by solving a pretext task that selects and compares anchor, negative and positive (APN) features from an unlabeled dataset. We present a conceptual…

Computer Vision and Pattern Recognition · Computer Science 2020-09-02 William Falcon , Kyunghyun Cho

Contrastive learning has nearly closed the gap between supervised and self-supervised learning of image representations, and has also been explored for videos. However, prior work on contrastive learning for video data has not explored the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Ishan Dave , Rohit Gupta , Mamshad Nayeem Rizve , Mubarak Shah

This paper introduces a semi-supervised contrastive learning framework and its application to text-independent speaker verification. The proposed framework employs generalized contrastive loss (GCL). GCL unifies losses from two different…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-09 Nakamasa Inoue , Keita Goto

Collaborative learning enables distributed clients to learn a shared model for prediction while keeping the training data local on each client. However, existing collaborative learning methods require fully-labeled data for training, which…

Machine Learning · Computer Science 2022-04-26 Yawen Wu , Zhepeng Wang , Dewen Zeng , Meng Li , Yiyu Shi , Jingtong Hu