中文
相关论文

相关论文: Cross-Model Cross-Stream Learning for Self-Supervi…

200 篇论文

Effective protein representation learning is crucial for predicting protein functions. Traditional methods often pretrain protein language models on large, unlabeled amino acid sequences, followed by finetuning on labeled data. While…

生物大分子 · 定量生物学 2024-09-05 Jiangbin Zheng , Stan Z. Li

Sequential recommendation (SR) aims to predict the subsequent behaviors of users by understanding their successive historical behaviors. Recently, some methods for SR are devoted to alleviating the data sparsity problem (i.e., limited…

信息检索 · 计算机科学 2022-08-30 Ziyang Wang , Huoyu Liu , Wei Wei , Yue Hu , Xian-Ling Mao , Shaojian He , Rui Fang , Dangyang chen

Graph clustering is a crucial task in network analysis with widespread applications, focusing on partitioning nodes into distinct groups with stronger intra-group connections than inter-group ones. Recently, contrastive learning has…

机器学习 · 计算机科学 2024-08-20 Xunlian Wu , Jingqi Hu , Anqi Zhang , Yining Quan , Qiguang Miao , Peng Gang Sun

Session-based recommendation aims to predict intents of anonymous users based on limited behaviors. With the ability in alleviating data sparsity, contrastive learning is prevailing in the task. However, we spot that existing contrastive…

信息检索 · 计算机科学 2025-06-06 Xiaokun Zhang , Bo Xu , Fenglong Ma , Zhizheng Wang , Liang Yang , Hongfei Lin

Recent advances in deep clustering and unsupervised representation learning are based on the idea that different views of an input image (generated through data augmentation techniques) must either be closer in the representation space, or…

计算机视觉与模式识别 · 计算机科学 2021-07-09 Jayanth Reddy Regatti , Aniket Anand Deshmukh , Eren Manavoglu , Urun Dogan

Continual self-supervised learning (CSSL) learns a series of tasks sequentially on the unlabeled data. Two main challenges of continual learning are catastrophic forgetting and task confusion. While CSSL problem has been studied to address…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Erum Mushtaq , Duygu Nur Yaldiz , Yavuz Faruk Bakman , Jie Ding , Chenyang Tao , Dimitrios Dimitriadis , Salman Avestimehr

Contrastive self-supervised learning (SSL) learns an embedding space that maps similar data pairs closer and dissimilar data pairs farther apart. Despite its success, one issue has been overlooked: the fairness aspect of representations…

Recently, many approaches tackle the Unsupervised Domain Adaptive person re-identification (UDA re-ID) problem through pseudo-label-based contrastive learning. During training, a uni-centroid representation is obtained by simply averaging…

计算机视觉与模式识别 · 计算机科学 2021-12-23 Yuhang Wu , Tengteng Huang , Haotian Yao , Chi Zhang , Yuanjie Shao , Chuchu Han , Changxin Gao , Nong Sang

Applications on Medical Image Analysis suffer from acute shortage of large volume of data properly annotated by medical experts. Supervised Learning algorithms require a large volumes of balanced data to learn robust representations. Often…

计算机视觉与模式识别 · 计算机科学 2022-11-15 Siladittya Manna , Rakesh Dey , Souvik Chakraborty

Medical image segmentation is a critical yet challenging task, primarily due to the difficulty of obtaining extensive datasets of high-quality, expert-annotated images. Contrastive learning presents a potential but still problematic…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Shuang Zeng , Lei Zhu , Xinliang Zhang , Hangzhou He , Yanye Lu

In today's connected world, the generation of massive streaming data across diverse domains has become commonplace. In the presence of concept drift, class imbalance, label scarcity, and new class emergence, they jointly degrade…

机器学习 · 计算机科学 2026-02-11 Jin Li , Kleanthis Malialis , Marios Polycarpou

In recent years, a variety of contrastive learning based unsupervised visual representation learning methods have been designed and achieved great success in many visual tasks. Generally, these methods can be roughly classified into four…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Wenbin Li , Meihao Kong , Xuesong Yang , Lei Wang , Jing Huo , Yang Gao , Jiebo Luo

Despite recent success of self-supervised based contrastive learning model for 3D point clouds representation, the adversarial robustness of such pre-trained models raised concerns. Adversarial contrastive learning (ACL) is considered an…

计算机视觉与模式识别 · 计算机科学 2022-09-16 Junxuan Huang , Yatong An , Lu cheng , Bai Chen , Junsong Yuan , Chunming Qiao

In skeleton-based human activity understanding, existing methods often adopt the contrastive learning paradigm to construct a discriminative feature space. However, many of these approaches fail to exploit the structural inter-class…

计算机视觉与模式识别 · 计算机科学 2026-02-25 Hongda Liu , Yunfan Liu , Min Ren , Lin Sui , Yunlong Wang , Zhenan Sun

Contrastive learning has emerged as a pivotal framework for representation learning, underpinning advances in both unimodal and bimodal applications like SimCLR and CLIP. To address fundamental limitations like large batch size dependency…

机器学习 · 计算机科学 2024-12-12 Ajay Jagannath , Aayush Upadhyay , Anant Mehta

Human Activity Recognition is a field of research where input data can take many forms. Each of the possible input modalities describes human behaviour in a different way, and each has its own strengths and weaknesses. We explore the…

计算机视觉与模式识别 · 计算机科学 2022-10-07 Razvan Brinzea , Bulat Khaertdinov , Stylianos Asteriadis

Recognizing underwater targets from acoustic signals is a challenging task owing to the intricate ocean environments and variable underwater channels. While deep learning-based systems have become the mainstream approach for underwater…

声音 · 计算机科学 2024-02-21 Yuan Xie , Jiawei Ren , Ji Xu

Instance-level contrastive learning techniques, which rely on data augmentation and a contrastive loss function, have found great success in the domain of visual representation learning. They are not suitable for exploiting the rich…

计算机视觉与模式识别 · 计算机科学 2021-10-22 Martine Toering , Ioannis Gatopoulos , Maarten Stol , Vincent Tao Hu

Recent work studies the supervised online continual learning setting where a learner receives a stream of data whose class distribution changes over time. Distinct from other continual learning settings the learner is presented new samples…

机器学习 · 计算机科学 2022-03-28 Nader Asadi , Sudhir Mudur , Eugene Belilovsky

Contrastive learning (CL) is a popular technique for self-supervised learning (SSL) of visual representations. It uses pairs of augmentations of unlabeled training examples to define a classification task for pretext learning of a deep…

计算机视觉与模式识别 · 计算机科学 2020-10-26 Chih-Hui Ho , Nuno Vasconcelos