中文
相关论文

相关论文: Representation Learning via Non-Contrastive Mutual…

200 篇论文

In the realms of computer vision, it is evident that deep neural networks perform better in a supervised setting with a large amount of labeled data. The representations learned with supervision are not only of high quality but also helps…

机器学习 · 计算机科学 2020-09-28 Souradip Chakraborty , Aritra Roy Gosthipaty , Sayak Paul

Recent work studies the supervised online continual learning setting where a learner receives a stream of data whose class distribution changes over time. Distinct from other continual learning settings the learner is presented new samples…

机器学习 · 计算机科学 2022-03-28 Nader Asadi , Sudhir Mudur , Eugene Belilovsky

We investigate contrastive learning in the federated setting through the lens of SimCLR and multi-view mutual information maximization. In doing so, we uncover a connection between contrastive representation learning and user verification;…

机器学习 · 计算机科学 2024-05-06 Christos Louizos , Matthias Reisser , Denis Korzhenkov

Contrastive learning and self-supervised techniques have gained prevalence in computer vision for the past few years. It is essential for medical image analysis, which is often notorious for its lack of annotations. Most existing…

图像与视频处理 · 电气工程与系统科学 2022-03-07 Jun Li , Quan Quan , S. Kevin Zhou

Learning effective visual representations that generalize well without human supervision is a fundamental problem in order to apply Machine Learning to a wide variety of tasks. Recently, two families of self-supervised methods, contrastive…

机器学习 · 计算机科学 2021-12-07 Kuang-Huei Lee , Anurag Arnab , Sergio Guadarrama , John Canny , Ian Fischer

We present a collaborative learning method called Mutual Contrastive Learning (MCL) for general visual representation learning. The core idea of MCL is to perform mutual interaction and transfer of contrastive distributions among a cohort…

计算机视觉与模式识别 · 计算机科学 2022-01-19 Chuanguang Yang , Zhulin An , Linhang Cai , Yongjun Xu

Learning robust representations to discriminate cell phenotypes based on microscopy images is important for drug discovery. Drug development efforts typically analyse thousands of cell images to screen for potential treatments. Early works…

计算机视觉与模式识别 · 计算机科学 2021-12-28 Alexis Perakis , Ali Gorji , Samriddhi Jain , Krishna Chaitanya , Simone Rizza , Ender Konukoglu

A prominent technique for self-supervised representation learning has been to contrast semantically similar and dissimilar pairs of samples. Without access to labels, dissimilar (negative) points are typically taken to be randomly sampled…

机器学习 · 计算机科学 2020-10-22 Ching-Yao Chuang , Joshua Robinson , Lin Yen-Chen , Antonio Torralba , Stefanie Jegelka

Collaborative learning enables distributed clients to learn a shared model for prediction while keeping the training data local on each client. However, existing collaborative learning methods require fully-labeled data for training, which…

机器学习 · 计算机科学 2022-04-26 Yawen Wu , Zhepeng Wang , Dewen Zeng , Meng Li , Yiyu Shi , Jingtong Hu

Contrastive self-supervised learning (SSL) learns an embedding space that maps similar data pairs closer and dissimilar data pairs farther apart. Despite its success, one issue has been overlooked: the fairness aspect of representations…

Traditional supervised learning methods are hitting a bottleneck because of their dependency on expensive manually labeled data and their weaknesses such as limited generalization ability and vulnerability to adversarial attacks. A…

机器学习 · 计算机科学 2021-06-08 Ran Liu

Self-supervised contrastive learning offers a means of learning informative features from a pool of unlabeled data. In this paper, we delve into another useful approach -- providing a way of selecting a core-set that is entirely unlabeled.…

机器学习 · 计算机科学 2021-04-08 Jeongwoo Ju , Heechul Jung , Yoonju Oh , Junmo Kim

Self-supervised learning has achieved a great success in the representation learning of visual and textual data. However, the current methods are mainly validated on the well-curated datasets, which do not exhibit the real-world long-tailed…

计算机视觉与模式识别 · 计算机科学 2022-07-08 Zhihan Zhou , Jiangchao Yao , Yanfeng Wang , Bo Han , Ya Zhang

Existing adversarial learning approaches mostly use class labels to generate adversarial samples that lead to incorrect predictions, which are then used to augment the training of the model for improved robustness. While some recent works…

机器学习 · 计算机科学 2020-10-27 Minseon Kim , Jihoon Tack , Sung Ju Hwang

Image recognition techniques heavily rely on abundant labeled data, particularly in medical contexts. Addressing the challenges associated with obtaining labeled data has led to the prominence of self-supervised learning and semi-supervised…

计算机视觉与模式识别 · 计算机科学 2024-04-17 Hao Feng , Yuanzhe Jia , Ruijia Xu , Mukesh Prasad , Ali Anaissi , Ali Braytee

Unsupervised learning is a challenging task due to the lack of labels. Multiple Object Tracking (MOT), which inevitably suffers from mutual object interference, occlusion, etc., is even more difficult without label supervision. In this…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Sha Meng , Dian Shao , Jiacheng Guo , Shan Gao

Learning representations for individual instances when only bag-level labels are available is a fundamental challenge in multiple instance learning (MIL). Recent works have shown promising results using contrastive self-supervised learning…

计算机视觉与模式识别 · 计算机科学 2023-07-13 Kangning Liu , Weicheng Zhu , Yiqiu Shen , Sheng Liu , Narges Razavian , Krzysztof J. Geras , Carlos Fernandez-Granda

We introduce Bootstrap Your Own Latent (BYOL), a new approach to self-supervised image representation learning. BYOL relies on two neural networks, referred to as online and target networks, that interact and learn from each other. From an…

We introduce Consistent Assignment for Representation Learning (CARL), an unsupervised learning method to learn visual representations by combining ideas from self-supervised contrastive learning and deep clustering. By viewing contrastive…

机器学习 · 计算机科学 2023-10-23 Thalles Silva , Adín Ramírez Rivera

Learning a discriminative semantic space using unlabelled and noisy data remains unaddressed in a multi-label setting. We present a contrastive self-supervised learning method which is robust to data noise, grounded in the domain of…

计算机视觉与模式识别 · 计算机科学 2024-05-09 Mehmet Can Yavuz , Berrin Yanikoglu