中文
相关论文

相关论文: Mixing Up Contrastive Learning: Self-Supervised Re…

200 篇论文

The goal of unsupervised representation learning is to extract a new representation of data, such that solving many different tasks becomes easier. Existing methods typically focus on vectorized data and offer little support for relational…

机器学习 · 统计学 2017-09-29 Sebastijan Dumancic , Hendrik Blockeel

Image-to-image translation aims to learn a mapping between different groups of visually distinguishable images. While recent methods have shown impressive ability to change even intricate appearance of images, they still rely on domain…

计算机视觉与模式识别 · 计算机科学 2021-05-10 Hanbit Lee , Jinseok Seol , Sang-goo Lee

Time series classification is a critical task in various domains, such as finance, healthcare, and sensor data analysis. Unsupervised contrastive learning has garnered significant interest in learning effective representations from time…

机器学习 · 计算机科学 2025-03-24 Huili Cai , Xiang Zhang , Xiaofeng Liu

Convolutional networks have marked their place over the last few years as the best performing model for various visual tasks. They are, however, most suited for supervised learning from large amounts of labeled data. Previous attempts have…

机器学习 · 计算机科学 2018-12-05 Elad Hoffer , Itay Hubara , Nir Ailon

We present a technique to improve the transferability of deep representations learned on small labeled datasets by introducing self-supervised tasks as auxiliary loss functions. While recent approaches for self-supervised learning have…

计算机视觉与模式识别 · 计算机科学 2019-06-18 Jong-Chyi Su , Subhransu Maji , Bharath Hariharan

A central goal of unsupervised learning is to acquire representations from unlabeled data or experience that can be used for more effective learning of downstream tasks from modest amounts of labeled data. Many prior unsupervised learning…

机器学习 · 计算机科学 2019-03-25 Kyle Hsu , Sergey Levine , Chelsea Finn

Contrastive learning is a recent promising approach in unsupervised representation learning where a feature representation of data is learned by solving a pseudo classification problem from unlabelled data. However, it is not…

机器学习 · 计算机科学 2022-08-10 Hiroaki Sasaki , Takashi Takenouchi

Datasets for biosignals, such as electroencephalogram (EEG) and electrocardiogram (ECG), often have noisy labels and have limited number of subjects (<100). To handle these challenges, we propose a self-supervised approach based on…

机器学习 · 计算机科学 2020-07-10 Joseph Y. Cheng , Hanlin Goh , Kaan Dogrusoz , Oncel Tuzel , Erdrin Azemi

As a pioneering work, PointContrast conducts unsupervised 3D representation learning via leveraging contrastive learning over raw RGB-D frames and proves its effectiveness on various downstream tasks. However, the trend of large-scale…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Xiaoyang Wu , Xin Wen , Xihui Liu , Hengshuang Zhao

Sound localization aims to find the source of the audio signal in the visual scene. However, it is labor-intensive to annotate the correlations between the signals sampled from the audio and visual modalities, thus making it difficult to…

计算机视觉与模式识别 · 计算机科学 2021-04-02 Yan-Bo Lin , Hung-Yu Tseng , Hsin-Ying Lee , Yen-Yu Lin , Ming-Hsuan Yang

We investigate contrastive learning in the federated setting through the lens of SimCLR and multi-view mutual information maximization. In doing so, we uncover a connection between contrastive representation learning and user verification;…

机器学习 · 计算机科学 2024-05-06 Christos Louizos , Matthias Reisser , Denis Korzhenkov

Previous research has indicated that deep neural network based models for time series classification (TSC) tasks are prone to overfitting. This issue can be mitigated by employing strategies that prevent the model from becoming overly…

机器学习 · 计算机科学 2024-09-02 Hengyi Ma , Weitong Chen

Disease diagnosis from medical images via supervised learning is usually dependent on tedious, error-prone, and costly image labeling by medical experts. Alternatively, semi-supervised learning and self-supervised learning offer…

计算机视觉与模式识别 · 计算机科学 2023-06-14 Attiano Purpura-Pontoniere , Demetri Terzopoulos , Adam Wang , Abdullah-Al-Zubaer Imran

Vast quantities of person-generated health data (wearables) are collected but the process of annotating to feed to machine learning models is impractical. This paper discusses ways in which self-supervised approaches that use contrastive…

机器学习 · 计算机科学 2021-11-16 Kevalee Shah , Dimitris Spathis , Chi Ian Tang , Cecilia Mascolo

Unsupervised person re-identification (re-ID) aims at closing the performance gap to supervised methods. These methods build reliable relationship between data points while learning representations. However, we empirically show that the…

计算机视觉与模式识别 · 计算机科学 2021-03-22 Xuanyu He , Wei Zhang , Ran Song , Qian Zhang , Xiangyuan Lan , Lin Ma

Unsupervised domain adaptation which aims to adapt models trained on a labeled source domain to a completely unlabeled target domain has attracted much attention in recent years. While many domain adaptation techniques have been proposed…

计算机视觉与模式识别 · 计算机科学 2021-10-29 Aadarsh Sahoo , Rutav Shah , Rameswar Panda , Kate Saenko , Abir Das

Time series forecasting (TSF) holds significant importance in modern society, spanning numerous domains. Previous representation learning-based TSF algorithms typically embrace a contrastive learning paradigm featuring segregated…

机器学习 · 计算机科学 2023-12-12 Jiaxin Gao , Yuxiao Hu , Qinglong Cao , Siqi Dai , Yuntian Chen

This paper presents a novel method for embedding transfer, a task of transferring knowledge of a learned embedding model to another. Our method exploits pairwise similarities between samples in the source embedding space as the knowledge,…

计算机视觉与模式识别 · 计算机科学 2021-03-30 Sungyeon Kim , Dongwon Kim , Minsu Cho , Suha Kwak

Learning good representations involves capturing the diverse ways in which data samples relate. Contrastive loss - an objective matching related samples - underlies methods from self-supervised to multimodal learning. Contrastive losses,…

计算机视觉与模式识别 · 计算机科学 2024-09-13 Vlad Sobal , Mark Ibrahim , Randall Balestriero , Vivien Cabannes , Diane Bouchacourt , Pietro Astolfi , Kyunghyun Cho , Yann LeCun

Convolutional networks have marked their place over the last few years as the best performing model for various visual tasks. They are, however, most suited for supervised learning from large amounts of labeled data. Previous attempts have…

机器学习 · 统计学 2016-11-23 Elad Hoffer , Itay Hubara , Nir Ailon