中文
相关论文

相关论文: Self-Supervised Learning for Time Series Analysis:…

200 篇论文

Time series self-supervised learning (SSL) aims to exploit unlabeled data for pre-training to mitigate the reliance on labels. Despite the great success in recent years, there is limited discussion on the potential noise in the time series,…

机器学习 · 计算机科学 2024-06-10 Shuang Zhou , Daochen Zha , Xiao Shen , Xiao Huang , Rui Zhang , Fu-Lai Chung

Using large training datasets enhances the generalization capabilities of neural networks. Semi-supervised learning (SSL) is useful when there are few labeled data and a lot of unlabeled data. SSL methods that use data augmentation are most…

计算与语言 · 计算机科学 2024-01-09 Himmet Toprak Kesgin , Mehmet Fatih Amasyali

Given an unlabeled dataset and an annotation budget, we study how to selectively label a fixed number of instances so that semi-supervised learning (SSL) on such a partially labeled dataset is most effective. We focus on selecting the right…

机器学习 · 计算机科学 2023-08-24 Xudong Wang , Long Lian , Stella X. Yu

Self-supervised learning (SSL) has recently received significant attention due to its ability to train high-performance encoders purely on unlabeled data-often scraped from the internet. This data can still be sensitive and empirical…

Multivariate time-series data in fields like healthcare and industry are informative but challenging due to high dimensionality and lack of labels. Recent self-supervised learning methods excel in learning rich representations without…

机器学习 · 计算机科学 2024-10-22 Ching Chang , Chiao-Tung Chan , Wei-Yao Wang , Wen-Chih Peng , Tien-Fu Chen

As a newly emerging unsupervised learning paradigm, self-supervised learning (SSL) recently gained widespread attention, which usually introduces a pretext task without manual annotation of data. With its help, SSL effectively learns the…

计算机视觉与模式识别 · 计算机科学 2020-05-18 Chuanxing Geng , Zhenghao Tan , Songcan Chen

We witnessed a massive growth in the supervised learning paradigm in the past decade. Supervised learning requires a large amount of labeled data to reach state-of-the-art performance. However, labeling the samples requires a lot of human…

计算机视觉与模式识别 · 计算机科学 2021-11-04 Mrinal Anand , Aditya Garg

We explore the impact of training with more diverse datasets, characterized by the number of unique samples, on the performance of self-supervised learning (SSL) under a fixed computational budget. Our findings consistently demonstrate that…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Hasan Abed Al Kader Hammoud , Tuhin Das , Fabio Pizzati , Philip Torr , Adel Bibi , Bernard Ghanem

Semi-supervised learning (SSL) addresses the lack of labeled data by exploiting large unlabeled data through pseudolabeling. However, in the extremely low-label regime, pseudo labels could be incorrect, a.k.a. the confirmation bias, and the…

计算机视觉与模式识别 · 计算机科学 2022-05-09 Xun Xu , Jingyi Liao , Lile Cai , Manh Cuong Nguyen , Kangkang Lu , Wanyue Zhang , Yasin Yazici , Chuan Sheng Foo

We consider the problem of semi-supervised 3D action recognition which has been rarely explored before. Its major challenge lies in how to effectively learn motion representations from unlabeled data. Self-supervised learning (SSL) has been…

计算机视觉与模式识别 · 计算机科学 2020-07-14 Chenyang Si , Xuecheng Nie , Wei Wang , Liang Wang , Tieniu Tan , Jiashi Feng

Some of the threats in the dynamic environment include the unpredictability of the motion of objects and interferences to the robotic grasp. In such conditions the traditional supervised and reinforcement learning approaches are ill suited…

机器人学 · 计算机科学 2024-10-18 Ankit Shaw

Self-supervised learning (SSL) has empirically shown its data representation learnability in many downstream tasks. There are only a few theoretical works on data representation learnability, and many of those focus on final data…

机器学习 · 计算机科学 2024-01-09 Ruofeng Yang , Xiangyuan Li , Bo Jiang , Shuai Li

In many modern machine learning applications, the outcome is expensive or time-consuming to collect while the predictor information is easy to obtain. Semi-supervised learning (SSL) aims at utilizing large amounts of `unlabeled' data along…

统计方法学 · 统计学 2017-11-16 Jessica Gronsbell , Tianxi Cai

Objective. Supervised learning paradigms are often limited by the amount of labeled data that is available. This phenomenon is particularly problematic in clinically-relevant data, such as electroencephalography (EEG), where labeling can be…

Traditional semi-supervised learning (SSL) assumes that the feature distributions of labeled and unlabeled data are consistent which rarely holds in realistic scenarios. In this paper, we propose a novel SSL setting, where unlabeled samples…

计算机视觉与模式识别 · 计算机科学 2024-06-03 Jiachen Liang , Ruibing Hou , Hong Chang , Bingpeng Ma , Shiguang Shan , Xilin Chen

Semi-supervised learning (SSL) is one of the dominant approaches to address the annotation bottleneck of supervised learning. Recent SSL methods can effectively leverage a large repository of unlabeled data to improve performance while…

计算机视觉与模式识别 · 计算机科学 2022-07-29 Mamshad Nayeem Rizve , Navid Kardan , Salman Khan , Fahad Shahbaz Khan , Mubarak Shah

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most of methods mainly focus on the instance level information…

计算机视觉与模式识别 · 计算机科学 2021-07-26 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

The current success of deep neural networks (DNNs) in an increasingly broad range of tasks involving artificial intelligence strongly depends on the quality and quantity of labeled training data. In general, the scarcity of labeled data,…

计算与语言 · 计算机科学 2018-11-21 Shun Kiyono , Jun Suzuki , Kentaro Inui

Self-supervised learning (SSL) has emerged as a key technique for training networks that can generalize well to diverse tasks without task-specific supervision. This property makes SSL desirable for computational pathology, the study of…

Contrastive self-supervised learning (SSL) learns an embedding space that maps similar data pairs closer and dissimilar data pairs farther apart. Despite its success, one issue has been overlooked: the fairness aspect of representations…