中文
相关论文

相关论文: Self-Supervised Learning for Time Series Analysis:…

200 篇论文

With the development of deep learning, supervised learning methods perform well in remote sensing images (RSIs) scene classification. However, supervised learning requires a huge number of annotated data for training. When labeled samples…

计算机视觉与模式识别 · 计算机科学 2020-10-05 Chao Tao , Ji Qi , Weipeng Lu , Hao Wang , Haifeng Li

Self-supervised learning (SSL) provides a promising alternative for representation learning on hypergraphs without costly labels. However, existing hypergraph SSL models are mostly based on contrastive methods with the instance-level…

机器学习 · 计算机科学 2024-04-19 Fan Li , Xiaoyang Wang , Dawei Cheng , Wenjie Zhang , Ying Zhang , Xuemin Lin

Self-supervised learning (SSL) is an emerging paradigm that exploits supervisory signals generated from the data itself, and many recent studies have leveraged SSL to conduct graph anomaly detection. However, we empirically found that three…

机器学习 · 计算机科学 2025-07-01 Zhong Li , Yuhang Wang , Matthijs van Leeuwen

Self-supervised learning (SSL) excels at finding general-purpose latent representations from complex data, yet lacks a unifying theoretical framework that explains the diverse existing methods and guides the design of new ones. We cast SSL…

机器学习 · 计算机科学 2026-05-28 Fabian A Mikulasch , Friedemann Zenke

Self-Supervised Learning (SSL) has emerged as a promising approach in computer vision, enabling networks to learn meaningful representations from large unlabeled datasets. SSL methods fall into two main categories: instance discrimination…

计算机视觉与模式识别 · 计算机科学 2026-05-01 Alina Ciocarlan , Sidonie Lefebvre , Sylvie Le Hégarat-Mascle , Arnaud Woiselle

Inspired by the success of Self-supervised learning (SSL) in learning visual representations from unlabeled data, a few recent works have studied SSL in the context of continual learning (CL), where multiple tasks are learned sequentially,…

计算机视觉与模式识别 · 计算机科学 2023-03-15 Li Yang , Sen Lin , Fan Zhang , Junshan Zhang , Deliang Fan

3D point clouds are a crucial type of data collected by LiDAR sensors and widely used in transportation applications due to its concise descriptions and accurate localization. Deep neural networks (DNNs) have achieved remarkable success in…

计算机视觉与模式识别 · 计算机科学 2023-05-25 Changyu Zeng , Wei Wang , Anh Nguyen , Yutao Yue

With the progress of sensor technology in wearables, the collection and analysis of PPG signals are gaining more interest. Using Machine Learning, the cardiac rhythm corresponding to PPG signals can be used to predict different tasks such…

信号处理 · 电气工程与系统科学 2022-12-20 Ramin Ghorbani , Marcel J. T. Reinders , David M. J. Tax

In Self-Supervised Learning (SSL), pre-training and evaluation are resource intensive. In the speech domain, current indicators of the quality of SSL models during pre-training, such as the loss, do not correlate well with downstream…

声音 · 计算机科学 2025-06-03 Ryan Whetten , Lucas Maison , Titouan Parcollet , Marco Dinarelli , Yannick Estève

Self-supervised learning achieves superior performance in many domains by extracting useful representations from the unlabeled data. However, most of traditional self-supervised methods mainly focus on exploring the inter-sample structure…

机器学习 · 计算机科学 2020-11-30 Haoyi Fan , Fengbin Zhang , Yue Gao

The abundance of complex and interconnected healthcare data offers numerous opportunities to improve prediction, diagnosis, and treatment. Graph-structured data, which includes entities and their relationships, is well-suited for capturing…

机器学习 · 计算机科学 2024-12-10 Safa Ben Atitallah , Chaima Ben Rabah , Maha Driss , Wadii Boulila , Anis Koubaa

Recent advancements in self-supervised learning (SSL) made it possible to learn generalizable visual representations from unlabeled data. The performance of Deep Learning models fine-tuned on pretrained SSL representations is on par with…

机器学习 · 计算机科学 2021-09-21 Atharva Tendle , Mohammad Rashedul Hasan

With the rapid proliferation of mobile devices and data, next-generation wireless communication systems face stringent requirements for ultra-low latency, ultra-high reliability, and massive connectivity. Traditional AI-driven wireless…

信号处理 · 电气工程与系统科学 2024-06-12 Zhixiang Yang , Hongyang Du , Dusit Niyato , Xudong Wang , Yu Zhou , Lei Feng , Fanqin Zhou , Wenjing Li , Xuesong Qiu

Deep neural networks are efficient at learning the data distribution if it is sufficiently sampled. However, they can be strongly biased by non-relevant factors implicitly incorporated in the training data. These include operational biases,…

计算机视觉与模式识别 · 计算机科学 2022-03-04 Kirill Sirotkin , Pablo Carballeira , Marcos Escudero-Viñolo

Recently, self-supervised learning (SSL) has achieved tremendous success in learning image representation. Despite the empirical success, most self-supervised learning methods are rather "inefficient" learners, typically taking hundreds of…

计算机视觉与模式识别 · 计算机科学 2023-04-11 Shengbang Tong , Yubei Chen , Yi Ma , Yann Lecun

Self-supervised learning (SSL) has emerged as a promising paradigm in medical imaging, addressing the chronic challenge of limited labeled data in healthcare settings. While SSL has shown impressive results, existing studies in the medical…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Valay Bundele , Karahan Sarıtaş , Bora Kargi , Oğuz Ata Çal , Kıvanç Tezören , Zohreh Ghaderi , Hendrik Lensch

Recently, self-supervised learning (SSL) has demonstrated strong performance in speaker recognition, even if the pre-training objective is designed for speech recognition. In this paper, we study which factor leads to the success of…

计算与语言 · 计算机科学 2022-06-28 Sanyuan Chen , Yu Wu , Chengyi Wang , Shujie Liu , Zhuo Chen , Peidong Wang , Gang Liu , Jinyu Li , Jian Wu , Xiangzhan Yu , Furu Wei

This paper presents a production Semi-Supervised Learning (SSL) pipeline based on the student-teacher framework, which leverages millions of unlabeled examples to improve Natural Language Understanding (NLU) tasks. We investigate two…

计算与语言 · 计算机科学 2021-03-31 Luoxin Chen , Francisco Garcia , Varun Kumar , He Xie , Jianhua Lu

Semi-supervised machine learning (SSL) is gaining popularity as it reduces the cost of training ML models. It does so by using very small amounts of (expensive, well-inspected) labeled data and large amounts of (cheap, non-inspected)…

密码学与安全 · 计算机科学 2022-11-02 Virat Shejwalkar , Lingjuan Lyu , Amir Houmansadr

Semi-supervised learning (SSL) provides a powerful framework for leveraging unlabeled data when labels are limited or expensive to obtain. SSL algorithms based on deep neural networks have recently proven successful on standard benchmark…

机器学习 · 计算机科学 2019-06-18 Avital Oliver , Augustus Odena , Colin Raffel , Ekin D. Cubuk , Ian J. Goodfellow