中文
相关论文

相关论文: Martingale-Consistent Self-Supervised Learning

200 篇论文

Self-supervised learning (SSL) methods have achieved remarkable success in learning image representations allowing invariances in them - but therefore discarding transformation information that some computer vision tasks actually require.…

计算机视觉与模式识别 · 计算机科学 2026-02-11 Qin Wang , Alessio Quercia , Benjamin Bruns , Abigail Morrison , Hanno Scharr , Kai Krajsek

Self-supervised learning (SSL) learns high-quality representations from large pools of unlabeled training data. As datasets grow larger, it becomes crucial to identify the examples that contribute the most to learning such representations.…

机器学习 · 计算机科学 2024-03-14 Siddharth Joshi , Baharan Mirzasoleiman

Semi-Supervised Learning (SSL) has been proved to be an effective way to leverage both labeled and unlabeled data at the same time. Recent semi-supervised approaches focus on deep neural networks and have achieved promising results on…

计算机视觉与模式识别 · 计算机科学 2018-12-14 Hong-Yu Zhou , Avital Oliver , Jianxin Wu , Yefeng Zheng

Self-supervised learning (SSL) has emerged as an effective paradigm for deriving general representations from vast amounts of unlabeled data. However, as real-world applications continually integrate new content, the high computational and…

机器学习 · 计算机科学 2024-03-28 Wenzhuo Liu , Fei Zhu , Cheng-Lin Liu

In recent years, self-supervised learning (SSL) has emerged as a promising approach for extracting valuable representations from unlabeled data. One successful SSL method is contrastive learning, which aims to bring positive examples closer…

机器学习 · 计算机科学 2023-07-20 Zeen Song , Xingzhe Su , Jingyao Wang , Wenwen Qiang , Changwen Zheng , Fuchun Sun

The premise of semi-supervised learning (SSL) is that combining labeled and unlabeled data yields significantly more accurate models. Despite empirical successes, the theoretical understanding of SSL is still far from complete. In this…

机器学习 · 统计学 2024-09-06 Eyar Azar , Boaz Nadler

Self-supervised learning (SSL) methods aim to exploit the abundance of unlabelled data for machine learning (ML), however the underlying principles are often method-specific. An SSL framework derived from biological first principles of…

机器学习 · 计算机科学 2023-08-03 Franz Scherr , Qinghai Guo , Timoleon Moraitis

Recent semi-supervised learning (SSL) methods are commonly based on pseudo labeling. Since the SSL performance is greatly influenced by the quality of pseudo labels, mutual learning has been proposed to effectively suppress the noises in…

计算机视觉与模式识别 · 计算机科学 2021-12-28 Pan Zhang , Bo Zhang , Ting Zhang , Dong Chen , Fang Wen

While semi-supervised learning (SSL) algorithms provide an efficient way to make use of both labelled and unlabelled data, they generally struggle when the number of annotated samples is very small. In this work, we consider the problem of…

计算机视觉与模式识别 · 计算机科学 2020-04-23 Sylvestre-Alvise Rebuffi , Sebastien Ehrhardt , Kai Han , Andrea Vedaldi , Andrew Zisserman

Semi-supervised learning (SSL) constructs classifiers from datasets in which only a subset of observations is labelled, a situation that naturally arises because obtaining labels often requires expert judgement or costly manual effort. This…

统计计算 · 统计学 2025-12-09 Geoffrey J. McLachlan , Jinran Wu

Self-supervised learning (SSL) excels at finding general-purpose latent representations from complex data, yet lacks a unifying theoretical framework that explains the diverse existing methods and guides the design of new ones. We cast SSL…

机器学习 · 计算机科学 2026-05-28 Fabian A Mikulasch , Friedemann Zenke

Self-supervised learning (SSL) offers a powerful way to learn robust, generalizable representations without labeled data. In music, where labeled data is scarce, existing SSL methods typically use generated supervision and multi-view…

声音 · 计算机科学 2024-11-06 Julia Wilkins , Sivan Ding , Magdalena Fuentes , Juan Pablo Bello

Self supervised learning (SSL) has become a very successful technique to harness the power of unlabeled data, with no annotation effort. A number of developed approaches are evolving with the goal of outperforming supervised alternatives,…

计算机视觉与模式识别 · 计算机科学 2022-10-31 Salman Mohamadi , Gianfranco Doretto , Donald A. Adjeroh

While the success of semi-supervised learning (SSL) is still not fully understood, Sch\"olkopf et al. (2012) have established a link to the principle of independent causal mechanisms. They conclude that SSL should be impossible when…

机器学习 · 统计学 2020-06-25 Julius von Kügelgen , Alexander Mey , Marco Loog , Bernhard Schölkopf

Semi-supervised learning (SSL) provides a powerful framework for leveraging unlabeled data when labels are limited or expensive to obtain. SSL algorithms based on deep neural networks have recently proven successful on standard benchmark…

机器学习 · 计算机科学 2019-06-18 Avital Oliver , Augustus Odena , Colin Raffel , Ekin D. Cubuk , Ian J. Goodfellow

Self-supervised learning (SSL), which can automatically generate ground-truth samples from raw data, holds vast potential to improve recommender systems. Most existing SSL-based methods perturb the raw data graph with uniform node/edge…

信息检索 · 计算机科学 2021-08-27 Junliang Yu , Hongzhi Yin , Min Gao , Xin Xia , Xiangliang Zhang , Nguyen Quoc Viet Hung

Consistency regularization on label predictions becomes a fundamental technique in semi-supervised learning, but it still requires a large number of training iterations for high performance. In this study, we analyze that the consistency…

机器学习 · 计算机科学 2022-06-10 Doyup Lee , Sungwoong Kim , Ildoo Kim , Yeongjae Cheon , Minsu Cho , Wook-Shin Han

Deep supervised learning algorithms typically require a large volume of labeled data to achieve satisfactory performance. However, the process of collecting and labeling such data can be expensive and time-consuming. Self-supervised…

机器学习 · 计算机科学 2024-07-16 Jie Gui , Tuo Chen , Jing Zhang , Qiong Cao , Zhenan Sun , Hao Luo , Dacheng Tao

Self-supervised learning (SSL) aims to eliminate one of the major bottlenecks in representation learning - the need for human annotations. As a result, SSL holds the promise to learn representations from data in-the-wild, i.e., without the…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Senthil Purushwalkam , Pedro Morgado , Abhinav Gupta

In semi-supervised learning, the paradigm of self-training refers to the idea of learning from pseudo-labels suggested by the learner itself. Across various domains, corresponding methods have proven effective and achieve state-of-the-art…

机器学习 · 统计学 2023-06-12 Julian Lienen , Caglar Demir , Eyke Hüllermeier