中文
相关论文

相关论文: A Probabilistic Model for Non-Contrastive Learning

200 篇论文

Self-supervised learning (SSL) has emerged as a promising alternative to create supervisory signals to real-world problems, avoiding the extensive cost of manual labeling. SSL is particularly attractive for unsupervised tasks such as…

机器学习 · 计算机科学 2023-07-31 Jaemin Yoo , Tiancheng Zhao , Leman Akoglu

Recent advancements in self-supervised learning (SSL) made it possible to learn generalizable visual representations from unlabeled data. The performance of Deep Learning models fine-tuned on pretrained SSL representations is on par with…

机器学习 · 计算机科学 2021-09-21 Atharva Tendle , Mohammad Rashedul Hasan

Self-supervised learning (SSL) of graph neural networks is emerging as a promising way of leveraging unlabeled data. Currently, most methods are based on contrastive learning adapted from the image domain, which requires view generation and…

机器学习 · 计算机科学 2022-07-12 Yaochen Xie , Zhao Xu , Shuiwang Ji

Self-Supervised Learning (SSL) has been shown to learn useful and information-preserving representations. Neural Networks (NNs) are widely applied, yet their weight space is still not fully understood. Therefore, we propose to use SSL to…

机器学习 · 计算机科学 2022-12-15 Konstantin Schürholt , Dimche Kostadinov , Damian Borth

Contrastive learning (CL) is a popular technique for self-supervised learning (SSL) of visual representations. It uses pairs of augmentations of unlabeled training examples to define a classification task for pretext learning of a deep…

计算机视觉与模式识别 · 计算机科学 2020-10-26 Chih-Hui Ho , Nuno Vasconcelos

Semi-supervised learning (SSL) is a popular setting aiming to effectively utilize unlabelled data to improve model performance in downstream natural language processing (NLP) tasks. Currently, there are two popular approaches to make use of…

计算与语言 · 计算机科学 2023-05-23 Zhengxiang Shi , Francesco Tonolini , Nikolaos Aletras , Emine Yilmaz , Gabriella Kazai , Yunlong Jiao

While semi-supervised learning (SSL) has received tremendous attentions in many machine learning tasks due to its successful use of unlabeled data, existing SSL algorithms use either all unlabeled examples or the unlabeled examples with a…

机器学习 · 计算机科学 2021-09-03 Yi Xu , Lei Shang , Jinxing Ye , Qi Qian , Yu-Feng Li , Baigui Sun , Hao Li , Rong Jin

Semi-supervised learning (SSL) has been widely explored in recent years, and it is an effective way of leveraging unlabeled data to reduce the reliance on labeled data. In this work, we adjust neural processes (NPs) to the semi-supervised…

计算机视觉与模式识别 · 计算机科学 2023-06-27 Jianfeng Wang , Xiaolin Hu , Thomas Lukasiewicz

Self-supervised learning (SSL) has emerged as a powerful framework to learn representations from raw data without supervision. Yet in practice, engineers face issues such as instability in tuning optimizers and collapse of representations…

机器学习 · 统计学 2023-06-02 Vivien Cabannes , Bobak T. Kiani , Randall Balestriero , Yann LeCun , Alberto Bietti

Self-Supervised Learning (SSL) is a new paradigm for learning discriminative representations without labelled data and has reached comparable or even state-of-the-art results in comparison to supervised counterparts. Contrastive Learning…

计算机视觉与模式识别 · 计算机科学 2022-08-05 Shohreh Deldari , Hao Xue , Aaqib Saeed , Daniel V. Smith , Flora D. Salim

Designing learning-based no-reference (NR) video quality assessment (VQA) algorithms for camera-captured videos is cumbersome due to the requirement of a large number of human annotations of quality. In this work, we propose a…

图像与视频处理 · 电气工程与系统科学 2022-12-01 Shankhanil Mitra , Saiyam Jogani , Rajiv Soundararajan

Semi-supervised learning (SSL) is an active area of research which aims to utilize unlabelled data in order to improve the accuracy of speech recognition systems. The current study proposes a methodology for integration of two key ideas: 1)…

计算与语言 · 计算机科学 2020-08-11 Prakhar Swarup , Debmalya Chakrabarty , Ashtosh Sapru , Hitesh Tulsiani , Harish Arsikere , Sri Garimella

Supervised learning methods have been found to exhibit inductive biases favoring simpler features. When such features are spuriously correlated with the label, this can result in suboptimal performance on minority subgroups. Despite the…

计算机视觉与模式识别 · 计算机科学 2024-06-28 Kimia Hamidieh , Haoran Zhang , Swami Sankaranarayanan , Marzyeh Ghassemi

Semi-supervised learning (SSL) is a machine learning methodology that leverages unlabeled data in conjunction with a limited amount of labeled data. Although SSL has been applied in various applications and its effectiveness has been…

机器学习 · 计算机科学 2025-03-14 Xiaosi Gu , Tomoyuki Obuchi

Contrastive learning (CL) approaches have gained great recognition as a very successful subset of self-supervised learning (SSL) methods. SSL enables learning from unlabeled data, a crucial step in the advancement of deep learning,…

计算机视觉与模式识别 · 计算机科学 2025-04-29 Mohamed Hassan , Mohammad Wasil , Sebastian Houben

Although supervised learning has been highly successful in improving the state-of-the-art in the domain of image-based computer vision in the past, the margin of improvement has diminished significantly in recent years, indicating that a…

计算机视觉与模式识别 · 计算机科学 2023-05-24 Utku Ozbulak , Hyun Jung Lee , Beril Boga , Esla Timothy Anzaku , Homin Park , Arnout Van Messem , Wesley De Neve , Joris Vankerschaver

Semi-Supervised Learning (SSL) has advanced classification tasks by inputting both labeled and unlabeled data to train a model jointly. However, existing SSL methods only consider the unlabeled data whose predictions are beyond a fixed…

计算机视觉与模式识别 · 计算机科学 2022-05-24 Zechen Liang , Yuan-Gen Wang , Wei Lu , Xiaochun Cao

This thesis studies advanced probabilistic models, including both their theoretical foundations and practical applications, for different semi-supervised learning (SSL) tasks. The proposed probabilistic methods are able to improve the…

机器学习 · 计算机科学 2024-04-08 Jianfeng Wang

Contrastive learning (CL) has recently emerged as an alternative to traditional supervised machine learning solutions by enabling rich representations from unstructured and unlabeled data. However, CL and, more broadly, self-supervised…

机器学习 · 计算机科学 2025-07-10 Roberto Pereira , Fernanda Famá , Asal Rangrazi , Marco Miozzo , Charalampos Kalalas , Paolo Dini

Self-supervised learning (SSL) has emerged as a promising paradigm that presents supervisory signals to real-world problems, bypassing the extensive cost of manual labeling. Consequently, self-supervised anomaly detection (SSAD) has seen a…

机器学习 · 计算机科学 2025-07-22 Jaemin Yoo , Lingxiao Zhao , Leman Akoglu