中文
相关论文

相关论文: Martingale-Consistent Self-Supervised Learning

200 篇论文

The fundamental goal of self-supervised learning (SSL) is to produce useful representations of data without access to any labels for classifying the data. Modern methods in SSL, which form representations based on known or constructed…

机器学习 · 计算机科学 2022-09-30 Bobak T. Kiani , Randall Balestriero , Yubei Chen , Seth Lloyd , Yann LeCun

The problem of fully supervised classification is that it requires a tremendous amount of annotated data, however, in many datasets a large portion of data is unlabeled. To alleviate this problem semi-supervised learning (SSL) leverages the…

机器学习 · 计算机科学 2022-07-26 Ehsan Kazemi

Self-Supervised Learning (SSL) is a reliable learning mechanism in which a robot uses an original, trusted sensor cue for training to recognize an additional, complementary sensor cue. We study for the first time in SSL how a robot's…

机器人学 · 计算机科学 2016-03-29 Kevin van Hecke , Guido de Croon , Laurens van der Maaten , Daniel Hennes , Dario Izzo

Self-Supervised Learning (SSL) has emerged as a promising approach in computer vision, enabling networks to learn meaningful representations from large unlabeled datasets. SSL methods fall into two main categories: instance discrimination…

计算机视觉与模式识别 · 计算机科学 2026-05-01 Alina Ciocarlan , Sidonie Lefebvre , Sylvie Le Hégarat-Mascle , Arnaud Woiselle

In recent years, great progress has been made to incorporate unlabeled data to overcome the inefficiently supervised problem via semi-supervised learning (SSL). Most state-of-the-art models are based on the idea of pursuing consistent model…

机器学习 · 计算机科学 2022-09-27 Yangbangyan Jiang , Xiaodan Li , Yuefeng Chen , Yuan He , Qianqian Xu , Zhiyong Yang , Xiaochun Cao , Qingming Huang

Existing self-supervised learning (SSL) methods primarily learn object-invariant representations but often neglect the spatial structure and relationships among object parts. To address this limitation, we introduce Spatial Prediction (SP),…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Yang Shen , Yusen Cai , Weronika Hryniewska-Guzik , Qing Lin , Mengmi Zhang

With the success of self-supervised learning (SSL), it has become a mainstream paradigm to fine-tune from self-supervised pretrained models to boost the performance on downstream tasks. However, we find that current SSL models suffer severe…

计算机视觉与模式识别 · 计算机科学 2022-07-13 Yun-Hao Cao , Peiqin Sun , Yechang Huang , Jianxin Wu , Shuchang Zhou

Semi-supervised learning (SSL) aims to train a machine learning model using both labelled and unlabelled data. While the unlabelled data have been used in various ways to improve the prediction accuracy, the reason why unlabelled data could…

机器学习 · 统计学 2025-10-28 Archer Moore , Heejung Shim , Jingge Zhu , Mingming Gong

Self-supervised learning (SSL) has developed rapidly in recent years. However, most of the mainstream methods are computationally expensive and rely on two (or more) augmentations for each image to construct positive pairs. Moreover, they…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Yun-Hao Cao , Jianxin Wu

We evaluate the effectiveness of semi-supervised learning (SSL) on a realistic benchmark where data exhibits considerable class imbalance and contains images from novel classes. Our benchmark consists of two fine-grained classification…

计算机视觉与模式识别 · 计算机科学 2021-04-02 Jong-Chyi Su , Zezhou Cheng , Subhransu Maji

This paper introduces a novel approach to improving the training stability of self-supervised learning (SSL) methods by leveraging a non-parametric memory of seen concepts. The proposed method involves augmenting a neural network with a…

计算机视觉与模式识别 · 计算机科学 2024-07-26 Thalles Silva , Helio Pedrini , Adín Ramírez Rivera

Self-supervised learning (SSL) has recently advanced through non-contrastive methods that couple an invariance term with variance, covariance, or redundancy-reduction penalties. While such objectives shape first- and second-order statistics…

机器学习 · 计算机科学 2026-05-18 Benyamin Ghojogh , M. Hadi Sepanj , Paul Fieguth

Self-supervised learning (SSL) is a machine learning approach where the data itself provides supervision, eliminating the need for external labels. The model is forced to learn about the data structure or context by solving a pretext task.…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Markus Marks , Manuel Knott , Neehar Kondapaneni , Elijah Cole , Thijs Defraeye , Fernando Perez-Cruz , Pietro Perona

Remote sensing data has been widely used for various Earth Observation (EO) missions such as land use and cover classification, weather forecasting, agricultural management, and environmental monitoring. Most existing remote sensing…

计算机视觉与模式识别 · 计算机科学 2023-11-14 Xin Zhang , Liangxiu Han

Self-supervised learning (SSL) aims to find meaningful representations from unlabeled data by encoding semantic similarities through data augmentations. Despite its current popularity, theoretical insights about SSL are still scarce. For…

机器学习 · 计算机科学 2025-05-27 Maximilian Fleissner , Pascal Esser , Debarghya Ghoshdastidar

Self-supervised learning (SSL) has emerged as a powerful strategy for representation learning under limited annotation regimes, yet its effectiveness remains highly sensitive to many factors, especially the nature of the target task. In…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Jorge Quesada , Ghassan AlRegib

Federated Learning (FL) and Split Learning (SL) are two popular paradigms of distributed machine learning. By offloading the computation-intensive portions to the server, SL is promising for deep model training on resource-constrained…

机器学习 · 计算机科学 2023-12-27 Yipeng Li , Xinchen Lyu

Semi-supervised learning (SSL) algorithms struggle to perform well when exposed to imbalanced training data. In this scenario, the generated pseudo-labels can exhibit a bias towards the majority class, and models that employ these…

机器学习 · 计算机科学 2024-09-18 Zeju Li , Ying-Qiu Zheng , Chen Chen , Saad Jbabdi

Last couple of years have witnessed a tremendous progress in self-supervised learning (SSL), the success of which can be attributed to the introduction of useful inductive biases in the learning process to learn meaningful visual…

计算机视觉与模式识别 · 计算机科学 2024-02-26 Abhishek Jha , Matthew B. Blaschko , Yuki M. Asano , Tinne Tuytelaars

Although supervised learning has been highly successful in improving the state-of-the-art in the domain of image-based computer vision in the past, the margin of improvement has diminished significantly in recent years, indicating that a…

计算机视觉与模式识别 · 计算机科学 2023-05-24 Utku Ozbulak , Hyun Jung Lee , Beril Boga , Esla Timothy Anzaku , Homin Park , Arnout Van Messem , Wesley De Neve , Joris Vankerschaver