中文
相关论文

相关论文: Trust-SSL: Additive-Residual Selective Invariance …

200 篇论文

Anomalous sound detection (ASD) in the wild requires robustness to distribution shifts such as unseen low-SNR input mixtures of machine and noise types. State-of-the-art systems extract embeddings from an adapted audio encoder and detect…

音频与语音处理 · 电气工程与系统科学 2025-10-30 Phurich Saengthong , Tomoya Nishida , Kota Dohi , Natsuo Yamashita , Yohei Kawaguchi

Self-supervised learning (SSL) is a scalable way to learn general visual representations since it learns without labels. However, large-scale unlabeled datasets in the wild often have long-tailed label distributions, where we know little…

机器学习 · 计算机科学 2022-05-24 Hong Liu , Jeff Z. HaoChen , Adrien Gaidon , Tengyu Ma

Deep neural networks need huge amount of training data, while in real world there is a scarcity of data available for training purposes. To resolve these issues, self-supervised learning (SSL) methods are used. SSL using geometric…

计算机视觉与模式识别 · 计算机科学 2022-02-18 Muhammad Ali , Sayed Hashim

Self-supervised learning (SSL) is one strategy for addressing the paucity of labelled data in medical imaging by learning representations from unlabelled images. Contrastive and non-contrastive SSL methods produce learned representations…

图像与视频处理 · 电气工程与系统科学 2024-03-13 Blake VanBerlo , Alexander Wong , Jesse Hoey , Robert Arntfield

Semi-supervised learning (SSL) has witnessed remarkable progress, resulting in the emergence of numerous method variations. However, practitioners often encounter challenges when attempting to deploy these methods due to their subpar…

机器学习 · 计算机科学 2024-05-21 Kai Gan , Tong Wei

Contrastive Learning (CL), a leading paradigm in Self-Supervised Learning (SSL), typically relies on pairs of data views generated through augmentation. While multiple augmentations per instance (more than two) improve generalization in…

Self-supervised learning (SSL) has recently achieved tremendous empirical advancements in learning image representation. However, our understanding of the principle behind learning such a representation is still limited. This work shows…

计算机视觉与模式识别 · 计算机科学 2023-06-14 Yubei Chen , Adrien Bardes , Zengyi Li , Yann LeCun

We propose a new method for high-dimensional semi-supervised learning problems based on the careful aggregation of the results of a low-dimensional procedure applied to many axis-aligned random projections of the data. Our primary goal is…

统计方法学 · 统计学 2023-04-19 Tengyao Wang , Edgar Dobriban , Milana Gataric , Richard J. Samworth

Self-supervised learning (SSL) is a growing torrent that has recently transformed machine learning and its many real world applications, by learning on massive amounts of unlabeled data via self-generated supervisory signals. Unsupervised…

机器学习 · 计算机科学 2023-08-29 Leman Akoglu , Jaemin Yoo

MatSSL is a streamlined self-supervised learning (SSL) architecture that employs Gated Feature Fusion at each stage of the backbone to integrate multi-level representations effectively. Current micrograph analysis of metallic materials…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Hoang Hai Nam Nguyen , Phan Nguyen Duc Hieu , Ho Won Lee

Self-supervised learning (SSL) applied to natural images has demonstrated a remarkable ability to learn meaningful, low-dimension representations without labels, resulting in models that are adaptable to many different tasks. Until now,…

Self-supervised learning (SSL) learns high-quality representations from large pools of unlabeled training data. As datasets grow larger, it becomes crucial to identify the examples that contribute the most to learning such representations.…

机器学习 · 计算机科学 2024-03-14 Siddharth Joshi , Baharan Mirzasoleiman

Despite the empirical successes of self-supervised learning (SSL) methods, it is unclear what characteristics of their representations lead to high downstream accuracies. In this work, we characterize properties that SSL representations…

机器学习 · 计算机科学 2022-12-13 Yann Dubois , Tatsunori Hashimoto , Stefano Ermon , Percy Liang

Despite the large augmentation family, only a few cherry-picked robust augmentation policies are beneficial to self-supervised image representation learning. In this paper, we propose a directional self-supervised learning paradigm (DSSL),…

计算机视觉与模式识别 · 计算机科学 2021-11-30 Yalong Bai , Yifan Yang , Wei Zhang , Tao Mei

Consistency regularization is one of the most widely-used techniques for semi-supervised learning (SSL). Generally, the aim is to train a model that is invariant to various data augmentations. In this paper, we revisit this idea and find…

计算机视觉与模式识别 · 计算机科学 2021-12-14 Yue Fan , Anna Kukleva , Bernt Schiele

Reconstruction and joint embedding have emerged as two leading paradigms in Self Supervised Learning (SSL). Reconstruction methods focus on recovering the original sample from a different view in input space. On the other hand, joint…

机器学习 · 计算机科学 2025-10-15 Hugues Van Assel , Mark Ibrahim , Tommaso Biancalani , Aviv Regev , Randall Balestriero

We propose a novel semi-supervised learning (SSL) method that adopts selective training with pseudo labels. In our method, we generate hard pseudo-labels and also estimate their confidence, which represents how likely each pseudo-label is…

机器学习 · 计算机科学 2021-03-16 Masato Ishii

While contrastive approaches of self-supervised learning (SSL) learn representations by minimizing the distance between two augmented views of the same data point (positive pairs) and maximizing views from different data points (negative…

机器学习 · 计算机科学 2021-10-11 Yuandong Tian , Xinlei Chen , Surya Ganguli

Cloud contamination significantly impairs the usability of optical satellite imagery, affecting critical applications such as environmental monitoring, disaster response, and land-use analysis. This research presents a Cloud-Attentive…

计算机视觉与模式识别 · 计算机科学 2025-06-25 Trong-An Bui , Thanh-Thoai Le

Self-Supervised Learning (SSL) surmises that inputs and pairwise positive relationships are enough to learn meaningful representations. Although SSL has recently reached a milestone: outperforming supervised methods in many modalities\dots…

机器学习 · 计算机科学 2022-06-13 Randall Balestriero , Yann LeCun