中文
相关论文

相关论文: Improving Self-supervised Molecular Representation…

200 篇论文

Self-supervised learning (SSL) aims to find meaningful representations from unlabeled data by encoding semantic similarities through data augmentations. Despite its current popularity, theoretical insights about SSL are still scarce. For…

机器学习 · 计算机科学 2025-05-27 Maximilian Fleissner , Pascal Esser , Debarghya Ghoshdastidar

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most methods mainly focus on the instance level information (\ie,…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Self-Supervised Learning (SSL) is a reliable learning mechanism in which a robot uses an original, trusted sensor cue for training to recognize an additional, complementary sensor cue. We study for the first time in SSL how a robot's…

机器人学 · 计算机科学 2016-03-29 Kevin van Hecke , Guido de Croon , Laurens van der Maaten , Daniel Hennes , Dario Izzo

Self-Supervised Learning (SSL) is an increasingly popular ML paradigm that trains models to transform complex inputs into representations without relying on explicit labels. These representations encode similarity structures that enable…

机器学习 · 计算机科学 2022-06-30 Adam Dziedzic , Nikita Dhawan , Muhammad Ahmad Kaleem , Jonas Guan , Nicolas Papernot

Self-supervised learning (SSL) approaches have brought tremendous success across many tasks and domains. It has been argued that these successes can be attributed to a link between SSL and identifiable representation learning: Temporal…

机器学习 · 统计学 2025-06-03 Rodrigo González Laiz , Tobias Schmidt , Steffen Schneider

Self-supervised representation learning (SSL) has attained SOTA results on several downstream speech tasks, but SSL-based speech enhancement (SE) solutions still lag behind. To address this issue, we exploit three main ideas: (i)…

Self-supervised learning (SSL) has recently allowed leveraging large datasets of unlabeled speech signals to reach impressive performance on speech tasks using only small amounts of annotated data. The high number of proposed approaches…

音频与语音处理 · 电气工程与系统科学 2023-06-02 Salah Zaiem , Youcef Kemiche , Titouan Parcollet , Slim Essid , Mirco Ravanelli

Self-supervised learning (SSL) is a machine learning approach where the data itself provides supervision, eliminating the need for external labels. The model is forced to learn about the data structure or context by solving a pretext task.…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Markus Marks , Manuel Knott , Neehar Kondapaneni , Elijah Cole , Thijs Defraeye , Fernando Perez-Cruz , Pietro Perona

Self-supervised learning (SSL) methods have achieved remarkable success in learning image representations allowing invariances in them - but therefore discarding transformation information that some computer vision tasks actually require.…

计算机视觉与模式识别 · 计算机科学 2026-02-11 Qin Wang , Alessio Quercia , Benjamin Bruns , Abigail Morrison , Hanno Scharr , Kai Krajsek

Self-supervised learning (SSL) has become the de facto training paradigm of large models, where pre-training is followed by supervised fine-tuning using domain-specific data and labels. Despite demonstrating comparable performance with…

Successive Subspace Learning (SSL) offers a light-weight unsupervised feature learning method based on inherent statistical properties of data units (e.g. image pixels and points in point cloud sets). It has shown promising results,…

计算机视觉与模式识别 · 计算机科学 2021-03-02 Mozhdeh Rouhsedaghat , Masoud Monajatipoor , Zohreh Azizi , C. -C. Jay Kuo

Computational pathology can lead to saving human lives, but models are annotation hungry and pathology images are notoriously expensive to annotate. Self-supervised learning has shown to be an effective method for utilizing unlabeled data,…

计算机视觉与模式识别 · 计算机科学 2023-04-19 Mingu Kang , Heon Song , Seonwook Park , Donggeun Yoo , Sérgio Pereira

Supervised learning methods have been found to exhibit inductive biases favoring simpler features. When such features are spuriously correlated with the label, this can result in suboptimal performance on minority subgroups. Despite the…

计算机视觉与模式识别 · 计算机科学 2024-06-28 Kimia Hamidieh , Haoran Zhang , Swami Sankaranarayanan , Marzyeh Ghassemi

Self-Supervised Learning (SSL) models have been successfully applied in various deep learning-based speech tasks, particularly those with a limited amount of data. However, the quality of SSL representations depends highly on the…

计算与语言 · 计算机科学 2022-04-20 Dan Berrebbi , Jiatong Shi , Brian Yan , Osbel Lopez-Francisco , Jonathan D. Amith , Shinji Watanabe

Graph representation learning has emerged as a cornerstone for tasks like node classification and link prediction, yet prevailing self-supervised learning (SSL) methods face challenges such as computational inefficiency, reliance on…

机器学习 · 计算机科学 2025-09-04 Srinitish Srinivasan , Omkumar CU

Supervised learning demands large amounts of precisely annotated data to achieve promising results. Such data curation is labor-intensive and imposes significant overhead regarding time and costs. Self-supervised learning (SSL) partially…

计算机视觉与模式识别 · 计算机科学 2025-05-21 Thangarajah Akilan , Nusrat Jahan , Wandong Zhang

As an effective way to alleviate the burden of data annotation, semi-supervised learning (SSL) provides an attractive solution due to its ability to leverage both labeled and unlabeled data to build a predictive model. While significant…

计算机视觉与模式识别 · 计算机科学 2023-09-12 Hai-Ming Xu , Lingqiao Liu , Hao Chen , Ehsan Abbasnejad , Rafael Felix

Continuous unsupervised representation learning (CURL) research has greatly benefited from improvements in self-supervised learning (SSL) techniques. As a result, existing CURL methods using SSL can learn high-quality representations…

机器学习 · 计算机科学 2023-09-13 Alex Gomez-Villa , Bartlomiej Twardowski , Kai Wang , Joost van de Weijer

Self-supervised learning (SSL) has emerged as a desirable paradigm in computer vision due to the inability of supervised models to learn representations that can generalize in domains with limited labels. The recent popularity of SSL has…

机器学习 · 计算机科学 2022-09-20 Romain Cosentino , Sarath Shekkizhar , Mahdi Soltanolkotabi , Salman Avestimehr , Antonio Ortega

Deep learning (DL) finds rich applications in the wireless domain to improve spectrum awareness. Typically, DL models are either randomly initialized following a statistical distribution or pretrained on tasks from other domains in the form…

网络与互联网体系结构 · 计算机科学 2022-11-02 Kemal Davaslioglu , Serdar Boztas , Mehmet Can Ertem , Yalin E. Sagduyu , Ender Ayanoglu