中文
相关论文

相关论文: On the Difficulty of Defending Self-Supervised Lea…

200 篇论文

Self-supervised learning (SSL) has developed rapidly in recent years. However, most of the mainstream methods are computationally expensive and rely on two (or more) augmentations for each image to construct positive pairs. Moreover, they…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Yun-Hao Cao , Jianxin Wu

Recently, deep learning has experienced rapid expansion, contributing significantly to the progress of supervised learning methodologies. However, acquiring labeled data in real-world settings can be costly, labor-intensive, and sometimes…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Jicheng Yuan , Anh Le-Tuan , Ali Ganbarov , Manfred Hauswirth , Danh Le-Phuoc

Semi-supervised learning (SSL) is the branch of machine learning that aims to improve learning performance by leveraging unlabeled data when labels are insufficient. Recently, SSL with deep models has proven to be successful on standard…

机器学习 · 计算机科学 2022-11-15 Lan-Zhe Guo , Zhi Zhou , Yu-Feng Li

Self-supervised learning (SSL) has advanced significantly in visual representation learning, yet comprehensive evaluations of its adversarial robustness remain limited. In this study, we evaluate the adversarial robustness of seven…

计算机视觉与模式识别 · 计算机科学 2025-09-25 Ömer Veysel Çağatan , Ömer Faruk Tal , M. Emre Gürsoy

Simplicial Embeddings (SEM) are representations learned through self-supervised learning (SSL), wherein a representation is projected into $L$ simplices of $V$ dimensions each using a softmax operation. This procedure conditions the…

The promise of self-supervised learning (SSL) is to leverage large amounts of unlabeled data to solve complex tasks. While there has been excellent progress with simple, image-level learning, recent methods have shown the advantage of…

计算机视觉与模式识别 · 计算机科学 2022-07-28 Olivier J. Hénaff , Skanda Koppula , Evan Shelhamer , Daniel Zoran , Andrew Jaegle , Andrew Zisserman , João Carreira , Relja Arandjelović

Self-supervised learning (SSL) has been incorporated into many state-of-the-art models in various domains, where SSL defines pretext tasks based on unlabeled datasets to learn contextualized and robust representations. Recently, SSL has…

机器学习 · 计算机科学 2024-09-11 Wei-Yao Wang , Wei-Wei Du , Derek Xu , Wei Wang , Wen-Chih Peng

Machine learning (ML) has become a core component of many real-world applications and training data is a key factor that drives current progress. This huge success has led Internet companies to deploy machine learning as a service (MLaaS).…

密码学与安全 · 计算机科学 2018-12-18 Ahmed Salem , Yang Zhang , Mathias Humbert , Pascal Berrang , Mario Fritz , Michael Backes

A major limitation in applying deep learning to artificial intelligence (AI) systems is the scarcity of high-quality curated datasets. We investigate strong augmentation based self-supervised learning (SSL) techniques to address this…

图像与视频处理 · 电气工程与系统科学 2022-03-18 John D. Miller , Vignesh A. Arasu , Albert X. Pu , Laurie R. Margolies , Weiva Sieh , Li Shen

Reinforcement learning (RL) has shown great success in estimating sequential treatment strategies which take into account patient heterogeneity. However, health-outcome information, which is used as the reward for reinforcement learning…

机器学习 · 计算机科学 2021-02-24 Aaron Sonabend-W , Nilanjana Laha , Ashwin N. Ananthakrishnan , Tianxi Cai , Rajarshi Mukherjee

Machine Learning-as-a-Service (MLaaS) has become a widespread paradigm, making even the most complex machine learning models available for clients via e.g. a pay-per-query principle. This allows users to avoid time-consuming processes of…

机器学习 · 计算机科学 2023-06-07 Daryna Oliynyk , Rudolf Mayer , Andreas Rauber

Self-supervised learning (SSL) has produced a diverse landscape of vision transformers (ViTs) whose pretrained representations support a wide range of downstream tasks. Towards a better understanding of these models, a body of work has…

计算机视觉与模式识别 · 计算机科学 2026-05-29 Xiaoyan Yu , Lisa Mais , Jannik Franzen , Peter Hirsch , Nick Lechtenbörger , Andreas Mardt , Dagmar Kainmüller

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most methods mainly focus on the instance level information (\ie,…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

This study explores the application of self-supervised learning (SSL) for improved target recognition in synthetic aperture sonar (SAS) imagery. The unique challenges of underwater environments make traditional computer vision techniques,…

计算机视觉与模式识别 · 计算机科学 2023-07-31 BW Sheffield

While deep learning models have shown significant performance across various domains, their deployment needs extensive resources and advanced computing infrastructure. As a solution, Machine Learning as a Service (MLaaS) has emerged,…

密码学与安全 · 计算机科学 2024-01-09 Yi Xie , Jie Zhang , Shiqian Zhao , Tianwei Zhang , Xiaofeng Chen

Deep learning is pushing the state-of-the-art in many computer vision applications. However, it relies on large annotated data repositories, and capturing the unconstrained nature of the real-world data is yet to be solved. Semi-supervised…

计算机视觉与模式识别 · 计算机科学 2022-07-29 Mamshad Nayeem Rizve , Navid Kardan , Mubarak Shah

Self-supervised learning (SSL) has emerged as a powerful paradigm for learning representations without labeled data. Most SSL approaches rely on strong, well-established, handcrafted data augmentations to generate diverse views for…

机器学习 · 计算机科学 2026-01-16 Berken Utku Demirel , Christian Holz

Machine learning models trained on confidential datasets are increasingly being deployed for profit. Machine Learning as a Service (MLaaS) has made such models easily accessible to end-users. Prior work has developed model extraction…

机器学习 · 计算机科学 2019-05-23 Soham Pal , Yash Gupta , Aditya Shukla , Aditya Kanade , Shirish Shevade , Vinod Ganapathy

Self-supervised learning (SSL) is a powerful technique for learning from unlabeled data. By learning to remain invariant to applied data augmentations, methods such as SimCLR and MoCo can reach quality on par with supervised approaches.…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Marcin Przewięźlikowski , Mateusz Pyla , Bartosz Zieliński , Bartłomiej Twardowski , Jacek Tabor , Marek Śmieja

Self-supervised learning has gained significant attention in contemporary applications, particularly due to the scarcity of labeled data. While existing SSL methodologies primarily address feature variance and linear correlations, they…

机器学习 · 计算机科学 2025-11-18 M. Hadi Sepanj , Benyamin Ghojogh , Paul Fieguth