中文
相关论文

相关论文: An Investigation into Whitening Loss for Self-supe…

200 篇论文

To avoid collapse in self-supervised learning (SSL), a contrastive loss is widely used but often requires a large number of negative samples. Without negative samples yet achieving competitive performance, a recent work has attracted…

机器学习 · 计算机科学 2022-03-31 Chaoning Zhang , Kang Zhang , Chenshuang Zhang , Trung X. Pham , Chang D. Yoo , In So Kweon

Self-supervised learning (SSL) frameworks consist of pretext task, and loss function aiming to learn useful general features from unlabeled data. The basic idea of most SSL baselines revolves around enforcing the invariance to a variety of…

机器学习 · 计算机科学 2024-12-05 Salman Mohamadi , Gianfranco Doretto , Donald A. Adjeroh

Self-supervised representation learning (SSL) methods provide an effective label-free initial condition for fine-tuning downstream tasks. However, in numerous realistic scenarios, the downstream task might be biased with respect to the…

机器学习 · 计算机科学 2022-11-01 Andrius Ovsianas , Jason Ramapuram , Dan Busbridge , Eeshan Gunesh Dhekane , Russ Webb

We develop biologically plausible training mechanisms for self-supervised learning (SSL) in deep networks. Specifically, by biological plausible training we mean (i) All updates of weights are based on current activities of pre-synaptic…

神经与进化计算 · 计算机科学 2022-02-02 Mufeng Tang , Yibo Yang , Yali Amit

This work proposes a self-supervised learning system for segmenting rigid objects in RGB images. The proposed pipeline is trained on unlabeled RGB-D videos of static objects, which can be captured with a camera carried by a mobile robot. A…

计算机视觉与模式识别 · 计算机科学 2023-04-11 Shiyang Lu , Yunfu Deng , Abdeslam Boularias , Kostas Bekris

Self-supervised learning (SSL) has rapidly advanced in recent years, approaching the performance of its supervised counterparts through the extraction of representations from unlabeled data. However, dimensional collapse, where a few large…

机器学习 · 计算机科学 2024-11-04 Junlin He , Jinxiao Du , Wei Ma

Batch Normalization (BN) is extensively employed in various network architectures by performing standardization within mini-batches. A full understanding of the process has been a central target in the deep learning communities. Unlike…

计算机视觉与模式识别 · 计算机科学 2020-03-30 Lei Huang , Lei Zhao , Yi Zhou , Fan Zhu , Li Liu , Ling Shao

Dense Self-Supervised Learning (SSL) methods address the limitations of using image-level feature representations when handling images with multiple objects. Although the dense features extracted by employing segmentation maps and bounding…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Congpei Qiu , Tong Zhang , Wei Ke , Mathieu Salzmann , Sabine Süsstrunk

Self-supervised learning (SSL) has rapidly emerged as a transformative approach in computer vision, enabling the extraction of rich feature representations from vast amounts of unlabeled data and reducing reliance on costly manual…

计算机视觉与模式识别 · 计算机科学 2025-05-19 Nikolaos Giakoumoglou , Tania Stathaki , Athanasios Gkelias

Self-supervised learning (SSL) provides a promising alternative for representation learning on hypergraphs without costly labels. However, existing hypergraph SSL models are mostly based on contrastive methods with the instance-level…

机器学习 · 计算机科学 2024-04-19 Fan Li , Xiaoyang Wang , Dawei Cheng , Wenjie Zhang , Ying Zhang , Xuemin Lin

Ensembling has proven to be a powerful technique for boosting model performance, uncertainty estimation, and robustness in supervised learning. Advances in self-supervised learning (SSL) enable leveraging large unlabeled corpora for…

Several self-supervised learning (SSL) approaches have shown that redundancy reduction in the feature embedding space is an effective tool for representation learning. However, these methods consider a narrow notion of redundancy, focusing…

机器学习 · 计算机科学 2024-12-10 David Zollikofer , Béni Egressy , Frederik Benzing , Matthias Otth , Roger Wattenhofer

Few-shot image classification aims to classify unseen classes with limited labelled samples. Recent works benefit from the meta-learning process with episodic tasks and can fast adapt to class from training to testing. Due to the limited…

计算机视觉与模式识别 · 计算机科学 2021-02-24 Da Chen , Yuefeng Chen , Yuhong Li , Feng Mao , Yuan He , Hui Xue

Self-supervised learning (SSL) excels at finding general-purpose latent representations from complex data, yet lacks a unifying theoretical framework that explains the diverse existing methods and guides the design of new ones. We cast SSL…

机器学习 · 计算机科学 2026-05-28 Fabian A Mikulasch , Friedemann Zenke

Self-supervised learning (SSL) as an effective paradigm of representation learning has achieved tremendous success on various curated datasets in diverse scenarios. Nevertheless, when facing the long-tailed distribution in real-world…

机器学习 · 计算机科学 2023-10-27 Zhihan Zhou , Jiangchao Yao , Feng Hong , Ya Zhang , Bo Han , Yanfeng Wang

Recent semi-supervised learning (SSL) methods are commonly based on pseudo labeling. Since the SSL performance is greatly influenced by the quality of pseudo labels, mutual learning has been proposed to effectively suppress the noises in…

计算机视觉与模式识别 · 计算机科学 2021-12-28 Pan Zhang , Bo Zhang , Ting Zhang , Dong Chen , Fang Wen

Semi-Supervised Learning (SSL) is important for reducing the annotation cost for medical image segmentation models. State-of-the-art SSL methods such as Mean Teacher, FixMatch and Cross Pseudo Supervision (CPS) are mainly based on…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Weiren Zhao , Lanfeng Zhong , Xin Liao , Wenjun Liao , Sichuan Zhang , Shaoting Zhang , Guotai Wang

The self-supervised learning (SSL) paradigm is an essential exploration area, which tries to eliminate the need for expensive data labeling. Despite the great success of SSL methods in computer vision and natural language processing, most…

机器学习 · 计算机科学 2023-09-13 Piotr Bielak , Tomasz Kajdanowicz , Nitesh V. Chawla

Self-Supervised Learning (SSL) methods operate on unlabeled data to learn robust representations useful for downstream tasks. Most SSL methods rely on augmentations obtained by transforming the 2D image pixel map. These augmentations ignore…

计算机视觉与模式识别 · 计算机科学 2023-01-30 Sumukh Aithal , Anirudh Goyal , Alex Lamb , Yoshua Bengio , Michael Mozer

3D deep learning is a growing field of interest due to the vast amount of information stored in 3D formats. Triangular meshes are an efficient representation for irregular, non-uniform 3D objects. However, meshes are often challenging to…

计算机视觉与模式识别 · 计算机科学 2022-12-23 Ayaan Haque , Hankyu Moon , Heng Hao , Sima Didari , Jae Oh Woo , Patrick Bangert