中文
相关论文

相关论文: An Investigation into Whitening Loss for Self-supe…

200 篇论文

This study explores the application of self-supervised learning (SSL) for improved target recognition in synthetic aperture sonar (SAS) imagery. The unique challenges of underwater environments make traditional computer vision techniques,…

计算机视觉与模式识别 · 计算机科学 2023-07-31 BW Sheffield

Semi-supervised semantic segmentation (SSSS) aims to improve segmentation performance by utilizing large amounts of unlabeled data with limited labeled samples. Existing methods often suffer from coupling, where over-reliance on initial…

计算机视觉与模式识别 · 计算机科学 2025-04-10 Ebenezer Tarubinga , Jenifer Kalafatovich , Seong-Whan Lee

Self Supervised learning (SSL) has demonstrated its effectiveness in feature learning from unlabeled data. Regarding this success, there have been some arguments on the role that mutual information plays within the SSL framework. Some works…

计算机视觉与模式识别 · 计算机科学 2024-12-04 Salman Mohamadi , Gianfranco Doretto , Donald A. Adjeroh

Self-Supervised Learning (SSL) is an important paradigm for learning representations from unlabelled data, and SSL with neural networks has been highly successful in practice. However current theoretical analysis of SSL is mostly restricted…

机器学习 · 计算机科学 2023-09-06 Pascal Esser , Satyaki Mukherjee , Debarghya Ghoshdastidar

In regularization Self-Supervised Learning (SSL) methods for graphs, computational complexity increases with the number of nodes in graphs and embedding dimensions. To mitigate the scalability of non-contrastive graph SSL, we propose a…

机器学习 · 计算机科学 2024-02-16 Ali Saheb Pasand , Reza Moravej , Mahdi Biparva , Raika Karimi , Ali Ghodsi

Some of the threats in the dynamic environment include the unpredictability of the motion of objects and interferences to the robotic grasp. In such conditions the traditional supervised and reinforcement learning approaches are ill suited…

机器人学 · 计算机科学 2024-10-18 Ankit Shaw

Previous studies dominantly target at self-supervised learning on real-valued networks and have achieved many promising results. However, on the more challenging binary neural networks (BNNs), this task has not yet been fully explored in…

计算机视觉与模式识别 · 计算机科学 2021-06-22 Zhiqiang Shen , Zechun Liu , Jie Qin , Lei Huang , Kwang-Ting Cheng , Marios Savvides

Self-supervised learning (SSL) pipelines differ in many design choices such as the architecture, augmentations, or pretraining data. Yet SSL is typically evaluated using a single metric: linear probing on ImageNet. This does not provide…

机器学习 · 计算机科学 2024-01-09 Yann Dubois , Tatsunori Hashimoto , Percy Liang

Self-supervised learning (SSL) has emerged as an effective paradigm for deriving general representations from vast amounts of unlabeled data. However, as real-world applications continually integrate new content, the high computational and…

机器学习 · 计算机科学 2024-03-28 Wenzhuo Liu , Fei Zhu , Cheng-Lin Liu

Successive Subspace Learning (SSL) offers a light-weight unsupervised feature learning method based on inherent statistical properties of data units (e.g. image pixels and points in point cloud sets). It has shown promising results,…

计算机视觉与模式识别 · 计算机科学 2021-03-02 Mozhdeh Rouhsedaghat , Masoud Monajatipoor , Zohreh Azizi , C. -C. Jay Kuo

Despite the impressive progress of self-supervised learning (SSL), its applicability to low-compute networks has received limited attention. Reported performance has trailed behind standard supervised pre-training by a large margin, barring…

计算机视觉与模式识别 · 计算机科学 2023-10-04 Fuwen Tan , Fatemeh Saleh , Brais Martinez

With the rapid proliferation of mobile devices and data, next-generation wireless communication systems face stringent requirements for ultra-low latency, ultra-high reliability, and massive connectivity. Traditional AI-driven wireless…

信号处理 · 电气工程与系统科学 2024-06-12 Zhixiang Yang , Hongyang Du , Dusit Niyato , Xudong Wang , Yu Zhou , Lei Feng , Fanqin Zhou , Wenjing Li , Xuesong Qiu

In recent years, neural architecture-based recommender systems have achieved tremendous success, but they still fall short of expectation when dealing with highly sparse data. Self-supervised learning (SSL), as an emerging technique for…

信息检索 · 计算机科学 2023-06-05 Junliang Yu , Hongzhi Yin , Xin Xia , Tong Chen , Jundong Li , Zi Huang

Self-supervised learning (SSL) has emerged as a powerful paradigm for learning representations without labeled data, often by enforcing invariance to input transformations such as rotations or blurring. Recent studies have highlighted two…

机器学习 · 计算机科学 2026-02-09 Julie Mordacq , David Loiseaux , Vicky Kalogeiton , Steve Oudot

Published research highlights the presence of demographic bias in automated facial attribute classification. The proposed bias mitigation techniques are mostly based on supervised learning, which requires a large amount of labeled training…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Sreeraj Ramachandran , Ajita Rattani

Whitening is a classical technique in unsupervised learning that can facilitate estimation tasks by standardizing data. An important application is the estimation of latent variable models via the decomposition of tensors built from…

Noisy labels are an unavoidable consequence of labeling processes and detecting them is an important step towards preventing performance degradations in Convolutional Neural Networks. Discarding noisy labels avoids a harmful memorization,…

计算机视觉与模式识别 · 计算机科学 2020-07-28 Diego Ortego , Eric Arazo , Paul Albert , Noel E. O'Connor , Kevin McGuinness

The promise of self-supervised learning (SSL) is to leverage large amounts of unlabeled data to solve complex tasks. While there has been excellent progress with simple, image-level learning, recent methods have shown the advantage of…

计算机视觉与模式识别 · 计算机科学 2022-07-28 Olivier J. Hénaff , Skanda Koppula , Evan Shelhamer , Daniel Zoran , Andrew Jaegle , Andrew Zisserman , João Carreira , Relja Arandjelović

Self-supervised learning (SSL) is a powerful tool in machine learning, but understanding the learned representations and their underlying mechanisms remains a challenge. This paper presents an in-depth empirical analysis of SSL-trained…

机器学习 · 计算机科学 2023-06-01 Ido Ben-Shaul , Ravid Shwartz-Ziv , Tomer Galanti , Shai Dekel , Yann LeCun

Semi-supervised learning (SSL) provides an effective means of leveraging unlabelled data to improve a model performance. Even though the domain has received a considerable amount of attention in the past years, most methods present the…

机器学习 · 统计学 2023-03-06 Hugo Schmutz , Olivier Humbert , Pierre-Alexandre Mattei