中文
相关论文

相关论文: Memorization in Self-Supervised Learning Improves …

200 篇论文

Self-supervised learning (SSL) has led to important breakthroughs in computer vision by allowing learning from large amounts of unlabeled data. As such, it might have a pivotal role to play in biomedicine where annotating data requires a…

计算机视觉与模式识别 · 计算机科学 2024-03-14 Roy Hirsch , Mathilde Caron , Regev Cohen , Amir Livne , Ron Shapiro , Tomer Golany , Roman Goldenberg , Daniel Freedman , Ehud Rivlin

Electroencephalogram (EEG) is a non-invasive technique to record bioelectrical signals. Integrating supervised deep learning techniques with EEG signals has recently facilitated automatic analysis across diverse EEG-based tasks. However,…

信号处理 · 电气工程与系统科学 2024-01-12 Weining Weng , Yang Gu , Shuai Guo , Yuan Ma , Zhaohua Yang , Yuchen Liu , Yiqiang Chen

Self-supervised learning (SSL) is a technique for learning useful representations from unlabeled data. It has been applied effectively to domain adaptation (DA) on images and videos. It is still unknown if and how it can be leveraged for…

计算机视觉与模式识别 · 计算机科学 2022-05-16 Idan Achituve , Haggai Maron , Gal Chechik

Self-supervised learning (SSL) offers a powerful way to learn robust, generalizable representations without labeled data. In music, where labeled data is scarce, existing SSL methods typically use generated supervision and multi-view…

声音 · 计算机科学 2024-11-06 Julia Wilkins , Sivan Ding , Magdalena Fuentes , Juan Pablo Bello

The past few years have witnessed a remarkable advance in deep learning for EEG-based sleep stage classification (SSC). However, the success of these models is attributed to possessing a massive amount of labeled data for training, limiting…

信号处理 · 电气工程与系统科学 2022-10-14 Emadeldeen Eldele , Mohamed Ragab , Zhenghua Chen , Min Wu , Chee-Keong Kwoh , Xiaoli Li

Self-supervised learning (SSL) can be used to solve complex visual tasks without human labels. Self-supervised representations encode useful semantic information about images, and as a result, they have already been used for tasks such as…

计算机视觉与模式识别 · 计算机科学 2023-11-27 Paul Engstler , Luke Melas-Kyriazi , Christian Rupprecht , Iro Laina

Self-supervised learning (SSL) learns high-quality representations from large pools of unlabeled training data. As datasets grow larger, it becomes crucial to identify the examples that contribute the most to learning such representations.…

机器学习 · 计算机科学 2024-03-14 Siddharth Joshi , Baharan Mirzasoleiman

Self-supervised learning (SSL) has revolutionized visual representation learning, but has not achieved the robustness of human vision. A reason for this could be that SSL does not leverage all the data available to humans during learning.…

计算机视觉与模式识别 · 计算机科学 2024-08-09 Arthur Aubret , Céline Teulière , Jochen Triesch

Semi-supervised learning (SSL) has tremendous value in practice due to its ability to utilize both labeled data and unlabelled data. An important class of SSL methods is to naturally represent data as graphs such that the label information…

机器学习 · 计算机科学 2021-03-01 Zixing Song , Xiangli Yang , Zenglin Xu , Irwin King

This study explores the application of self-supervised learning (SSL) for improved target recognition in synthetic aperture sonar (SAS) imagery. The unique challenges of underwater environments make traditional computer vision techniques,…

计算机视觉与模式识别 · 计算机科学 2023-07-31 BW Sheffield

The advancement of deep learning has greatly improved supervised image classification. However, labeling data is costly, prompting research into unsupervised learning methods such as contrastive learning. In real-world scenarios, fully…

人工智能 · 计算机科学 2026-01-09 Shogo Nakayama , Masahiro Okuda

Self-Supervised Learning (SSL) methods harness the concept of semantic invariance by utilizing data augmentation strategies to produce similar representations for different deformations of the same input. Essentially, the model captures the…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Huijie Guo , Ying Ba , Jie Hu , Lingyu Si , Wenwen Qiang , Lei Shi

Given a small set of labeled data and a large set of unlabeled data, semi-supervised learning (SSL) attempts to leverage the location of the unlabeled datapoints in order to create a better classifier than could be obtained from supervised…

机器学习 · 计算机科学 2022-05-25 Michael C. Burkhart , Kyle Shan

Self-supervised learning (SSL) has improved empirical performance by unleashing the power of unlabeled data for practical applications. Specifically, SSL extracts the representation from massive unlabeled data, which will be transferred to…

机器学习 · 计算机科学 2026-02-16 Bo Dai , Na Li , Dale Schuurmans

Self-supervised learning (SSL), which utilizes the input data itself for representation learning, has achieved state-of-the-art results for various downstream speech tasks. However, most of the previous studies focused on offline…

音频与语音处理 · 电气工程与系统科学 2022-11-11 Zili Huang , Zhuo Chen , Naoyuki Kanda , Jian Wu , Yiming Wang , Jinyu Li , Takuya Yoshioka , Xiaofei Wang , Peidong Wang

Mid-level vision capabilities - such as generic object localization and 3D geometric understanding - are not only fundamental to human vision but are also crucial for many real-world applications of computer vision. These abilities emerge…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Xuweiyi Chen , Markus Marks , Zezhou Cheng

Self supervised learning (SSL) has become a very successful technique to harness the power of unlabeled data, with no annotation effort. A number of developed approaches are evolving with the goal of outperforming supervised alternatives,…

计算机视觉与模式识别 · 计算机科学 2022-10-31 Salman Mohamadi , Gianfranco Doretto , Donald A. Adjeroh

Can pretrained models generalize to new datasets without any retraining? We deploy pretrained image models on datasets they were not trained for, and investigate whether their embeddings form meaningful clusters. Our suite of benchmarking…

机器学习 · 计算机科学 2024-06-05 Scott C. Lowe , Joakim Bruslund Haurum , Sageev Oore , Thomas B. Moeslund , Graham W. Taylor

Self-Supervised Learning (SSL) is crucial for real-world applications, especially in data-hungry domains such as healthcare and self-driving cars. In addition to a lack of labeled data, these applications also suffer from distributional…

计算机视觉与模式识别 · 计算机科学 2022-12-26 Ha Manh Bui , Iliana Maifeld-Carucci

Given an unlabeled dataset and an annotation budget, we study how to selectively label a fixed number of instances so that semi-supervised learning (SSL) on such a partially labeled dataset is most effective. We focus on selecting the right…

机器学习 · 计算机科学 2023-08-24 Xudong Wang , Long Lian , Stella X. Yu