中文
相关论文

相关论文: Dissecting Self-Supervised Learning Methods for Su…

200 篇论文

With the progress of sensor technology in wearables, the collection and analysis of PPG signals are gaining more interest. Using Machine Learning, the cardiac rhythm corresponding to PPG signals can be used to predict different tasks such…

信号处理 · 电气工程与系统科学 2022-12-20 Ramin Ghorbani , Marcel J. T. Reinders , David M. J. Tax

Self-supervised learning (SSL), in particular contrastive learning, has made great progress in recent years. However, a common theme in these methods is that they inherit the learning paradigm from the supervised deep learning scenario.…

计算机视觉与模式识别 · 计算机科学 2021-03-26 Yun-Hao Cao , Jianxin Wu

Self-supervised learning (SSL) has proven to be a powerful approach for extracting biologically meaningful representations from single-cell data. To advance our understanding of SSL methods applied to single-cell data, we present…

Self-Supervised Learning (SSL) methods operate on unlabeled data to learn robust representations useful for downstream tasks. Most SSL methods rely on augmentations obtained by transforming the 2D image pixel map. These augmentations ignore…

计算机视觉与模式识别 · 计算机科学 2023-01-30 Sumukh Aithal , Anirudh Goyal , Alex Lamb , Yoshua Bengio , Michael Mozer

Deep Learning is often depicted as a trio of data-architecture-loss. Yet, recent Self Supervised Learning (SSL) solutions have introduced numerous additional design choices, e.g., a projector network, positive views, or teacher-student…

机器学习 · 计算机科学 2024-06-18 Mark Ibrahim , David Klindt , Randall Balestriero

Self-supervised learning (SSL) has recently achieved impressive performance on various time series tasks. The most prominent advantage of SSL is that it reduces the dependence on labeled data. Based on the pre-training and fine-tuning…

Self-supervised learning (SSL) has emerged as a promising solution for addressing the challenge of limited labeled data in deep neural networks (DNNs), offering scalability potential. However, the impact of design dependencies within the…

计算机视觉与模式识别 · 计算机科学 2024-04-16 Shruthi Gowda , Elahe Arani , Bahram Zonooz

This paper presents a production Semi-Supervised Learning (SSL) pipeline based on the student-teacher framework, which leverages millions of unlabeled examples to improve Natural Language Understanding (NLU) tasks. We investigate two…

计算与语言 · 计算机科学 2021-03-31 Luoxin Chen , Francisco Garcia , Varun Kumar , He Xie , Jianhua Lu

Self supervised learning (SSL) has become a very successful technique to harness the power of unlabeled data, with no annotation effort. A number of developed approaches are evolving with the goal of outperforming supervised alternatives,…

计算机视觉与模式识别 · 计算机科学 2022-10-31 Salman Mohamadi , Gianfranco Doretto , Donald A. Adjeroh

As a newly emerging unsupervised learning paradigm, self-supervised learning (SSL) recently gained widespread attention, which usually introduces a pretext task without manual annotation of data. With its help, SSL effectively learns the…

计算机视觉与模式识别 · 计算机科学 2020-05-18 Chuanxing Geng , Zhenghao Tan , Songcan Chen

Existing semi-supervised learning (SSL) methods assume that labeled and unlabeled data share the same class space. However, in real-world applications, unlabeled data always contain classes not present in the labeled set, which may cause…

机器学习 · 计算机科学 2024-01-17 Wenjuan Xi , Xin Song , Weili Guo , Yang Yang

Self-supervised learning (SSL) has emerged as a powerful technique for learning visual representations. While recent SSL approaches achieve strong results in global image understanding, they are limited in capturing the structured…

计算机视觉与模式识别 · 计算机科学 2025-08-28 Oussama Hadjerci , Antoine Letienne , Mohamed Abbas Hedjazi , Adel Hafiane

Automated segmentation of multiple sclerosis (MS) lesions from MRI scans is important to quantify disease progression. In recent years, convolutional neural networks (CNNs) have shown top performance for this task when a large amount of…

计算机视觉与模式识别 · 计算机科学 2023-03-10 Jiacheng Wang , Hao Li , Han Liu , Dewei Hu , Daiwei Lu , Keejin Yoon , Kelsey Barter , Francesca Bagnato , Ipek Oguz

The promise of self-supervised learning (SSL) is to leverage large amounts of unlabeled data to solve complex tasks. While there has been excellent progress with simple, image-level learning, recent methods have shown the advantage of…

计算机视觉与模式识别 · 计算机科学 2022-07-28 Olivier J. Hénaff , Skanda Koppula , Evan Shelhamer , Daniel Zoran , Andrew Jaegle , Andrew Zisserman , João Carreira , Relja Arandjelović

Using large training datasets enhances the generalization capabilities of neural networks. Semi-supervised learning (SSL) is useful when there are few labeled data and a lot of unlabeled data. SSL methods that use data augmentation are most…

计算与语言 · 计算机科学 2024-01-09 Himmet Toprak Kesgin , Mehmet Fatih Amasyali

In the realm of modern diagnostic technology, video capsule endoscopy (VCE) is a standout for its high efficacy and non-invasive nature in diagnosing various gastrointestinal (GI) conditions, including obscure bleeding. Importantly, for the…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Hechen Li , Yanan Wu , Long Bai , An Wang , Tong Chen , Hongliang Ren

Semi-supervised learning (SSL) has a potential to improve the predictive performance of machine learning models using unlabeled data. Although there has been remarkable recent progress, the scope of demonstration in SSL has mainly been on…

计算机视觉与模式识别 · 计算机科学 2020-12-04 Kihyuk Sohn , Zizhao Zhang , Chun-Liang Li , Han Zhang , Chen-Yu Lee , Tomas Pfister

Self-supervised learning (SSL) has recently received significant attention due to its ability to train high-performance encoders purely on unlabeled data-often scraped from the internet. This data can still be sensitive and empirical…

Self-supervised learning (SSL) techniques have recently produced outstanding results in learning visual representations from unlabeled videos. Despite the importance of motion in supervised learning techniques for action recognition, SSL…

计算机视觉与模式识别 · 计算机科学 2023-11-02 Mona Ahmadian , Frank Guerin , Andrew Gilbert

Self-supervised learning (SSL) is an emerging technique that has been successfully employed to train convolutional neural networks (CNNs) and graph neural networks (GNNs) for more transferable, generalizable, and robust representation…

计算机视觉与模式识别 · 计算机科学 2022-09-13 Prarthana Bhattacharyya , Chengjie Huang , Krzysztof Czarnecki