中文
相关论文

相关论文: Unifying Synergies between Self-supervised Learnin…

200 篇论文

This study explores the application of self-supervised learning (SSL) for improved target recognition in synthetic aperture sonar (SAS) imagery. The unique challenges of underwater environments make traditional computer vision techniques,…

计算机视觉与模式识别 · 计算机科学 2023-07-31 BW Sheffield

Transfer learning is crucial in training deep neural networks on new target tasks. Current transfer learning methods always assume at least one of (i) source and target task label spaces overlap, (ii) source datasets are available, and…

机器学习 · 计算机科学 2025-02-21 Shin'ya Yamaguchi , Sekitoshi Kanai , Atsutoshi Kumagai , Daiki Chijiwa , Hisashi Kashima

In recent years, self-supervised learning (SSL) frameworks have been extensively applied to sensor-based Human Activity Recognition (HAR) in order to learn deep representations without data annotations. While SSL frameworks reach…

机器学习 · 计算机科学 2023-08-01 Bulat Khaertdinov , Stylianos Asteriadis

Self-Supervised Learning (SSL) methods operate on unlabeled data to learn robust representations useful for downstream tasks. Most SSL methods rely on augmentations obtained by transforming the 2D image pixel map. These augmentations ignore…

计算机视觉与模式识别 · 计算机科学 2023-01-30 Sumukh Aithal , Anirudh Goyal , Alex Lamb , Yoshua Bengio , Michael Mozer

Self-Supervised Learning (SSL) is a paradigm that leverages unlabeled data for model training. Empirical studies show that SSL can achieve promising performance in distribution shift scenarios, where the downstream and training…

机器学习 · 计算机科学 2023-12-13 Xuyang Zhao , Tianqi Du , Yisen Wang , Jun Yao , Weiran Huang

A combinatory approach of two well-known fields: deep learning and semi supervised learning is presented, to tackle the land cover identification problem. The proposed methodology demonstrates the impact on the performance of deep learning…

计算机视觉与模式识别 · 计算机科学 2020-06-02 Eftychios Protopapadakis , Anastasios Doulamis , Nikolaos Doulamis , Evangelos Maltezos

We approach the challenge of addressing semi-supervised domain generalization (SSDG). Specifically, our aim is to obtain a model that learns domain-generalizable features by leveraging a limited subset of labelled data alongside a…

计算机视觉与模式识别 · 计算机科学 2024-05-08 Chamuditha Jayanga Galappaththige , Sanoojan Baliah , Malitha Gunawardhana , Muhammad Haris Khan

Volume-wise labeling in 3D medical images is a time-consuming task that requires expertise. As a result, there is growing interest in using semi-supervised learning (SSL) techniques to train models with limited labeled data. However, the…

图像与视频处理 · 电气工程与系统科学 2023-10-18 Haonan Wang , Xiaomeng Li

Deep learning is pushing the state-of-the-art in many computer vision applications. However, it relies on large annotated data repositories, and capturing the unconstrained nature of the real-world data is yet to be solved. Semi-supervised…

计算机视觉与模式识别 · 计算机科学 2022-07-29 Mamshad Nayeem Rizve , Navid Kardan , Mubarak Shah

Self-supervised learning (SSL) methods targeting scene images have seen a rapid growth recently, and they mostly rely on either a dedicated dense matching mechanism or a costly unsupervised object discovery module. This paper shows that…

计算机视觉与模式识别 · 计算机科学 2023-10-02 Ke Zhu , Minghao Fu , Jianxin Wu

Deep neural networks have been widely used in communication signal recognition and achieved remarkable performance, but this superiority typically depends on using massive examples for supervised learning, whereas training a deep neural…

信号处理 · 电气工程与系统科学 2023-11-15 Weidong Wang , Hongshu Liao , Lu Gan

Use of Deep Learning (DL) in commercial applications such as image classification, sentiment analysis and speech recognition is increasing. When training DL models with large number of parameters and/or large datasets, cost and speed of…

分布式、并行与集群计算 · 计算机科学 2021-05-28 Medha Atre , Birendra Jha , Ashwini Rao

Self-supervised learning (SSL) is an efficient approach that addresses the issue of limited training data and annotation shortage. The key part in SSL is its proxy task that defines the supervisory signals and drives the learning toward…

计算机视觉与模式识别 · 计算机科学 2021-03-26 Jiuwen Zhu , Yuexiang Li , S. Kevin Zhou

Accurate prediction of the properties of crystalline materials is crucial for targeted discovery, and this prediction is increasingly done with data-driven models. However, for many properties of interest, the number of materials for which…

机器学习 · 计算机科学 2024-09-02 Alexander New , Nam Q. Le , Michael J. Pekala , Christopher D. Stiles

The premise of semi-supervised learning (SSL) is that combining labeled and unlabeled data yields significantly more accurate models. Despite empirical successes, the theoretical understanding of SSL is still far from complete. In this…

机器学习 · 统计学 2024-09-06 Eyar Azar , Boaz Nadler

While self-supervised representation learning (SSL) has received widespread attention from the community, recent research argue that its performance will suffer a cliff fall when the model size decreases. The current method mainly relies on…

计算机视觉与模式识别 · 计算机科学 2022-07-05 Yuting Gao , Jia-Xin Zhuang , Shaohui Lin , Hao Cheng , Xing Sun , Ke Li , Chunhua Shen

Self-supervised learning (SSL) has emerged as a key technique for training networks that can generalize well to diverse tasks without task-specific supervision. This property makes SSL desirable for computational pathology, the study of…

Self-supervised learning (SSL) has emerged as a powerful technique for learning rich representations from unlabeled data. The data representations are able to capture many underlying attributes of data, and be useful in downstream…

机器学习 · 计算机科学 2023-12-01 Weicheng Zhu , Sheng Liu , Carlos Fernandez-Granda , Narges Razavian

Whilst computer vision models built using self-supervised approaches are now commonplace, some important questions remain. Do self-supervised models learn highly redundant channel features? What if a self-supervised network could…

计算机视觉与模式识别 · 计算机科学 2022-12-19 Tarun Krishna , Ayush K. Rai , Yasser A. D. Djilali , Alan F. Smeaton , Kevin McGuinness , Noel E. O'Connor

Early cancer detection is crucial for prognosis, but many cancer types lack large labelled datasets required for developing deep learning models. This paper investigates self-supervised learning (SSL) as an alternative to the standard…

图像与视频处理 · 电气工程与系统科学 2024-11-27 Hamish Haggerty , Rohitash Chandra