中文
相关论文

相关论文: Exploring Transferability of Self-Supervised Learn…

200 篇论文

Transfer learning aims to learn classifiers for a target domain by transferring knowledge from a source domain. However, due to two main issues: feature discrepancy and distribution divergence, transfer learning can be a very difficult…

机器学习 · 计算机科学 2022-09-05 Md Geaur Rahman , Md Zahidul Islam

Self-supervised learning (SSL) has emerged as a powerful technique for learning rich representations from unlabeled data. The data representations are able to capture many underlying attributes of data, and be useful in downstream…

机器学习 · 计算机科学 2023-12-01 Weicheng Zhu , Sheng Liu , Carlos Fernandez-Granda , Narges Razavian

Transfer learning aims to transfer knowledge or information from a source domain to a relevant target domain. In this paper, we understand transfer learning from the perspectives of knowledge transferability and trustworthiness. This…

机器学习 · 计算机科学 2025-11-13 Jun Wu , Jingrui He

Self-supervised learning (SSL), as a newly emerging unsupervised representation learning paradigm, generally follows a two-stage learning pipeline: 1) learning invariant and discriminative representations with auto-annotation pretext(s),…

机器学习 · 计算机科学 2022-08-23 Jiayu Yao , Qingyuan Wu , Quan Feng , Songcan Chen

Transfer learning has been developed to improve the performances of different but related tasks in machine learning. However, such processes become less efficient with the increase of the size of training data and the number of tasks.…

机器学习 · 计算机科学 2018-03-28 Rui Zhang , Quanyan Zhu

In activity recognition, it is often expensive and time-consuming to acquire sufficient activity labels. To solve this problem, transfer learning leverages the labeled samples from the source domain to annotate the target domain which has…

计算机视觉与模式识别 · 计算机科学 2018-01-04 Jindong Wang , Yiqiang Chen , Lisha Hu , Xiaohui Peng , Philip S. Yu

Transfer Learning (TL) aims to transfer knowledge acquired in one problem, the source problem, onto another problem, the target problem, dispensing with the bottom-up construction of the target model. Due to its relevance, TL has gained…

The growing popularity of transfer learning, due to the availability of models pre-trained on vast amounts of data, makes it imperative to understand when the knowledge of these pre-trained models can be transferred to obtain…

机器学习 · 计算机科学 2024-10-30 Akshay Mehra , Yunbei Zhang , Jihun Hamm

Self-supervised learning (SSL), especially contrastive methods, has raised attraction recently as it learns effective transferable representations without semantic annotations. A common practice for self-supervised pre-training is to use as…

计算机视觉与模式识别 · 计算机科学 2022-05-27 Zhili Liu , Jianhua Han , Lanqing Hong , Hang Xu , Kai Chen , Chunjing Xu , Zhenguo Li

Many machine learning and data mining algorithms rely on the assumption that the training and testing data share the same feature space and distribution. However, this assumption may not always hold. For instance, there are situations where…

密码学与安全 · 计算机科学 2024-03-05 Adrian Shuai Li , Arun Iyengar , Ashish Kundu , Elisa Bertino

Self-supervised learning (SSL) has demonstrated its effectiveness in learning representations through comparison methods that align with human intuition. However, mainstream SSL methods heavily rely on high body datasets with single label,…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Jiale Chen

As an effective learning paradigm against insufficient training samples, Multi-Task Learning (MTL) encourages knowledge sharing across multiple related tasks so as to improve the overall performance. In MTL, a major challenge springs from…

机器学习 · 计算机科学 2020-04-30 Zhiyong Yang , Qianqian Xu , Xiaochun Cao , Qingming Huang

Self-supervised learning (SSL) has emerged as an effective paradigm for deriving general representations from vast amounts of unlabeled data. However, as real-world applications continually integrate new content, the high computational and…

机器学习 · 计算机科学 2024-03-28 Wenzhuo Liu , Fei Zhu , Cheng-Lin Liu

Unsupervised domain adaptation without consuming annotation process for unlabeled target data attracts appealing interests in semantic segmentation. However, 1) existing methods neglect that not all semantic representations across domains…

计算机视觉与模式识别 · 计算机科学 2020-08-25 Jiahua Dong , Yang Cong , Gan Sun , Yuyang Liu , Xiaowei Xu

Self-supervised learning (SSL) has achieved remarkable performance in various medical imaging tasks by dint of priors from massive unlabelled data. However, regarding a specific downstream task, there is still a lack of an instruction book…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Chuyan Zhang , Yun Gu

Automated segmentation of multiple sclerosis (MS) lesions from MRI scans is important to quantify disease progression. In recent years, convolutional neural networks (CNNs) have shown top performance for this task when a large amount of…

计算机视觉与模式识别 · 计算机科学 2023-03-10 Jiacheng Wang , Hao Li , Han Liu , Dewei Hu , Daiwei Lu , Keejin Yoon , Kelsey Barter , Francesca Bagnato , Ipek Oguz

Artificial intelligence (AI) is anticipated to play a pivotal role in 6G. However, a key challenge in developing AI-powered solutions is the extensive data collection and labeling efforts required to train supervised deep learning models.…

信号处理 · 电气工程与系统科学 2025-09-04 Ogechukwu Kanu , Ashkan Eshaghbeigi , Hatem Abou-Zeid

Transfer learning has become an essential paradigm in artificial intelligence, enabling the transfer of knowledge from a source task to improve performance on a target task. This approach, particularly through techniques such as pretraining…

The human brain can effectively learn a new task from a small number of samples, which indicate that the brain can transfer its prior knowledge to solve tasks in different domains. This function is analogous to transfer learning (TL) in the…

计算机视觉与模式识别 · 计算机科学 2020-07-06 Satoshi Nishida , Yusuke Nakano , Antoine Blanc , Naoya Maeda , Masataka Kado , Shinji Nishimoto

Semi-Supervised Learning (SSL) has been proved to be an effective way to leverage both labeled and unlabeled data at the same time. Recent semi-supervised approaches focus on deep neural networks and have achieved promising results on…

计算机视觉与模式识别 · 计算机科学 2018-12-14 Hong-Yu Zhou , Avital Oliver , Jianxin Wu , Yefeng Zheng