English
Related papers

Related papers: Targeted transfer learning to improve performance …

200 papers

Transfer learning refers to the process of adapting a model trained on a source task to a target task. While kernel methods are conceptually and computationally simple machine learning models that are competitive on a variety of tasks, it…

Machine Learning · Computer Science 2022-11-02 Adityanarayanan Radhakrishnan , Max Ruiz Luyten , Neha Prasad , Caroline Uhler

Deep learning-based methods in computational microscopy have been shown to be powerful but in general face some challenges due to limited generalization to new types of samples and requirements for large and diverse training data. Here, we…

Image and Video Processing · Electrical Eng. & Systems 2022-06-13 Luzhe Huang , Xilin Yang , Tairan Liu , Aydogan Ozcan

Brain imaging plays a crucial role in the diagnosis and treatment of various neurological disorders, providing valuable insights into the structure and function of the brain. Techniques such as magnetic resonance imaging (MRI) and computed…

Image and Video Processing · Electrical Eng. & Systems 2025-01-23 Fatima Haimour , Rizik Al-Sayyed , Waleed Mahafza , Omar S. Al-Kadi

This paper provides a starting point for Software Engineering (SE) researchers and practitioners faced with the problem of training machine learning models on small datasets. Due to the high costs associated with labeling data, in Software…

Software Engineering · Computer Science 2021-06-30 Julian Aron Prenner , Romain Robbes

A common approach to transfer learning under distribution shift is to fine-tune the last few layers of a pre-trained model, preserving learned features while also adapting to the new task. This paper shows that in such settings, selectively…

Machine Learning · Computer Science 2023-06-07 Yoonho Lee , Annie S. Chen , Fahim Tajwar , Ananya Kumar , Huaxiu Yao , Percy Liang , Chelsea Finn

In this work, we compare the performance of six state-of-the-art deep neural networks in classification tasks when using only image features, to when these are combined with patient metadata. We utilise transfer learning from networks…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Spencer A. Thomas

Although deep learning models like CNNs have achieved great success in medical image analysis, the small size of medical datasets remains a major bottleneck in this area. To address this problem, researchers have started looking for…

Image and Video Processing · Electrical Eng. & Systems 2021-02-09 Xiaozheng Xie , Jianwei Niu , Xuefeng Liu , Zhengsu Chen , Shaojie Tang , Shui Yu

Pre-training and transfer learning are an important building block of current computer vision systems. While pre-training is usually performed on large real-world image datasets, in this paper we ask whether this is truly necessary. To this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Ryo Nakamura , Ryu Tadokoro , Ryosuke Yamada , Yuki M. Asano , Iro Laina , Christian Rupprecht , Nakamasa Inoue , Rio Yokota , Hirokatsu Kataoka

Meta-Learning is a subarea of Machine Learning that aims to take advantage of prior knowledge to learn faster and with fewer data [1]. There are different scenarios where meta-learning can be applied, and one of the most common is algorithm…

Machine Learning · Computer Science 2019-10-17 Gean Trindade Pereira , Moisés dos Santos , Edesio Alcobaça , Rafael Mantovani , André Carvalho

Knowledge transfer impacts the performance of deep learning -- the state of the art for image classification tasks, including automated melanoma screening. Deep learning's greed for large amounts of training data poses a challenge for…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Afonso Menegola , Michel Fornaciali , Ramon Pires , Flávia Vasques Bittencourt , Sandra Avila , Eduardo Valle

Deep learning has shown promising results in medical image analysis, however, the lack of very large annotated datasets confines its full potential. Although transfer learning with ImageNet pre-trained classification models can alleviate…

Computer Vision and Pattern Recognition · Computer Science 2018-08-16 Ken C. L. Wong , Tanveer Syeda-Mahmood , Mehdi Moradi

Transfer learning is a widely used method to build high performing computer vision models. In this paper, we study the efficacy of transfer learning by examining how the choice of data impacts performance. We find that more pre-training…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Jiquan Ngiam , Daiyi Peng , Vijay Vasudevan , Simon Kornblith , Quoc V. Le , Ruoming Pang

Deep learning techniques have revolutionised medical imaging, improving diagnostic accuracy and enabling both more accurate and earlier disease detection. However, the relationship between pre-training strategies and downstream performance…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Felix Krones

The neural network needs excessive costs of time because of the complexity of architecture when trained on images. Transfer learning and fine-tuning can help improve time and cost efficiency when training a neural network. Yet, Transfer…

Neural and Evolutionary Computing · Computer Science 2020-04-16 Albert Susanto , Herman , Tjeng Wawan Cenggoro , Suharjito , Bens Pardamean

Deep Learning (DL) requires a large amount of training data to provide quality outcomes. However, the field of medical imaging suffers from the lack of sufficient data for properly training DL models because medical images require manual…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Laith Alzubaidi , J. Santamaría , Mohamed Manoufali , Beadaa Mohammed , Mohammed A. Fadhel , Jinglan Zhang , Ali H. Al-Timemy , Omran Al-Shamma , Ye Duan

Limited availability of annotated medical imaging data poses a challenge for deep learning algorithms. Although transfer learning minimizes this hurdle in general, knowledge transfer across disparate domains is shown to be less effective.…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Jitender Singh Virk , Deepti R. Bathula

Deep learning has established the state of the art in multiple fields, including hyperspectral image analysis. However, training large-capacity learners to segment such imagery requires representative training sets. Acquiring such data is…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Jakub Nalepa , Michal Myller , Michal Kawulok

Transfer learning is a widely used strategy in medical image analysis. Instead of only training a network with a limited amount of data from the target task of interest, we can first train the network with other, potentially larger source…

Computer Vision and Pattern Recognition · Computer Science 2019-01-11 Veronika Cheplygina

Transfer learning is a critical technique in training deep neural networks for the challenging medical image segmentation task that requires enormous resources. With the abundance of medical image data, many research institutions release…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yuncheng Yang , Meng Wei , Junjun He , Jie Yang , Jin Ye , Yun Gu

Transfer learning for deep neural networks is the process of first training a base network on a source dataset, and then transferring the learned features (the network's weights) to a second network to be trained on a target dataset. This…

Machine Learning · Computer Science 2019-01-29 Hassan Ismail Fawaz , Germain Forestier , Jonathan Weber , Lhassane Idoumghar , Pierre-Alain Muller