English
Related papers

Related papers: Rethinking Transfer Learning for Medical Image Cla…

200 papers

Fine-tuning is widely applied in image classification tasks as a transfer learning approach. It re-uses the knowledge from a source task to learn and obtain a high performance in target tasks. Fine-tuning is able to alleviate the challenge…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Xuyang Shen , Jo Plested , Sabrina Caldwell , Yiran Zhong , Tom Gedeon

A common approach to transfer learning under distribution shift is to fine-tune the last few layers of a pre-trained model, preserving learned features while also adapting to the new task. This paper shows that in such settings, selectively…

Machine Learning · Computer Science 2023-06-07 Yoonho Lee , Annie S. Chen , Fahim Tajwar , Ananya Kumar , Huaxiu Yao , Percy Liang , Chelsea Finn

Transfer learning (TL) is becoming a powerful tool in scientific applications of neural networks (NNs), such as weather/climate prediction and turbulence modeling. TL enables out-of-distribution generalization (e.g., extrapolation in…

Fluid Dynamics · Physics 2023-07-04 Adam Subel , Yifei Guan , Ashesh Chattopadhyay , Pedram Hassanzadeh

Accurate classification of laryngeal vascular as benign or malignant is crucial for early detection of laryngeal cancer. However, organizations with limited access to laryngeal vascular images face challenges due to the lack of large and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Xinyi Fang , Xu Yang , Chak Fong Chong , Kei Long Wong , Yapeng Wang , Tiankui Zhang , Sio-Kei Im

Research in many fields has shown that transfer learning (TL) is well-suited to improve the performance of deep learning (DL) models in datasets with small numbers of samples. This empirical success has triggered interest in the application…

Neurons and Cognition · Quantitative Biology 2021-11-03 Armin W. Thomas , Ulman Lindenberger , Wojciech Samek , Klaus-Robert Müller

Deep learning algorithms provide a new paradigm to study high-dimensional dynamical behaviors, such as those in fusion plasma systems. Development of novel model reduction methods, coupled with detection of abnormal modes with plasma…

Computational Physics · Physics 2024-04-29 Zhe Bai , Xishuo Wei , William Tang , Leonid Oliker , Zhihong Lin , Samuel Williams

In medical contexts, the imbalanced data distribution in long-tailed datasets, due to scarce labels for rare diseases, greatly impairs the diagnostic accuracy of deep learning models. Recent multimodal text-image supervised foundation…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Sirui Li , Li Lin , Yijin Huang , Pujin Cheng , Xiaoying Tang

Deep Learning (DL) requires a large amount of training data to provide quality outcomes. However, the field of medical imaging suffers from the lack of sufficient data for properly training DL models because medical images require manual…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Laith Alzubaidi , J. Santamaría , Mohamed Manoufali , Beadaa Mohammed , Mohammed A. Fadhel , Jinglan Zhang , Ali H. Al-Timemy , Omran Al-Shamma , Ye Duan

Deep learning has shown substantial progress in image analysis. However, the computational demands of large, fully trained models remain a consideration. Transfer learning offers a strategy for adapting pre-trained models to new tasks.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Jacinto Colan , Ana Davila , Yasuhisa Hasegawa

Early diagnosis of interstitial lung diseases is crucial for their treatment, but even experienced physicians find it difficult, as their clinical manifestations are similar. In order to assist with the diagnosis, computer-aided diagnosis…

Computer Vision and Pattern Recognition · Computer Science 2016-12-13 Stergios Christodoulidis , Marios Anthimopoulos , Lukas Ebner , Andreas Christe , Stavroula Mougiakakou

Medical image segmentation plays a crucial role in clinical diagnosis and treatment planning. Although models based on convolutional neural networks (CNNs) and Transformers have achieved remarkable success in medical image segmentation…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Jiashu Xu

Deep learning has significantly advanced image analysis across diverse domains but often depends on large, annotated datasets for success. Transfer learning addresses this challenge by utilizing pre-trained models to tackle new tasks with…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Ana Davila , Jacinto Colan , Yasuhisa Hasegawa

Using deep learning models pre-trained on Imagenet is the traditional solution for medical image classification to deal with data scarcity. Nevertheless, relevant literature supports that this strategy may offer limited gains due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Julio Silva-Rodriguez , Jihed Chelbi , Waziha Kabir , Hadi Chakor , Jose Dolz , Ismail Ben Ayed , Riadh Kobbi

Transfer learning is beneficial by allowing the expressive features of models pretrained on large-scale datasets to be finetuned for the target task of smaller, more domain-specific datasets. However, there is a concern that these…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Angelina Wang , Olga Russakovsky

Transfer learning from natural image datasets, particularly ImageNet, using standard large models and corresponding pretrained weights has become a de-facto method for deep learning applications to medical imaging. However, there are…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Maithra Raghu , Chiyuan Zhang , Jon Kleinberg , Samy Bengio

Transfer learning is a machine learning technique that uses previously acquired knowledge from a source domain to enhance learning in a target domain by reusing learned weights. This technique is ubiquitous because of its great advantages…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Nermeen Abou Baker , Nico Zengeler , Uwe Handmann

Transfer learning is a machine learning technique designed to improve generalization performance by using pre-trained parameters obtained from other learning tasks. For image recognition tasks, many previous studies have reported that, when…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Aiga Suzuki , Hidenori Sakanashi , Shoji Kido , Hayaru Shouno

Magnetic resonance imaging (MRI) is widely used in clinical practice, but it has been traditionally limited by its slow data acquisition. Recent advances in compressed sensing (CS) techniques for MRI reduce acquisition time while…

Image and Video Processing · Electrical Eng. & Systems 2019-11-06 Bihan Wen , Saiprasad Ravishankar , Luke Pfister , Yoram Bresler

The application of Digital Twin (DT) technology and Federated Learning (FL) has great potential to change the field of biomedical image analysis, particularly for Computed Tomography (CT) scans. This paper presents Federated Transfer…

Image and Video Processing · Electrical Eng. & Systems 2025-09-11 Avais Jan , Qasim Zia , Murray Patterson

Deep transfer learning (DTL) has formed a long-term quest toward enabling deep neural networks (DNNs) to reuse historical experiences as efficiently as humans. This ability is named knowledge transferability. A commonly used paradigm for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Yixiong Chen , Jingxian Li , Chris Ding , Li Liu