English
Related papers

Related papers: Bio-inspired fine-tuning for selective transfer le…

200 papers

Multitask learning and transfer learning have proven to be useful in the field of machine learning when additional knowledge is available to help a prediction task. We aim at deriving methods following these paradigms for use in autotuning,…

Machine Learning · Computer Science 2019-08-19 Wissam M. Sid-Lakhdar , Mohsen Mahmoudi Aznaveh , Xiaoye S. Li , James W. Demmel

Transfer learning is a critical technique in training deep neural networks for the challenging medical image segmentation task that requires enormous resources. With the abundance of medical image data, many research institutions release…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yuncheng Yang , Meng Wei , Junjun He , Jie Yang , Jin Ye , Yun Gu

Early diagnosis of interstitial lung diseases is crucial for their treatment, but even experienced physicians find it difficult, as their clinical manifestations are similar. In order to assist with the diagnosis, computer-aided diagnosis…

Computer Vision and Pattern Recognition · Computer Science 2016-12-13 Stergios Christodoulidis , Marios Anthimopoulos , Lukas Ebner , Andreas Christe , Stavroula Mougiakakou

A diversified dataset is crucial for training a well-generalized supervised computer vision algorithm. However, in the field of microbiology, generation and annotation of a diverse dataset including field-taken images are time consuming,…

Image and Video Processing · Electrical Eng. & Systems 2023-06-13 Saber Mirzaee Bafti , Chee Siang Ang , Gianluca Marcelli , Md. Moinul Hossain , Sadiya Maxamhud , Anastasios D. Tsaousis

In medical imaging, the heterogeneity of multi-centre data impedes the applicability of deep learning-based methods and results in significant performance degradation when applying models in an unseen data domain, e.g. a new centreor a new…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Hongwei Li , Timo Loehr , Anjany Sekuboyina , Jianguo Zhang , Benedikt Wiestler , Bjoern Menze

Transfer Learning enables Convolutional Neural Networks (CNN) to acquire knowledge from a source domain and transfer it to a target domain, where collecting large-scale annotated examples is time-consuming and expensive. Conventionally,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 S. H. Shabbeer Basha , Debapriya Tula , Sravan Kumar Vinakota , Shiv Ram Dubey

Transfer learning has emerged as a powerful technique in many application problems, such as computer vision and natural language processing. However, this technique is largely ignored in application to genetic data analysis. In this paper,…

Applications · Statistics 2022-06-22 Jinghang Lin , Shan Zhang , Qing Lu

Transfer-learning methods aim to improve performance in a data-scarce target domain using a model pretrained on a data-rich source domain. A cost-efficient strategy, linear probing, involves freezing the source model and training a new…

Machine Learning · Computer Science 2022-07-27 Utku Evci , Vincent Dumoulin , Hugo Larochelle , Michael C. Mozer

Communication scene recognition has been widely applied in practice, but using deep learning to address this problem faces challenges such as insufficient data and imbalanced data distribution. To address this, we designed a weighted loss…

Econometrics · Economics 2026-02-10 Jiasong Han , Yufei Feng , Xiaofeng Zhong

This study proposes a novel biologically-motivated learning method for deep convolutional neural networks (CNNs). The combination of CNNs and back propagation (BP) learning is the most powerful method in recent machine learning regimes.…

Neural and Evolutionary Computing · Computer Science 2020-01-07 Takashi Shinozaki

Transfer learning is widely used for training machine learning models. Here, we study the role of transfer learning for training fully convolutional networks (FCNs) for medical image segmentation. Our experiments show that although transfer…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Davood Karimi , Simon K. Warfield , Ali Gholipour

In this paper we introduce RE-tune, a novel approach for fine-tuning pre-trained Multimodal Biomedical Vision-Language models (VLMs) in Incremental Learning scenarios for multi-label chest disease diagnosis. RE-tune freezes the backbones…

Artificial Intelligence · Computer Science 2024-10-24 Marco Mistretta , Andrew D. Bagdanov

We investigate multiple techniques to improve upon the current state of the art deep convolutional neural network based image classification pipeline. The techiques include adding more image transformations to training data, adding more…

Computer Vision and Pattern Recognition · Computer Science 2013-12-20 Andrew G. Howard

Training deep neural networks using simulations typically requires very large numbers of simulated events. This can be a large computational burden and a limitation in the performance of the deep learning algorithm when insufficient numbers…

High Energy Physics - Experiment · Physics 2023-03-21 Andrew Chappell , Leigh H. Whitehead

Deep learning has emerged as a powerful artificial intelligence tool to interpret medical images for a growing variety of applications. However, the paucity of medical imaging data with high-quality annotations that is necessary for…

Computer Vision and Pattern Recognition · Computer Science 2018-10-02 Faisal Mahmood , Richard Chen , Sandra Sudarsky , Daphne Yu , Nicholas J. Durr

Transfer learning entails taking an artificial neural network (ANN) that is trained on a source dataset and adapting it to a new target dataset. While this has been shown to be quite powerful, its use has generally been restricted by…

Neural and Evolutionary Computing · Computer Science 2020-06-05 AbdElRahman ElSaid , Joshua Karns , Alexander Ororbia , Daniel Krutz , Zimeng Lyu , Travis Desell

In this paper, we introduce deep learning technology to tackle two traditional low-level image processing problems, companding and inverse halftoning. We make two main contributions. First, to the best knowledge of the authors, this is the…

Computer Vision and Pattern Recognition · Computer Science 2017-07-24 Xianxu Hou , Guoping Qiu

Computer-aided diagnosis (CAD) based on histopathological imaging has progressed rapidly in recent years with the rise of machine learning based methodologies. Traditional approaches consist of training a classification model using features…

Computer Vision and Pattern Recognition · Computer Science 2019-03-29 Junaid Malik , Serkan Kiranyaz , Suchitra Kunhoth , Turker Ince , Somaya Al-Maadeed , Ridha Hamila , Moncef Gabbouj

Imaging in clinical routine is subject to changing scanner protocols, hardware, or policies in a typically heterogeneous set of acquisition hardware. Accuracy and reliability of deep learning models suffer from those changes as data and…

Machine Learning · Computer Science 2021-06-08 Matthias Perkonigg , Johannes Hofmanninger , Georg Langs

Knowledge transfer between heterogeneous source and target networks and tasks has received a lot of attention in recent times as large amounts of quality labeled data can be difficult to obtain in many applications. Existing approaches…

Machine Learning · Computer Science 2022-03-17 Keerthiram Murugesan , Vijay Sadashivaiah , Ronny Luss , Karthikeyan Shanmugam , Pin-Yu Chen , Amit Dhurandhar