English
Related papers

Related papers: Transfer Learning for Segmentation Problems: Choos…

200 papers

A common practice in transfer learning is to initialize the downstream model weights by pre-training on a data-abundant upstream task. In object detection specifically, the feature backbone is typically initialized with Imagenet classifier…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Cristina Vasconcelos , Vighnesh Birodkar , Vincent Dumoulin

Deep learning has established the state of the art in multiple fields, including hyperspectral image analysis. However, training large-capacity learners to segment such imagery requires representative training sets. Acquiring such data is…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Jakub Nalepa , Michal Myller , Michal Kawulok

When it comes to the classification of brain signals in real-life applications, the training and the prediction data are often described by different distributions. Furthermore, diverse data sets, e.g., recorded from various subjects or…

Single encoder-decoder methodologies for semantic segmentation are reaching their peak in terms of segmentation quality and efficiency per number of layers. To address these limitations, we propose a new architecture based on a decoder…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Gabriel L. Oliveira , Senthil Yogamani , Wolfram Burgard , Thomas Brox

The ability to automatically learn task specific feature representations has led to a huge success of deep learning methods. When large training data is scarce, such as in medical imaging problems, transfer learning has been very effective.…

Computer Vision and Pattern Recognition · Computer Science 2017-04-21 Hariharan Ravishankar , Prasad Sudhakar , Rahul Venkataramani , Sheshadri Thiruvenkadam , Pavan Annangi , Narayanan Babu , Vivek Vaidya

Deep learning has shown promising results in medical image analysis, however, the lack of very large annotated datasets confines its full potential. Although transfer learning with ImageNet pre-trained classification models can alleviate…

Computer Vision and Pattern Recognition · Computer Science 2018-08-16 Ken C. L. Wong , Tanveer Syeda-Mahmood , Mehdi Moradi

Transfer learning from natural image datasets, particularly ImageNet, using standard large models and corresponding pretrained weights has become a de-facto method for deep learning applications to medical imaging. However, there are…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Maithra Raghu , Chiyuan Zhang , Jon Kleinberg , Samy Bengio

Image segmentation is often ambiguous at the level of individual image patches and requires contextual information to reach label consensus. In this paper we introduce Segmenter, a transformer model for semantic segmentation. In contrast to…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Robin Strudel , Ricardo Garcia , Ivan Laptev , Cordelia Schmid

The growing use of Machine Learning has produced significant advances in many fields. For image-based tasks, however, the use of deep learning remains challenging in small datasets. In this article, we review, evaluate and compare the…

Machine Learning · Computer Science 2021-06-09 Miguel Romero , Yannet Interian , Timothy Solberg , Gilmer Valdes

Meta-learning has been widely used for implementing few-shot learning and fast model adaptation. One kind of meta-learning methods attempt to learn how to control the gradient descent process in order to make the gradient-based learning…

Machine Learning · Computer Science 2019-11-20 Jialin Liu , Fei Chao , Longzhi Yang , Chih-Min Lin , Qiang Shen

Recent fast style transfer methods use a pre-trained convolutional neural network as a feature encoder and a perceptual loss network. Although the pre-trained network is used to generate responses of receptive fields effective for…

Computer Vision and Pattern Recognition · Computer Science 2018-07-05 Minseong Kim , Jongju Shin , Myung-Cheol Roh , Hyun-Chul Choi

Accurate decoding of surface electromyography (sEMG) is pivotal for muscle-to-machine-interfaces (MMI) and their application for e.g. rehabilitation therapy. sEMG signals have high inter-subject variability, due to various factors,…

Machine Learning · Computer Science 2022-01-03 Stephan Johann Lehmler , Muhammad Saif-ur-Rehman , Tobias Glasmachers , Ioannis Iossifidis

In the domain of computer vision, deep residual neural networks like EfficientNet have set new standards in terms of robustness and accuracy. One key problem underlying the training of deep neural networks is the immanent lack of a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Raoul Schönhof , Jannes Elstner , Radu Manea , Steffen Tauber , Ramez Awad , Marco F. Huber

Electroencephalography (EEG) decoding is a challenging task due to the limited availability of labelled data. While transfer learning is a promising technique to address this challenge, it assumes that transferable data domains and task are…

Signal Processing · Electrical Eng. & Systems 2023-08-07 Bruno Aristimunha , Raphael Y. de Camargo , Walter H. Lopez Pinaya , Sylvain Chevallier , Alexandre Gramfort , Cedric Rommel

Transfer learning with pre-trained neural networks is a common strategy for training classifiers in medical image analysis. Without proper channel selections, this often results in unnecessarily large models that hinder deployment and…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Ken C. L. Wong , Satyananda Kashyap , Mehdi Moradi

Supervised learning has been very successful for automatic segmentation of images from a single scanner. However, several papers report deteriorated performances when using classifiers trained on images from one scanner to segment images…

Computer Vision and Pattern Recognition · Computer Science 2017-03-16 Veronika Cheplygina , Annegreet van Opbroek , M. Arfan Ikram , Meike W. Vernooij , Marleen de Bruijne

Transfer learning leverages pre-trained model features from a large dataset to save time and resources when training new models for various tasks, potentially enhancing performance. Due to the lack of large datasets in the medical imaging…

Image and Video Processing · Electrical Eng. & Systems 2023-11-10 Gabriel Efrain Humpire-Mamani , Colin Jacobs , Mathias Prokop , Bram van Ginneken , Nikolas Lessmann

Transfer learning using deep neural networks as feature extractors has become increasingly popular over the past few years. It allows to obtain state-of-the-art accuracy on datasets too small to train a deep neural network on its own, and…

Machine Learning · Computer Science 2017-10-25 Vincent Gripon , Ghouthi B. Hacene , Matthias Löwe , Franck Vermet

Knowledge transfer impacts the performance of deep learning -- the state of the art for image classification tasks, including automated melanoma screening. Deep learning's greed for large amounts of training data poses a challenge for…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Afonso Menegola , Michel Fornaciali , Ramon Pires , Flávia Vasques Bittencourt , Sandra Avila , Eduardo Valle

Transfer learning is a critical technique in training deep neural networks for the challenging medical image segmentation task that requires enormous resources. With the abundance of medical image data, many research institutions release…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yuncheng Yang , Meng Wei , Junjun He , Jie Yang , Jin Ye , Yun Gu