English
Related papers

Related papers: CheXtransfer: Performance and Parameter Efficiency…

200 papers

Almost all the state-of-the-art neural networks for computer vision tasks are trained by (1) pre-training on a large-scale dataset and (2) finetuning on the target dataset. This strategy helps reduce dependence on the target dataset and…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Shuvam Chakraborty , Burak Uzkent , Kumar Ayush , Kumar Tanmay , Evan Sheehan , Stefano Ermon

Transfer learning is a standard technique to improve performance on tasks with limited data. However, for medical imaging, the value of transfer learning is less clear. This is likely due to the large domain mismatch between the usual…

Transfer learning from ImageNet is the go-to approach when applying deep learning to medical images. The approach is either to fine-tune a pre-trained model or use it as a feature extractor. Most modern architecture contain batch…

Computer Vision and Pattern Recognition · Computer Science 2021-02-11 Fahdi Kanavati , Masayuki Tsuneki

Convolutional Neural Networks (CNNs) are frequently and successfully used in medical prediction tasks. They are often used in combination with transfer learning, leading to improved performance when training data for the task are scarce.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Marta Oliveira , Rick Wilming , Benedict Clark , Céline Budding , Fabian Eitel , Kerstin Ritter , Stefan Haufe

Transfer learning is a classic paradigm by which models pretrained on large "upstream" datasets are adapted to yield good results on "downstream" specialized datasets. Generally, more accurate models on the "upstream" dataset tend to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Eugenia Iofinova , Alexandra Peste , Mark Kurtz , Dan Alistarh

While self-supervised pretraining has proven beneficial for many computer vision tasks, it requires expensive and lengthy computation, large amounts of data, and is sensitive to data augmentation. Prior work demonstrates that models…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Colorado J. Reed , Xiangyu Yue , Ani Nrusimha , Sayna Ebrahimi , Vivek Vijaykumar , Richard Mao , Bo Li , Shanghang Zhang , Devin Guillory , Sean Metzger , Kurt Keutzer , Trevor Darrell

Despite the progress in utilizing deep learning to automate chest radiograph interpretation and disease diagnosis tasks, change between sequential Chest X-rays (CXRs) has received limited attention. Monitoring the progression of pathologies…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Gaurang Karwande , Amarachi Mbakawe , Joy T. Wu , Leo A. Celi , Mehdi Moradi , Ismini Lourentzou

The ability to automatically learn task specific feature representations has led to a huge success of deep learning methods. When large training data is scarce, such as in medical imaging problems, transfer learning has been very effective.…

Computer Vision and Pattern Recognition · Computer Science 2017-04-21 Hariharan Ravishankar , Prasad Sudhakar , Rahul Venkataramani , Sheshadri Thiruvenkadam , Pavan Annangi , Narayanan Babu , Vivek Vaidya

The increased availability of X-ray image archives (e.g. the ChestX-ray14 dataset from the NIH Clinical Center) has triggered a growing interest in deep learning techniques. To provide better insight into the different approaches, and their…

Computer Vision and Pattern Recognition · Computer Science 2019-01-30 Ivo M. Baltruschat , Hannes Nickisch , Michael Grass , Tobias Knopp , Axel Saalbach

Clinical deployment of deep learning algorithms for chest x-ray interpretation requires a solution that can integrate into the vast spectrum of clinical workflows across the world. An appealing approach to scaled deployment is to leverage…

Over the last decade, convolutional neural networks (CNNs) have emerged as the leading algorithms in image classification and segmentation. Recent publication of large medical imaging databases have accelerated their use in the biomedical…

Image and Video Processing · Electrical Eng. & Systems 2020-05-11 John McManigle , Raquel Bartz , Lawrence Carin

Transfer learning allows us to exploit knowledge gained from one task to assist in solving another but relevant task. In modern computer vision research, the question is which architecture performs better for a given dataset. In this paper,…

Image and Video Processing · Electrical Eng. & Systems 2022-01-03 Sandhya Aneja , Nagender Aneja , Pg Emeroylariffion Abas , Abdul Ghani Naim

Pre-training a deep neural network on the ImageNet dataset is a common practice for training deep learning models, and generally yields improved performance and faster training times. The technique of pre-training on one task and then…

Machine Learning · Computer Science 2020-01-03 Nishai Kooverjee , Steven James , Terence van Zyl

Automated analysis of chest radiography using deep learning has tremendous potential to enhance the clinical diagnosis of diseases in patients. However, deep learning models typically require large amounts of annotated data to achieve high…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Keegan Quigley , Miriam Cha , Ruizhi Liao , Geeticka Chauhan , Steven Horng , Seth Berkowitz , Polina Golland

In medical image segmentation tasks, the scarcity of labeled training data poses a significant challenge when training deep neural networks. When using U-Net-style architectures, it is common practice to address this problem by pretraining…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Gábor Hidy , Bence Bakos , András Lukács

ImageNet pre-training has enabled state-of-the-art results on many tasks. In spite of its recognized contribution to generalization, we observed in this study that ImageNet pre-training also transfers adversarial non-robustness from…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Jiaming Zhang , Jitao Sang , Qi Yi , Yunfan Yang , Huiwen Dong , Jian Yu

The limited availability of annotated data presents a major challenge for applying deep learning methods to medical image analysis. Few-shot learning methods aim to recognize new classes from only a small number of labeled examples. These…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Berenice Montalvo-Lezama , Gibran Fuentes-Pineda

Visual embeddings from Convolutional Neural Networks (CNN) trained on the ImageNet dataset for the ILSVRC challenge have shown consistently good performance for transfer learning and are widely used in several tasks, including image…

Information Retrieval · Computer Science 2018-09-26 Felipe del Rio , Pablo Messina , Vicente Dominguez , Denis Parra

Chest X-rays (CXRs) are among the most commonly used medical image modalities. They are mostly used for screening, and an indication of disease typically results in subsequent tests. As this is mostly a screening test used to rule out chest…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Ken C. L. Wong , Mehdi Moradi , Joy Wu , Tanveer Syeda-Mahmood

Deep neural networks excel in radiological image classification but frequently suffer from poor interpretability, limiting clinical acceptance. We present MedicalPatchNet, an inherently self-explainable architecture for chest X-ray…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Patrick Wienholt , Christiane Kuhl , Jakob Nikolas Kather , Sven Nebelung , Daniel Truhn