English
Related papers

Related papers: Evaluating Knowledge Transfer in Neural Network fo…

200 papers

In this work we examine the performance enhancement in classification of medical imaging data when image features are combined with associated non-image data. We compare the performance of eight state-of-the-art deep neural networks in…

Image and Video Processing · Electrical Eng. & Systems 2021-11-30 Spencer A. Thomas

Knowledge transfer from large teacher models to smaller student models has recently been studied for metric learning, focusing on fine-grained classification. In this work, focusing on instance-level image retrieval, we study an asymmetric…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 Mateusz Budnik , Yannis Avrithis

Deep learning models have gained increasing adoption in medical image analysis. However, these models often produce overconfident predictions, which can compromise clinical accuracy and reliability. Bridging the gap between high-performance…

Image and Video Processing · Electrical Eng. & Systems 2026-03-24 Jutika Borah , Hidam Kumarjit Singh

Deep learning has emerged as a prominent field in recent literature, showcasing the introduction of models that utilize transfer learning to achieve remarkable accuracies in the classification of brain tumor MRI images. However, the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Raza Imam , Mohammed Talha Alam

Imaging techniques such as Chest X-rays, whole slide images, and optical coherence tomography serve as the initial screening and detection for a wide variety of medical pulmonary and ophthalmic conditions respectively. This paper…

Image and Video Processing · Electrical Eng. & Systems 2024-09-04 Jutika Borah , Kumaresh Sarmah , Hidam Kumarjit Singh

Deep convolutional neural networks (CNNs) have achieved remarkable success in various fields. However, training an excellent CNN is practically a trial-and-error process that consumes a tremendous amount of time and computer resources. To…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Dongyu Liu , Weiwei Cui , Kai Jin , Yuxiao Guo , Huamin Qu

Deep convolutional neural networks (CNNs) have been shown to be very successful in a wide range of image processing applications. However, due to their increasing number of model parameters and an increasing availability of large amounts of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Axel Klawonn , Martin Lanser , Janine Weber

Cases of diabetes and related diabetic retinopathy (DR) have been increasing at an alarming rate in modern times. Early detection of DR is an important problem since it may cause permanent blindness in the late stages. In the last two…

Image and Video Processing · Electrical Eng. & Systems 2021-05-31 Burcu Oltu , Büşra Kübra Karaca , Hamit Erdem , Atilla Özgür

Convolutional Neural Networks (CNN) have revolutionized perception for color images, and their application to sonar images has also obtained good results. But in general CNNs are difficult to train without a large dataset, need manual…

Computer Vision and Pattern Recognition · Computer Science 2017-09-11 Matias Valdenegro-Toro

Image segmentation is a fundamental and challenging problem in computer vision with applications spanning multiple areas, such as medical imaging, remote sensing, and autonomous vehicles. Recently, convolutional neural networks (CNNs) have…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Ali Hatamizadeh

Machine learning using quantum convolutional neural networks (QCNNs) has demonstrated success in both quantum and classical data classification. In previous studies, QCNNs attained a higher classification accuracy than their classical…

Quantum Physics · Physics 2023-09-29 Juhyeon Kim , Joonsuk Huh , Daniel K. Park

Deep neural networks have been investigated in learning latent representations of medical images, yet most of the studies limit their approach in a single supervised convolutional neural network (CNN), which usually rely heavily on a large…

Computer Vision and Pattern Recognition · Computer Science 2017-12-29 Yu-An Chung , Wei-Hung Weng

Transfer learning from ImageNet is the go-to approach when applying deep learning to medical images. The approach is either to fine-tune a pre-trained model or use it as a feature extractor. Most modern architecture contain batch…

Computer Vision and Pattern Recognition · Computer Science 2021-02-11 Fahdi Kanavati , Masayuki Tsuneki

The use of meta-learning and transfer learning in the task of few-shot image classification is a well researched area with many papers showcasing the advantages of transfer learning over meta-learning in cases where data is plentiful and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Joshua Ball

Knowledge Transfer (KT) techniques tackle the problem of transferring the knowledge from a large and complex neural network into a smaller and faster one. However, existing KT methods are tailored towards classification tasks and they…

Machine Learning · Computer Science 2019-03-21 Nikolaos Passalis , Anastasios Tefas

Medical image segmentation is an important step in medical image analysis, especially as a crucial prerequisite for efficient disease diagnosis and treatment. The use of deep learning for image segmentation has become a prevalent trend. The…

Image and Video Processing · Electrical Eng. & Systems 2023-08-11 Wenjian Yao , Jiajun Bai , Wei Liao , Yuheng Chen , Mengjuan Liu , Yao Xie

In medical image analysis, transfer learning is a powerful method for deep neural networks (DNNs) to generalize well on limited medical data. Prior efforts have focused on developing pre-training algorithms on domains such as lung…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Yixiong Chen , Li Liu , Jingxian Li , Hua Jiang , Chris Ding , Zongwei Zhou

Medical imaging deep learning models are often large and complex, requiring specialized hardware to train and evaluate these models. To address such issues, we propose the PocketNet paradigm to reduce the size of deep learning models by…

Image and Video Processing · Electrical Eng. & Systems 2023-11-21 Adrian Celaya , Jonas A. Actor , Rajarajeswari Muthusivarajan , Evan Gates , Caroline Chung , Dawid Schellingerhout , Beatrice Riviere , David Fuentes

We introduce techniques for rapidly transferring the information stored in one neural net into another neural net. The main purpose is to accelerate the training of a significantly larger neural net. During real-world workflows, one often…

Machine Learning · Computer Science 2016-04-26 Tianqi Chen , Ian Goodfellow , Jonathon Shlens

Data is one of the essential ingredients to power deep learning research. Small datasets, especially specific to medical institutes, bring challenges to deep learning training stage. This work aims to develop a practical deep multimodal…

Machine Learning · Computer Science 2019-02-26 Faik Aydin , Maggie Zhang , Michelle Ananda-Rajah , Gholamreza Haffari