English
Related papers

Related papers: Evaluating Knowledge Transfer in Neural Network fo…

200 papers

Despite the fact that deep neural networks are powerful models and achieve appealing results on many tasks, they are too large to be deployed on edge devices like smartphones or embedded sensor nodes. There have been efforts to compress…

Machine Learning · Computer Science 2019-12-18 Seyed-Iman Mirzadeh , Mehrdad Farajtabar , Ang Li , Nir Levine , Akihiro Matsukawa , Hassan Ghasemzadeh

In this paper, we propose a Computer Assisted Diagnosis (CAD) system based on a deep Convolutional Neural Network (CNN) model, to build an end-to-end learning process that classifies breast mass lesions. We investigate the impact that has…

Computer Vision and Pattern Recognition · Computer Science 2017-11-30 Hiba Chougrad , Hamid Zouaki , Omar Alheyane

Deep learning integration into medical imaging systems has transformed disease detection and diagnosis processes with a focus on pneumonia identification. The study introduces an intricate deep learning system using Convolutional Neural…

Image and Video Processing · Electrical Eng. & Systems 2025-10-02 P K Dutta , Anushri Chowdhury , Anouska Bhattacharyya , Shakya Chakraborty , Sujatra Dey

Meta-learning has been proposed as a framework to address the challenging few-shot learning setting. The key idea is to leverage a large number of similar few-shot tasks in order to learn how to adapt a base-learner to a new task for which…

Computer Vision and Pattern Recognition · Computer Science 2019-10-10 Qianru Sun , Yaoyao Liu , Zhaozheng Chen , Tat-Seng Chua , Bernt Schiele

Knowledge distillation (KD) has traditionally relied on a static teacher-student framework, where a large, well-trained teacher transfers knowledge to a single student model. However, these approaches often suffer from knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Md. Abdur Rahman , Mohaimenul Azam Khan Raiaan , Sami Azam , Asif Karim , Jemima Beissbarth , Amanda Leach

Diabetic retinopathy (DR) is one of the major blindness-causing diseases currently known. Automatic grading of DR using deep learning methods not only speeds up the diagnosis of the disease but also reduces the rate of misdiagnosis.…

Image and Video Processing · Electrical Eng. & Systems 2023-05-25 Lei Shi , Bin Wang , Junxing Zhang

Optical transmission spectroscopy is one method to understand brain tissue structural properties from brain tissue biopsy samples, yet manual interpretation is resource intensive and prone to inter observer variability. Deep convolutional…

Medical Physics · Physics 2025-05-20 Mohnish Sao , Mousa Alrubayan , Prabhakar Pradhan

Purpose: To test the feasibility of using deep learning for optical coherence tomography angiography (OCTA) detection of diabetic retinopathy (DR). Methods: A deep learning convolutional neural network (CNN) architecture VGG16 was employed…

Quantitative Methods · Quantitative Biology 2021-12-16 David Le , Minhaj Alam , Cham Yao , Jennifer I. Lim , R. V. P. Chan , Devrim Toslak , Xincheng Yao

Recently deep neural networks (DNNs) have been successfully introduced to the field of lensless imaging through scattering media. By solving an inverse problem in computational imaging, DNNs can overcome several shortcomings in the…

Image and Video Processing · Electrical Eng. & Systems 2020-01-01 Yukuan Yang , Lei Deng , Peng Jiao , Yansong Chua , Jing Pei , Cheng Ma , Guoqi Li

Learning-based approaches, especially those based on deep networks, have enabled high-quality estimation of tissue microstructure from low-quality diffusion magnetic resonance imaging (dMRI) scans, which are acquired with a limited number…

Image and Video Processing · Electrical Eng. & Systems 2019-10-25 Yu Qin , Yuxing Li , Zhiwen Liu , Chuyang Ye

Due to memory constraints on current hardware, most convolution neural networks (CNN) are trained on sub-megapixel images. For example, most popular datasets in computer vision contain images much less than a megapixel in size (0.09MP for…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Hans Pinckaers , Bram van Ginneken , Geert Litjens

Convolutional neural networks (CNNs) have been recently used for a variety of histology image analysis. However, availability of a large dataset is a major prerequisite for training a CNN which limits its use by the computational pathology…

Computer Vision and Pattern Recognition · Computer Science 2018-03-07 Ruqayya Awan , Navid Alemi Koohbanani , Muhammad Shaban , Anna Lisowska , Nasir Rajpoot

Transfer learning is a standard technique to transfer knowledge from one domain to another. For applications in medical imaging, transfer from ImageNet has become the de-facto approach, despite differences in the tasks and image…

Machine Learning · Computer Science 2022-06-10 Christos Matsoukas , Johan Fredin Haslum , Moein Sorkhei , Magnus Söderberg , Kevin Smith

Convolutional Neural Networks (CNNs) have become the state-of-the-art in various computer vision tasks, but they are still premature for most sensor data, especially in pervasive and wearable computing. A major reason for this is the…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 Monit Shah Singh , Vinaychandran Pondenkandath , Bo Zhou , Paul Lukowicz , Marcus Liwicki

Knowledge tracing---where a machine models the knowledge of a student as they interact with coursework---is a well established problem in computer supported education. Though effectively modeling student knowledge would have high…

Artificial Intelligence · Computer Science 2015-06-22 Chris Piech , Jonathan Spencer , Jonathan Huang , Surya Ganguli , Mehran Sahami , Leonidas Guibas , Jascha Sohl-Dickstein

Deep transfer learning (DTL) has formed a long-term quest toward enabling deep neural networks (DNNs) to reuse historical experiences as efficiently as humans. This ability is named knowledge transferability. A commonly used paradigm for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Yixiong Chen , Jingxian Li , Chris Ding , Li Liu

Training a deep convolutional neural network (CNN) from scratch is difficult because it requires a large amount of labeled training data and a great deal of expertise to ensure proper convergence. A promising alternative is to fine-tune a…

Computer Vision and Pattern Recognition · Computer Science 2017-06-05 Nima Tajbakhsh , Jae Y. Shin , Suryakanth R. Gurudu , R. Todd Hurst , Christopher B. Kendall , Michael B. Gotway , Jianming Liang

Medical imaging plays a crucial role in modern healthcare by providing non-invasive visualisation of internal structures and abnormalities, enabling early disease detection, accurate diagnosis, and treatment planning. This study aims to…

Image and Video Processing · Electrical Eng. & Systems 2023-09-25 Walid Ehab , Yongmin Li

Medical image interpretation using deep learning has shown promise but often requires extensive expert-annotated datasets. To reduce this annotation burden, we develop an Image-Graph Contrastive Learning framework that pairs chest X-rays…

Image and Video Processing · Electrical Eng. & Systems 2024-05-17 Sameer Khanna , Daniel Michael , Marinka Zitnik , Pranav Rajpurkar

We demonstrate that a deep neural network can significantly improve optical microscopy, enhancing its spatial resolution over a large field-of-view and depth-of-field. After its training, the only input to this network is an image acquired…

Machine Learning · Computer Science 2017-11-21 Yair Rivenson , Zoltan Gorocs , Harun Gunaydin , Yibo Zhang , Hongda Wang , Aydogan Ozcan