English
Related papers

Related papers: Explainable Knowledge Distillation for Efficient M…

200 papers

This paper presents the FuzzyDistillViT-MobileNet model, a novel approach for lung cancer (LC) classification, leveraging dynamic fuzzy logic-driven knowledge distillation (KD) to address uncertainty and complexity in disease diagnosis.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Saif Ur Rehman Khan , Muhammad Nabeel Asim , Sebastian Vollmer , Andreas Dengel

In this paper, we tackle a new problem: how to transfer knowledge from the pre-trained cumbersome yet well-performed CNN-based model to learn a compact Vision Transformer (ViT)-based model while maintaining its learning capacity? Due to the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Xu Zheng , Yunhao Luo , Pengyuan Zhou , Lin Wang

Tuberculosis (TB) remains one of the leading causes of mortality worldwide, particularly in resource-limited countries. Chest X-ray (CXR) imaging serves as an accessible and cost-effective diagnostic tool but requires expert interpretation,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Marshal Ashif Shawkat , Moidul Hasan , Taufiq Hasan

Timely and rapid diagnoses are core to informing on optimum interventions that curb the spread of COVID-19. The use of medical images such as chest X-rays and CTs has been advocated to supplement the Reverse-Transcription Polymerase Chain…

Image and Video Processing · Electrical Eng. & Systems 2023-05-31 Ogechukwu Ukwandu , Hanan Hindy , Elochukwu Ukwandu

High-quality annotation of fine-grained visual categories demands great expert knowledge, which is taxing and time consuming. Alternatively, learning fine-grained visual representation from enormous unlabeled images (e.g., species, brands)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Qi Bi , Wei Ji , Jingjun Yi , Haolan Zhan , Gui-Song Xia

COVID-19 pandemic has spread rapidly and caused a shortage of global medical resources. The efficiency of COVID-19 diagnosis has become highly significant. As deep learning and convolutional neural network (CNN) has been widely utilized and…

Image and Video Processing · Electrical Eng. & Systems 2022-05-30 Alexandros Shikun Zhang , Naomi Fengqi Li

Vision Transformers (ViTs) have achieved significant advancement in computer vision tasks due to their powerful modeling capacity. However, their performance notably degrades when trained with insufficient data due to lack of inherent…

Image and Video Processing · Electrical Eng. & Systems 2025-03-04 Omar S. EL-Assiouti , Ghada Hamed , Dina Khattab , Hala M. Ebied

Can one learn to diagnose COVID-19 under extreme minimal supervision? Since the outbreak of the novel COVID-19 there has been a rush for developing Artificial Intelligence techniques for expert-level disease identification on Chest X-ray…

Machine Learning · Computer Science 2021-07-06 Angelica I Aviles-Rivero , Philip Sellars , Carola-Bibiane Schönlieb , Nicolas Papadakis

The ongoing COVID-19 pandemic has already taken millions of lives and damaged economies across the globe. Most COVID-19 deaths and economic losses are reported from densely crowded cities. It is comprehensible that the effective control and…

Image and Video Processing · Electrical Eng. & Systems 2022-08-04 Zeba Ghaffar , Pir Masoom Shah , Hikmat Khan , Syed Farhan Alam Zaidi , Abdullah Gani , Izaz Ahmad Khan , Munam Ali Shah , Saif ul Islam

Knowledge distillation involves transferring the predictive capabilities of large, high-performing AI models (teachers) to smaller models (students) that can operate in environments with limited computing power. In this paper, we address…

Machine Learning · Computer Science 2026-01-12 Pattarawat Chormai , Ali Hashemi , Klaus-Robert Müller , Grégoire Montavon

COVID19 is a highly contagious disease infected millions of people worldwide. With limited testing components, screening tools such as chest radiography can assist the clinicians in the diagnosis and assessing the progress of disease. The…

Image and Video Processing · Electrical Eng. & Systems 2023-04-11 Zanoby N. Khan

COVID-19 was a significant challenge that led to the loss of numerous lives daily. Not only a certain country was involved in this outbreak, but even the world has suffered because of the coronavirus. Imaging techniques using computed…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Sarmad Khan , Arslan Shaukat , Umer Asgher , Basim Azam

Quick and accurate diagnosis is of paramount importance to mitigate the effects of COVID-19 infection, particularly for severe cases. Enormous effort has been put towards developing deep learning methods to classify and detect COVID-19…

Image and Video Processing · Electrical Eng. & Systems 2022-06-28 Muhammad Ridzuan , Ameera Ali Bawazir , Ivo Gollini Navarette , Ibrahim Almakky , Mohammad Yaqub

Knowledge distillation (KD) has demonstrated remarkable success across various domains, but its application to medical imaging tasks, such as kidney and liver tumor segmentation, has encountered challenges. Many existing KD methods are not…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Vandan Gorade , Sparsh Mittal , Debesh Jha , Ulas Bagci

Previous Knowledge Distillation based efficient image retrieval methods employs a lightweight network as the student model for fast inference. However, the lightweight student model lacks adequate representation capacity for effective…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Yi Xie , Huaidong Zhang , Xuemiao Xu , Jianqing Zhu , Shengfeng He

The worldwide COVID-19 pandemic has profoundly influenced the health and everyday experiences of individuals across the planet. It is a highly contagious respiratory disease requiring early and accurate detection to curb its rapid…

Image and Video Processing · Electrical Eng. & Systems 2025-06-10 Md. Alamin Talukder , Md. Abu Layek , Mohsin Kazi , Md Ashraf Uddin , Sunil Aryal

Although deep learning-based computer-aided diagnosis systems have recently achieved expert-level performance, developing a robust deep learning model requires large, high-quality data with manual annotation, which is expensive to obtain.…

Image and Video Processing · Electrical Eng. & Systems 2022-10-12 Sangjoon Park , Gwanghyun Kim , Yujin Oh , Joon Beom Seo , Sang Min Lee , Jin Hwan Kim , Sungjun Moon , Jae-Kwang Lim , Chang Min Park , Jong Chul Ye

In the light of the COVID-19 pandemic, deep learning methods have been widely investigated in detecting COVID-19 from chest X-rays. However, a more pragmatic approach to applying AI methods to a medical diagnosis is designing a framework…

Image and Video Processing · Electrical Eng. & Systems 2020-12-01 Sahithya Ravi , Samaneh Khoshrou , Mykola Pechenizkiy

Automatic segmentation of infected regions in computed tomography (CT) images is necessary for the initial diagnosis of COVID-19. Deep-learning-based methods have the potential to automate this task but require a large amount of data with…

Image and Video Processing · Electrical Eng. & Systems 2022-09-28 Han Chen , Yifan Jiang , Hanseok Ko , Murray Loew

Artificial Intelligence (AI) has made leapfrogs in development across all the industrial sectors especially when deep learning has been introduced. Deep learning helps to learn the behaviour of an entity through methods of recognising and…

Machine Learning · Computer Science 2021-04-30 Qinghao Ye , Jun Xia , Guang Yang