English
Related papers

Related papers: Explainable Knowledge Distillation for Efficient M…

200 papers

Automated leaf disease classification is critical for early disease detection in resource-constrained field environments. Vision Transformers (ViTs) provide strong representation capability by modeling long-range dependencies and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Minh-Dung Le , Minh-Duc Hoang , Hoang-Vu Truong , Thi-Thu-Hong Phan

Understanding visually situated language requires interpreting complex layouts of textual and visual elements. Pre-processing tools, such as optical character recognition (OCR), can map document image inputs to textual tokens, then large…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Wang Zhu , Alekh Agarwal , Mandar Joshi , Robin Jia , Jesse Thomason , Kristina Toutanova

The COVID-19 pandemic has strained global public health, necessitating accurate diagnosis and intervention to control disease spread and reduce mortality rates. This paper introduces an interpretable deep survival prediction model designed…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Zhusi Zhong , Jie Li , Zhuoqi Ma , Scott Collins , Harrison Bai , Paul Zhang , Terrance Healey , Xinbo Gao , Michael K. Atalay , Zhicheng Jiao

The coronavirus outbreak became a major concern for society worldwide. Technological innovation and ingenuity are essential to fight COVID-19 pandemic and bring us one step closer to overcome it. Researchers over the world are working…

Knowledge Distillation (KD) aims at improving the performance of a low-capacity student model by inheriting knowledge from a high-capacity teacher model. Previous KD methods typically train a student by minimizing a task-related loss and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Mengya Gao , Yujun Shen , Quanquan Li , Junjie Yan , Liang Wan , Dahua Lin , Chen Change Loy , Xiaoou Tang

Accurate 3D medical image segmentation is vital for diagnosis and treatment planning, but state-of-the-art models are often too large for clinics with limited computing resources. Lightweight architectures typically suffer significant…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Qizhen Lan , Yu-Chun Hsu , Nida Saddaf Khan , Xiaoqian Jiang

Knowledge distillation is a widely used technique for model compression. We posit that the teacher model used in a distillation setup, captures relationships between classes, that extend beyond the original dataset. We empirically show that…

Machine Learning · Computer Science 2019-11-14 Gaurav Menghani , Sujith Ravi

As of June 2021, the World Health Organization (WHO) has reported 171.7 million confirmed cases including 3,698,621 deaths from COVID-19. Detecting COVID-19 and other lung diseases from Chest X-Ray (CXR) images can be very effective for…

Image and Video Processing · Electrical Eng. & Systems 2021-09-28 Chinmoy Bose , Anirvan Basu

The outbreak of COVID-19 disease caused more than 100,000 deaths so far in the USA alone. It is necessary to conduct an initial screening of patients with the symptoms of COVID-19 disease to control the spread of the disease. However, it is…

Image and Video Processing · Electrical Eng. & Systems 2020-10-30 Md Manjurul Ahsan , Kishor Datta Gupta , Mohammad Maminur Islam , Sajib Sen , Md. Lutfar Rahman , Mohammad Shakhawat Hossain

Clinicians in the frontline need to assess quickly whether a patient with symptoms indeed has COVID-19 or not. The difficulty of this task is exacerbated in low resource settings that may not have access to biotechnology tests. Furthermore,…

Image and Video Processing · Electrical Eng. & Systems 2021-08-23 Ali H. Al-Timemy , Rami N. Khushaba , Zahraa M. Mosa , Javier Escudero

Skin cancer is one of the most common types of malignancy, affecting a large population and causing a heavy economic burden worldwide. Over the last few years, computer-aided diagnosis has been rapidly developed and make great progress in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Yongwei Wang , Yuheng Wang , Tim K. Lee , Chunyan Miao , Z. Jane Wang

Purpose: Accurate segmentation of lung and infection in COVID-19 CT scans plays an important role in the quantitative management of patients. Most of the existing studies are based on large and private annotated datasets that are…

Image and Video Processing · Electrical Eng. & Systems 2021-06-09 Jun Ma , Yixin Wang , Xingle An , Cheng Ge , Ziqi Yu , Jianan Chen , Qiongjie Zhu , Guoqiang Dong , Jian He , Zhiqiang He , Yuntao Zhu , Ziwei Nie , Xiaoping Yang

We introduce Layered Self-Supervised Knowledge Distillation (LSSKD) framework for training compact deep learning models. Unlike traditional methods that rely on pre-trained teacher networks, our approach appends auxiliary classifiers to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Tarique Dahri , Zulfiqar Ali Memon , Zhenyu Yu , Mohd. Yamani Idna Idris , Sheheryar Khan , Sadiq Ahmad , Maged Shoman , Saddam Aziz , Rizwan Qureshi

Identifying who is infected with the Covid-19 virus is critical for controlling its spread. X-ray machines are widely available worldwide and can quickly provide images that can be used for diagnosis. A number of recent studies claim it may…

Image and Video Processing · Electrical Eng. & Systems 2021-02-09 Kaoutar Ben Ahmed , Lawrence O. Hall , Dmitry B. Goldgof , Gregory M. Goldgof , Rahul Paul

COVID-19 is a virus with high transmission rate that demands rapid identification of the infected patients to reduce the spread of the disease. The current gold-standard test, Reverse-Transcription Polymerase Chain Reaction (RT-PCR), has a…

Recent research has found that knowledge distillation can be effective in reducing the size of a network and in increasing generalization. A pre-trained, large teacher network, for example, was shown to be able to bootstrap a student model…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Hyun Seung Lee , Christian Wallraven

Chest X-rays (CXRs) are a widely used imaging modality for the diagnosis and prognosis of lung disease. The image analysis tasks vary. Examples include pathology detection and lung segmentation. There is a large body of work where machine…

Image and Video Processing · Electrical Eng. & Systems 2023-05-19 Syed Muhammad Anwar , Abhijeet Parida , Sara Atito , Muhammad Awais , Gustavo Nino , Josef Kitler , Marius George Linguraru

COVID-19 is a severe and acute viral disease that can cause symptoms consistent with pneumonia in which inflammation is caused in the alveolous regions of the lungs leading to a build-up of fluid and breathing difficulties. Thus, the…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Yinuo Wang , Juhyun Bae , Ka Ho Chow , Shenyang Chen , Shreyash Gupta

Deep learning models are prone to learning shortcut solutions to problems using spuriously correlated yet irrelevant features of their training data. In high-risk applications such as medical image analysis, this phenomenon may prevent…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Christopher Boland , Sotirios Tsaftaris , Sonia Dahdouh

Accurate and rapid detection of COVID-19 pneumonia is crucial for optimal patient treatment. Chest X-Ray (CXR) is the first line imaging test for COVID-19 pneumonia diagnosis as it is fast, cheap and easily accessible. Inspired by the…

Image and Video Processing · Electrical Eng. & Systems 2023-02-20 Xin Zhang , Liangxiu Han , Tam Sobeih , Lianghao Han , Nina Dempsey , Symeon Lechareas , Ascanio Tridente , Haoming Chen , Stephen White