English
Related papers

Related papers: Knowledge Distillation to Ensemble Global and Inte…

200 papers

Top-performing machine learning systems, such as deep neural networks, large ensembles and complex probabilistic graphical models, can be expensive to store, slow to evaluate and hard to integrate into larger systems. Ideally, we would like…

Machine Learning · Statistics 2015-10-09 George Papamakarios

This paper presents a novel knowledge distillation based model compression framework consisting of a student ensemble. It enables distillation of simultaneously learnt ensemble knowledge onto each of the compressed student models. Each…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Devesh Walawalkar , Zhiqiang Shen , Marios Savvides

Automated diagnosis using deep neural networks in chest radiography can help radiologists detect life-threatening diseases. However, existing methods only provide predictions without accurate explanations, undermining the trustworthiness of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Eunji Kim , Siwon Kim , Minji Seo , Sungroh Yoon

We are concerned with the challenge of reliably classifying and assessing intracranial aneurysms using deep learning without compromising clinical transparency. While traditional black-box models achieve high predictive accuracy, their lack…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Toqa Khaled , Ahmad Al-Kabbany

Deep learning models are prone to learning shortcut solutions to problems using spuriously correlated yet irrelevant features of their training data. In high-risk applications such as medical image analysis, this phenomenon may prevent…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Christopher Boland , Sotirios Tsaftaris , Sonia Dahdouh

Deep learning methods have shown great success in several domains as they process a large amount of data efficiently, capable of solving complex classification, forecast, segmentation, and other tasks. However, they come with the inherent…

Artificial Intelligence · Computer Science 2020-11-20 Dominique Mercier , Andreas Dengel , Sheraz Ahmed

Concept Bottleneck Models (CBMs) aim to improve interpretability in Deep Learning by structuring predictions through human-understandable concepts, but they provide no way to verify whether learned concepts align with the human's intended…

Machine Learning · Computer Science 2026-05-22 Stefano Colamonaco , David Debot , Pietro Barbiero , Giuseppe Marra

Prototype-based methods use interpretable representations to address the black-box nature of deep learning models, in contrast to post-hoc explanation methods that only approximate such models. We propose the Neural Prototype Tree…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Meike Nauta , Ron van Bree , Christin Seifert

The emergence of deep learning networks raises a need for explainable AI so that users and domain experts can be confident applying them to high-risk decisions. In this paper, we leverage data from the latent space induced by deep learning…

Machine Learning · Computer Science 2019-09-10 Alan H. Gee , Diego Garcia-Olano , Joydeep Ghosh , David Paydarfar

We propose ProtoArgNet, a novel interpretable deep neural architecture for image classification in the spirit of prototypical-part-learning as found, e.g., in ProtoPNet. While earlier approaches associate every class with multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Hamed Ayoobi , Nico Potyka , Francesca Toni

Neural networks currently dominate the machine learning community and they do so for good reasons. Their accuracy on complex tasks such as image classification is unrivaled at the moment and with recent improvements they are reasonably easy…

Machine Learning · Computer Science 2019-01-21 Sascha Saralajew , Lars Holdijk , Maike Rees , Thomas Villmann

Part-prototype Networks (ProtoPNets) are concept-based classifiers designed to achieve the same performance as black-box models without compromising transparency. ProtoPNets compute predictions based on similarity to class-specific…

Machine Learning · Computer Science 2023-01-24 Andrea Bontempelli , Stefano Teso , Katya Tentori , Fausto Giunchiglia , Andrea Passerini

Multiplex Biological Networks (MBNs), which represent multiple interaction types between entities, are crucial for understanding complex biological systems. Yet, existing methods often inadequately model multiplexity, struggle to integrate…

Machine Learning · Computer Science 2026-03-10 Alana Deng , Sugitha Janarthanan , Yan Sun , Zihao Jing , Pingzhao Hu

Medical image classification is a critical problem for healthcare, with the potential to alleviate the workload of doctors and facilitate diagnoses of patients. However, two challenges arise when deploying deep learning models to real-world…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 An Yan , Yu Wang , Yiwu Zhong , Zexue He , Petros Karypis , Zihan Wang , Chengyu Dong , Amilcare Gentili , Chun-Nan Hsu , Jingbo Shang , Julian McAuley

Liver diseases are a serious health concern in the world, which requires precise and timely diagnosis to enhance the survival chances of patients. The current literature implemented numerous machine learning and deep learning models to…

Being able to interpret, or explain, the predictions made by a machine learning model is of fundamental importance. This is especially true when there is interest in deploying data-driven models to make high-stakes decisions, e.g. in…

Machine Learning · Computer Science 2019-10-01 An-phi Nguyen , María Rodríguez Martínez

Automated ICD-10 coding from clinical discharge summaries requires models that are both accurate on long-tailed multi-label classification tasks and interpretable to clinicians. Concept Bottleneck Models (CBMs) offer a principled framework…

Machine Learning · Computer Science 2026-05-12 Mohammed Sameer Syed , Xuan Lu

The rapid growth of user-generated text across digital platforms has intensified the need for interpretable models capable of fine-grained text classification and explanation. Existing prototype-based models offer intuitive explanations but…

Artificial Intelligence · Computer Science 2026-05-19 Utsav Kumar Nareti , Suraj Kumar , Soumya Pandey , Soumi Chattopadhyay , Chandranath Adak , Sankha Subhra Mullick

The lack of explainability of deep learning models limits the adoption of such models in clinical practice. Prototype-based models can provide inherent explainable predictions, but these have predominantly been designed for classification…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Linde S. Hesse , Nicola K. Dinsdale , Ana I. L. Namburete

Accurate and reliable histopathological image classification is essential for breast cancer diagnosis. However, many deep learning models remain sensitive to magnification variability and lack interpretability. To address these challenges,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Enam Ahmed Taufika , Md Ahasanul Arafatha , Abhijit Kumar Ghoshb , Md. Tanzim Rezab , Md Ashad Alamc