English
Related papers

Related papers: CHiQPM: Calibrated Hierarchical Interpretable Imag…

200 papers

Deep Neural Networks have often been called the black box because of the complex, deep architecture and non-transparency presented by the inner layers. There is a lack of trust to use Artificial Intelligence in critical and high-precision…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Frincy Clement , Ji Yang , Irene Cheng

Explainable AI (XAI) is crucial for building transparent and trustworthy machine learning systems, especially in high-stakes domains. Concept Bottleneck Models (CBMs) have emerged as a promising ante-hoc approach that provides…

Artificial Intelligence · Computer Science 2026-01-21 Hanwei Zhang , Luo Cheng , Rui Wen , Yang Zhang , Lijun Zhang , Holger Hermanns

Visual prompt tuning offers significant advantages for adapting pre-trained visual foundation models to specific tasks. However, current research provides limited insight into the interpretability of this approach, which is essential for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yubin Wang , Xinyang Jiang , De Cheng , Xiangqian Zhao , Zilong Wang , Dongsheng Li , Cairong Zhao

We present an interpretable companion model for any pre-trained black-box classifiers. The idea is that for any input, a user can decide to either receive a prediction from the black-box model, with high accuracy but no explanations, or…

Machine Learning · Statistics 2020-02-12 Danqing Pan , Tong Wang , Satoshi Hara

As machine learning algorithms getting adopted in an ever-increasing number of applications, interpretation has emerged as a crucial desideratum. In this paper, we propose a mathematical definition for the human-interpretable model. In…

Machine Learning · Computer Science 2021-06-01 Weishen Pan , Changshui Zhang

Interpretable machine learning tackles the important problem that humans cannot understand the behaviors of complex machine learning models and how these models arrive at a particular decision. Although many approaches have been proposed, a…

Machine Learning · Computer Science 2019-05-21 Mengnan Du , Ninghao Liu , Xia Hu

Many text classification applications require models with satisfying performance as well as good interpretability. Traditional machine learning methods are easy to interpret but have low accuracies. The development of deep learning models…

Computation and Language · Computer Science 2020-06-02 Zhengyang Wang , Xia Hu , Shuiwang Ji

Would you trust physicians if they cannot explain their decisions to you? Medical diagnostics using machine learning gained enormously in importance within the last decade. However, without further enhancements many state-of-the-art machine…

Machine Learning · Computer Science 2022-06-01 Emanuel Slany , Yannik Ott , Stephan Scheele , Jan Paulus , Ute Schmid

In human-centric settings like education or healthcare, model accuracy and model explainability are key factors for user adoption. Towards these two goals, intrinsically interpretable deep learning models have gained popularity, focusing on…

Machine Learning · Computer Science 2025-05-29 Vinitra Swamy , Syrielle Montariol , Julian Blackwell , Jibril Frej , Martin Jaggi , Tanja Käser

Quantum machine learning seeks to leverage quantum computers to improve upon classical machine learning algorithms. Currently, robust uncertainty quantification methods remain underdeveloped in the quantum domain, despite the critical need…

Machine Learning · Computer Science 2026-05-18 Douglas Spencer , Samual Nicholls , Michele Caprio

With the availability of large databases and recent improvements in deep learning methodology, the performance of AI systems is reaching or even exceeding the human level on an increasing number of complex tasks. Impressive examples of this…

Artificial Intelligence · Computer Science 2017-08-29 Wojciech Samek , Thomas Wiegand , Klaus-Robert Müller

The growing complexity of AI systems has intensified the need for transparency through Explainable AI (XAI). Counterfactual explanations (CFs) offer actionable "what-if" scenarios on three levels: Local CFs providing instance-specific…

Machine Learning · Computer Science 2026-05-12 Oleksii Furman , Patryk Wielopolski , Łukasz Lenkiewicz , Jerzy Stefanowski , Maciej Zięba

Interpretability of artificial intelligence (AI) methods, particularly deep neural networks, is of great interest. This heightened focus stems from the widespread use of AI-backed systems. These systems, often relying on intricate neural…

Quantum Physics · Physics 2024-11-11 Lirandë Pira , Chris Ferrie

Part-prototype models are explainable-by-design image classifiers, and a promising alternative to black box AI. This paper explores the applicability and potential of interpretable machine learning, in particular PIP-Net, for automated…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Meike Nauta , Johannes H. Hegeman , Jeroen Geerdink , Jörg Schlötterer , Maurice van Keulen , Christin Seifert

Deep learning models in robotics often output point estimates with poorly calibrated confidences, offering no native mechanism to quantify predictive reliability under novel, noisy, or out-of-distribution inputs. Conformal prediction (CP)…

Robotics · Computer Science 2025-09-29 Divake Kumar , Sina Tayebati , Francesco Migliarba , Ranganath Krishnan , Amit Ranjan Trivedi

Recent years have witnessed increasing interests in developing interpretable models in Natural Language Processing (NLP). Most existing models aim at identifying input features such as words or phrases important for model predictions.…

Computation and Language · Computer Science 2022-08-10 Hanqi Yan , Lin Gui , Yulan He

Recent advancements in machine learning have spurred growing interests in automated interpreting quality assessment. Nevertheless, existing research suffers from insufficient examination of language use quality, unsatisfactory modeling…

Computation and Language · Computer Science 2025-08-15 Zhaokun Jiang , Ziyin Zhang

Conformal Prediction (CP) is a distribution-free method for constructing prediction sets with marginal finite-sample coverage guarantees, making it a suitable framework for reliable uncertainty quantification in safety-critical object…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Christopher Ries , Moussa Kassem Sbeyti , Nicolas Bianco , Nadja Klein

Conformal Prediction (CP) is a popular method for uncertainty quantification with machine learning models. While conformal prediction provides probabilistic guarantees regarding the coverage of the true label, these guarantees are agnostic…

Machine Learning · Computer Science 2025-10-21 Aditya T. Vadlamani , Anutam Srinivasan , Pranav Maneriker , Ali Payani , Srinivasan Parthasarathy

Convolutional neural network (CNN) models have seen advanced improvements in performance in various domains, but lack of interpretability is a major barrier to assurance and regulation during operation for acceptance and deployment of…

Machine Learning · Computer Science 2022-11-02 Wenli Yang , Guan Huang , Renjie Li , Jiahao Yu , Yanyu Chen , Quan Bai , Beyong Kang