English
Related papers

Related papers: MCPNet: An Interpretable Classifier via Multi-Leve…

200 papers

Current machine learning models have shown high efficiency in solving a wide variety of real-world problems. However, their black box character poses a major challenge for the understanding and traceability of the underlying decision-making…

Machine Learning · Computer Science 2021-08-30 Srishti Gautam , Marina M. -C. Höhne , Stine Hansen , Robert Jenssen , Michael Kampffmeyer

Recent applications of deep convolutional neural networks in medical imaging raise concerns about their interpretability. While most explainable deep learning applications use post hoc methods (such as GradCAM) to generate feature…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Yuanyuan Wei , Roger Tam , Xiaoying Tang

Explaining black-box Artificial Intelligence (AI) models is a cornerstone for trustworthy AI and a prerequisite for its use in safety critical applications such that AI models can reliably assist humans in critical decisions. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Poulami Sinhamahapatra , Lena Heidemann , Maureen Monnet , Karsten Roscher

When we are faced with challenging image classification tasks, we often explain our reasoning by dissecting the image, and pointing out prototypical aspects of one class or another. The mounting evidence for each of the classes helps us…

Machine Learning · Computer Science 2020-01-01 Chaofan Chen , Oscar Li , Chaofan Tao , Alina Jade Barnett , Jonathan Su , Cynthia Rudin

The concept bottleneck model (CBM), as a technique improving interpretability via linking predictions to human-understandable concepts, makes high-risk and life-critical medical image classification credible. Typically, existing CBM methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Chunjiang Wang , Kun Zhang , Yandong Liu , Zhiyang He , Xiaodong Tao , S. Kevin Zhou

There is growing interest in concept-based models (CBMs) that combine high-performance and interpretability by acquiring and reasoning with a vocabulary of high-level concepts. A key requirement is that the concepts be interpretable.…

Machine Learning · Computer Science 2022-10-19 Emanuele Marconato , Andrea Passerini , Stefano Teso

Machine learning solutions for pattern classification problems are nowadays widely deployed in society and industry. However, the lack of transparency and accountability of most accurate models often hinders their safe use. Thus, there is a…

Machine Learning · Computer Science 2021-12-24 Gonzalo Nápoles , Yamisleydi Salgueiro , Isel Grau , Maikel Leon Espinosa

Modern deep neural networks have now reached human-level performance across a variety of tasks. However, unlike humans they lack the ability to explain their decisions by showing where and telling what concepts guided them. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Itay Benou , Tammy Riklin-Raviv

Black-box deep neural networks excel in text classification, yet their application in high-stakes domains is hindered by their lack of interpretability. To address this, we propose Text Bottleneck Models (TBM), an intrinsically…

Computation and Language · Computer Science 2024-04-04 Josh Magnus Ludan , Qing Lyu , Yue Yang , Liam Dugan , Mark Yatskar , Chris Callison-Burch

Self-explaining deep models are designed to learn the latent concept-based explanations implicitly during training, which eliminates the requirement of any post-hoc explanation generation technique. In this work, we propose one such model…

Machine Learning · Computer Science 2021-12-02 Anirban Sarkar , Deepak Vijaykeerthy , Anindya Sarkar , Vineeth N Balasubramanian

Classifying images with an interpretable decision-making process is a long-standing problem in computer vision. In recent years, Prototypical Part Networks has gained traction as an approach for self-explainable neural networks, due to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Zhijie Zhu , Lei Fan , Maurice Pagnucco , Yang Song

As machine learning (ML) models and datasets increase in complexity, the demand for methods that enhance explainability and interpretability becomes paramount. Prototypes, by encapsulating essential characteristics within data, offer…

Machine Learning · Computer Science 2024-08-20 Orfeas Menis-Mastromichalakis , Giorgos Filandrianos , Jason Liartis , Edmund Dervakos , Giorgos Stamou

Explaining deep learning models is of vital importance for understanding artificial intelligence systems, improving safety, and evaluating fairness. To better understand and control the CNN model, many methods for…

Machine Learning · Computer Science 2022-11-24 Zhihao Wang , Chuang Zhu

There has been considerable recent interest in interpretable concept-based models such as Concept Bottleneck Models (CBMs), which first predict human-interpretable concepts and then map them to output classes. To reduce reliance on…

Machine Learning · Computer Science 2024-07-08 Simon Schrodi , Julian Schur , Max Argus , Thomas Brox

Machine learning models that first learn a representation of a domain in terms of human-understandable concepts, then use it to make predictions, have been proposed to facilitate interpretation and interaction with models trained on…

Machine Learning · Computer Science 2020-12-08 Isaac Lage , Finale Doshi-Velez

Explainability of Deep Neural Networks (DNNs) has been garnering increasing attention in recent years. Of the various explainability approaches, concept-based techniques stand out for their ability to utilize human-meaningful concepts…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Fatemeh Aghaeipoor , Dorsa Asgarian , Mohammad Sabokrou

Automated skin lesion classification using deep learning has shown remarkable accuracy, yet clinical adoption remains limited due to the "black box" nature of these models. We present MelanomaNet, an explainable deep learning system for…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Sukhrobbek Ilyosbekov

In this work, we introduce InfoDisent, a hybrid approach to explainability based on the information bottleneck principle. InfoDisent enables the disentanglement of information in the final layer of any pretrained model into atomic concepts,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Łukasz Struski , Dawid Rymarczyk , Jacek Tabor

Deep neural networks are widely used for classification. These deep models often suffer from a lack of interpretability -- they are particularly difficult to understand because of their non-linear nature. As a result, neural networks are…

Artificial Intelligence · Computer Science 2017-11-22 Oscar Li , Hao Liu , Chaofan Chen , Cynthia Rudin

Deep neural networks have achieved remarkable performance in various text-based tasks but often lack interpretability, making them less suitable for applications where transparency is critical. To address this, we propose ProtoLens, a novel…

Computation and Language · Computer Science 2024-10-25 Bowen Wei , Ziwei Zhu