English
Related papers

Related papers: ProDG: Prototypes for Data-Free Generative Post-Ho…

200 papers

While state-of-the-art language models (LMs) surpass the vast majority of humans in certain domains, their reasoning remains largely opaque, undermining trust in their output. Furthermore, while autoregressive LMs can output explicit…

Despite the recent progress in deep neural networks (DNNs), it remains challenging to explain the predictions made by DNNs. Existing explanation methods for DNNs mainly focus on post-hoc explanations where another explanatory model is…

Machine Learning · Computer Science 2024-01-04 Wei Qian , Chenxu Zhao , Yangyi Li , Fenglong Ma , Chao Zhang , Mengdi Huai

Prototypical part networks offer interpretable alternatives to black-box deep learning models by learning visual prototypes for classification. This work provides a comprehensive analysis of prototype formulations, comparing point-based and…

Machine Learning · Computer Science 2026-01-08 Maximilian Xiling Li , Korbinian Franz Rudolf , Paul Mattes , Nils Blank , Rudolf Lioutikov

Deep Learning (DL) models processing images to recognize the health state of large infrastructure components can exhibit biases and rely on non-causal shortcuts. eXplainable Artificial Intelligence (XAI) can address these issues but…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Giovanni Floreale , Piero Baraldi , Enrico Zio , Olga Fink

Ante-hoc interpretability has become the holy grail of explainable artificial intelligence for high-stakes domains such as healthcare; however, this notion is elusive, lacks a widely-accepted definition and depends on the operational…

Machine Learning · Computer Science 2023-07-11 Kacper Sokol , Julia E. Vogt

We introduce provenance networks, a novel class of neural models designed to provide end-to-end, training-data-driven explainability. Unlike conventional post-hoc methods, provenance networks learn to link each prediction directly to its…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Ali Kayyam , Anusha Madan Gopal , M. Anthony Lewis

Utilizing potent representations of the large vision-language models (VLMs) to accomplish various downstream tasks has attracted increasing attention. Within this research field, soft prompt learning has become a representative approach for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Yequan Bie , Luyang Luo , Zhixuan Chen , Hao Chen

The need for interpretable models has fostered the development of self-explainable classifiers. Prior approaches are either based on multi-stage optimization schemes, impacting the predictive performance of the model, or produce…

We introduce ProtoSeg, a novel model for interpretable semantic image segmentation, which constructs its predictions using similar patches from the training set. To achieve accuracy comparable to baseline methods, we adapt the mechanism of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Mikołaj Sacha , Dawid Rymarczyk , Łukasz Struski , Jacek Tabor , Bartosz Zieliński

Neural networks for NLP are becoming increasingly complex and widespread, and there is a growing concern if these models are responsible to use. Explaining models helps to address the safety and ethical concerns and is essential for…

Computation and Language · Computer Science 2023-11-29 Andreas Madsen , Siva Reddy , Sarath Chandar

In time-series domains where both predictive performance and interpretability are essential, deep neural networks achieve strong results but provide limited insight into how their predictions are made. Projection-based prototype networks…

Machine Learning · Computer Science 2026-05-11 Steven Song , Sahil Sethi , Brett Beaulieu-Jones , Robert L. Grossman

Post-hoc explanation methods are used with the intent of providing insights about neural networks and are sometimes said to help engender trust in their outputs. However, popular explanations methods have been found to be fragile to minor…

Machine Learning · Computer Science 2022-12-19 Matthew Wicker , Juyeon Heo , Luca Costabello , Adrian Weller

We propose a novel interpretable deep neural network for text classification, called ProtoryNet, based on a new concept of prototype trajectories. Motivated by the prototype theory in modern linguistics, ProtoryNet makes a prediction by…

Machine Learning · Computer Science 2023-11-07 Dat Hong , Tong Wang , Stephen S. Baek

Post-hoc interpretability methods play a critical role in explainable artificial intelligence (XAI), as they pinpoint portions of data that a trained deep learning model deemed important to make a decision. However, different post-hoc…

Machine Learning · Computer Science 2024-07-30 Jiawen Wei , Hugues Turbé , Gianmarco Mengaldo

Post-hoc explanations provide transparency and are essential for guiding model optimization, such as prompt engineering and data sanitation. However, applying model-agnostic techniques to Large Language Models (LLMs) is hindered by…

Machine Learning · Computer Science 2026-04-13 Junhao Liu , Haonan Yu , Zhenyu Yan , Xin Zhang

In this article, we present a leap-forward expansion to the study of explainability in neural networks by considering explanations as answers to abstract reasoning-based questions. With $P$ as the prediction from a neural network, these…

Machine Learning · Computer Science 2022-02-25 Ghassan AlRegib , Mohit Prabhushankar

Beyond improving trust and validating model fairness, xAI practices also have the potential to recover valuable scientific insights in application domains where little to no prior human intuition exists. To that end, we propose a method to…

Machine Learning · Computer Science 2024-04-26 Jonas Teufel , Pascal Friederich

The rapid advancement of Text-to-Image(T2I) generative models has enabled the synthesis of high-quality images guided by textual descriptions. Despite this significant progress, these models are often susceptible in generating contents that…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Yichen Sun , Zhixuan Chu , Zhan Qin , Kui Ren

The growing interest in eXplainable Artificial Intelligence (XAI) has stimulated research on models with built-in interpretability, among which part-prototype models are particularly prominent. Part-Prototype Models (PPMs) classify inputs…

Machine Learning · Computer Science 2026-03-20 Khawla Elhadri , Tomasz Michalski , Adam Wróbel , Jörg Schlötterer , Bartosz Zieliński , Christin Seifert

Explainable AI (XAI) has been proposed as a valuable tool to assist in downstream tasks involving human and AI collaboration. Perhaps the most psychologically valid XAI techniques are case based approaches which display 'whole' exemplars to…

Artificial Intelligence · Computer Science 2023-11-07 Eoin Kenny , Eoin Delaney , Mark Keane