English
Related papers

Related papers: Comprehensive Evaluation of Prototype Neural Netwo…

200 papers

It has been long debated that eXplainable AI (XAI) is an important topic, but it lacks rigorous definition and fair metrics. In this paper, we briefly summarize the status quo of the metrics, along with an exhaustive experimental study…

Artificial Intelligence · Computer Science 2021-01-01 Xiao-Hui Li , Yuhan Shi , Haoyang Li , Wei Bai , Yuanwei Song , Caleb Chen Cao , Lei Chen

Explainable artificial intelligence (XAI) aims to develop transparent explanatory approaches for "black-box" deep learning models. However,it remains difficult for existing methods to achieve the trade-off of the three key criteria in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Changqi Sun , Hao Xu , Yuntian Chen , Dongxiao Zhang

Pretrained transformer-based Language Models (LMs) are well-known for their ability to achieve significant improvement on text classification tasks with their powerful word embeddings, but their black-box nature, which leads to a lack of…

Computation and Language · Computer Science 2024-12-23 Ximing Wen , Wenjuan Tan , Rosina O. Weber

Many text classification applications require models with satisfying performance as well as good interpretability. Traditional machine learning methods are easy to interpret but have low accuracies. The development of deep learning models…

Computation and Language · Computer Science 2020-06-02 Zhengyang Wang , Xia Hu , Shuiwang Ji

Foundation model reliability assessment typically requires thousands of evaluation examples, making it computationally expensive and time-consuming for real-world deployment. We introduce microprobe, a novel approach that achieves…

Artificial Intelligence · Computer Science 2025-12-25 Aayam Bansal , Ishaan Gangwani

Explaining predictions of black-box neural networks is crucial when applied to decision-critical tasks. Thus, attribution maps are commonly used to identify important image regions, despite prior work showing that humans prefer explanations…

Machine Learning · Computer Science 2023-12-20 Tom Nuno Wolf , Fabian Bongratz , Anne-Marie Rickmann , Sebastian Pölsterl , Christian Wachinger

When predictive models are used to support complex and important decisions, the ability to explain a model's reasoning can increase trust, expose hidden biases, and reduce vulnerability to adversarial attacks. However, attempts at…

Machine Learning · Computer Science 2019-07-11 Dimitris Bertsimas , Arthur Delarue , Patrick Jaillet , Sebastien Martin

Artificial intelligence (AI) is currently based largely on black-box machine learning models which lack interpretability. The field of eXplainable AI (XAI) strives to address this major concern, being critical in high-stakes areas such as…

Artificial Intelligence · Computer Science 2024-06-26 Sean Tull , Robin Lorenz , Stephen Clark , Ilyas Khan , Bob Coecke

MOTIVATION: Proteins fold into complex structures that are crucial for their biological functions. Experimental determination of protein structures is costly and therefore limited to a small fraction of all known proteins. Hence, different…

Biomolecules · Quantitative Biology 2018-04-18 David Menéndez Hurtado , Karolis Uziela , Arne Elofsson

As artificial intelligence increasingly drives critical decisions, the ability to genuinely explain how neural networks make predictions is essential for trust. Yet, most current explanation methods offer post-hoc rationalizations rather…

Machine Learning · Computer Science 2026-05-08 Corentin Lobet , Francesca Chiaromonte

Deep learning has become popular because of its potential to achieve high accuracy in prediction tasks. However, accuracy is not always the only goal of statistical modelling, especially for models developed as part of scientific research.…

Machine Learning · Computer Science 2021-10-19 Thomas P Quinn , Sunil Gupta , Svetha Venkatesh , Vuong Le

Supervised machine learning models boast remarkable predictive capabilities. But can you trust your model? Will it work in deployment? What else can it tell you about the world? We want models to be not only good, but interpretable. And yet…

Machine Learning · Computer Science 2017-03-07 Zachary C. Lipton

Recently, post hoc explanation methods have emerged to enhance model transparency by attributing model outputs to input features. However, these methods face challenges due to their specificity to certain neural network architectures and…

Machine Learning · Computer Science 2025-05-16 Seongun Kim , Sol A Kim , Geonhyeong Kim , Enver Menadjiev , Chanwoo Lee , Seongwook Chung , Nari Kim , Jaesik Choi

Artificial Intelligence (AI) has a tremendous impact on the unexpected growth of technology in almost every aspect. AI-powered systems are monitoring and deciding about sensitive economic and societal issues. The future is towards…

Machine Learning · Computer Science 2022-06-14 Ioannis Mollas , Nick Bassiliades , Grigorios Tsoumakas

Artificial intelligence models encounter significant challenges due to their black-box nature, particularly in safety-critical domains such as healthcare, finance, and autonomous vehicles. Explainable Artificial Intelligence (XAI) addresses…

Artificial Intelligence · Computer Science 2025-03-14 Melkamu Mersha , Khang Lam , Joseph Wood , Ali AlShami , Jugal Kalita

While machine learning techniques have been successfully applied in several fields, the black-box nature of the models presents challenges for interpreting and explaining the results. We develop a new framework called Adaptive Explainable…

Machine Learning · Statistics 2020-06-03 Jie Chen , Joel Vaughan , Vijayan N. Nair , Agus Sudjianto

The use of eXplainable Artificial Intelligence (XAI) systems has introduced a set of challenges that need resolution. Herein, we focus on how to correctly select an XAI method, an open questions within the field. The inherent difficulty of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Miquel Miró-Nicolau , Antoni Jaume-i-Capó , Gabriel Moyà-Alcover

Interpretable machine learning tackles the important problem that humans cannot understand the behaviors of complex machine learning models and how these models arrive at a particular decision. Although many approaches have been proposed, a…

Machine Learning · Computer Science 2019-05-21 Mengnan Du , Ninghao Liu , Xia Hu

Explainable AI (XAI) has a counterpart in analytical modeling which we refer to as model explainability. We tackle the issue of model explainability in the context of prediction models. We analyze a dataset of loans from a credit card…

Machine Learning · Computer Science 2024-06-03 Donald Kridel , Jacob Dineen , Daniel Dolk , David Castillo

Utilizing potent representations of the large vision-language models (VLMs) to accomplish various downstream tasks has attracted increasing attention. Within this research field, soft prompt learning has become a representative approach for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Yequan Bie , Luyang Luo , Zhixuan Chen , Hao Chen