English
Related papers

Related papers: MAGIX: Model Agnostic Globally Interpretable Expla…

200 papers

Deep learning methods have been very effective for a variety of medical diagnostic tasks and has even beaten human experts on some of those. However, the black-box nature of the algorithms has restricted clinical use. Recent explainability…

Computer Vision and Pattern Recognition · Computer Science 2020-05-29 Amitojdeep Singh , Sourya Sengupta , Vasudevan Lakshminarayanan

There is a need of ensuring machine learning models that are interpretable. Higher interpretability of the model means easier comprehension and explanation of future predictions for end-users. Further, interpretable machine learning models…

Machine Learning · Computer Science 2020-08-17 Gregor Stiglic , Primoz Kocbek , Nino Fijacko , Marinka Zitnik , Katrien Verbert , Leona Cilar

Most AI systems are black boxes generating reasonable outputs for given inputs. Some domains, however, have explainability and trustworthiness requirements that cannot be directly met by these approaches. Various methods have therefore been…

Artificial Intelligence · Computer Science 2024-10-28 Hormoz Shahrzad , Babak Hodjat , Risto Miikkulainen

The financial industry faces a significant challenge modeling and risk portfolios: balancing the predictability of advanced machine learning models, neural network models, and explainability required by regulatory entities (such as Office…

Machine Learning · Computer Science 2025-11-10 Rongbin Ye , Jiaqi Chen

Explainable machine learning (ML) enables human learning from ML, human appeal of automated model decisions, regulatory compliance, and security audits of ML models. Explainable ML (i.e. explainable artificial intelligence or XAI) has been…

Machine Learning · Statistics 2019-12-03 Patrick Hall , Navdeep Gill , Nicholas Schmidt

Explaining Graph Neural Networks (GNNs) has garnered significant attention due to the need for interpretability, enabling users to understand the behavior of these black-box models better and extract valuable insights from their…

Machine Learning · Computer Science 2025-06-03 Jiaxing Zhang , Xiaoou Liu , Dongsheng Luo , Hua Wei

Explainable artificial intelligence (XAI) is a set of tools and algorithms that applied or embedded to machine learning models to understand and interpret the models. They are recommended especially for complex or advanced models including…

Machine Learning · Computer Science 2024-07-18 Ahmed M Salih , Yuhe Wang

Explainability for Large Language Models (LLMs) is a critical yet challenging aspect of natural language processing. As LLMs are increasingly integral to diverse applications, their "black-box" nature sparks significant concerns regarding…

Computation and Language · Computer Science 2024-02-23 Haoyan Luo , Lucia Specia

Counterfactual explanations offer an intuitive and straightforward way to explain black-box models and offer algorithmic recourse to individuals. To address the need for plausible explanations, existing work has primarily relied on…

Machine Learning · Computer Science 2023-12-19 Patrick Altmeyer , Mojtaba Farmanbar , Arie van Deursen , Cynthia C. S. Liem

We present the Explabox: an open-source toolkit for transparent and responsible machine learning (ML) model development and usage. Explabox aids in achieving explainable, fair and robust models by employing a four-step strategy: explore,…

Machine Learning · Computer Science 2024-11-26 Marcel Robeer , Michiel Bron , Elize Herrewijnen , Riwish Hoeseni , Floris Bex

Understanding the interpretation of machine learning (ML) models has been of paramount importance when making decisions with societal impacts such as transport control, financial activities, and medical diagnosis. While current model…

Human-Computer Interaction · Computer Science 2024-05-07 Jun Yuan , Gromit Yeuk-Yin Chan , Brian Barr , Kyle Overton , Kim Rees , Luis Gustavo Nonato , Enrico Bertini , Claudio T. Silva

Imagine being able to ask questions to a black box model such as "Which adversarial examples exist?", "Does a specific attribute have a disproportionate effect on the model's prediction?" or "What kind of predictions could possibly be made…

Machine Learning · Computer Science 2021-05-19 Laurens Devos , Wannes Meert , Jesse Davis

Modern statistical learning techniques have often emphasized prediction performance over interpretability, giving rise to "black box" models that may be difficult to understand, and to generalize to other settings. We conceptually divide a…

Methodology · Statistics 2019-09-16 Wenjia Wang , Yi-Hui Zhou

Interpretable machine learning models offer understandable reasoning behind their decision-making process, though they may not always match the performance of their black-box counterparts. This trade-off between interpretability and model…

Artificial Intelligence · Computer Science 2025-03-12 Pranjal Atrey , Michael P. Brundage , Min Wu , Sanghamitra Dutta

Deep learning models achieve remarkable predictive performance, yet their black-box nature limits transparency and trustworthiness. Although numerous explainable artificial intelligence (XAI) methods have been proposed, they primarily…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Jiarui Li , Zixiang Yin , Samuel J Landry , Zhengming Ding , Ramgopal R. Mettu

Using Machine Learning systems in the real world can often be problematic, with inexplicable black-box models, the assumed certainty of imperfect measurements, or providing a single classification instead of a probability distribution. This…

Machine Learning · Computer Science 2023-07-11 Jonathan S. Kent , David H. Menager

Explainability is motivated by the lack of transparency of black-box Machine Learning approaches, which do not foster trust and acceptance of Machine Learning algorithms. This also happens in the Predictive Process Monitoring field, where…

Artificial Intelligence · Computer Science 2025-07-25 Williams Rizzi , Marco Comuzzi , Chiara Di Francescomarino , Chiara Ghidini , Suhwan Lee , Fabrizio Maria Maggi , Alexander Nolte

Advanced machine learning models have recently achieved high predictive accuracy for weather and climate prediction. However, these complex models often lack inherent transparency and interpretability, acting as "black boxes" that impede…

Atmospheric and Oceanic Physics · Physics 2024-03-29 Ruyi Yang , Jingyu Hu , Zihao Li , Jianli Mu , Tingzhao Yu , Jiangjiang Xia , Xuhong Li , Aritra Dasgupta , Haoyi Xiong

Interpretability is the study of explaining models in understandable terms to humans. At present, interpretability is divided into two paradigms: the intrinsic paradigm, which believes that only models designed to be explained can be…

Machine Learning · Computer Science 2024-11-14 Andreas Madsen , Himabindu Lakkaraju , Siva Reddy , Sarath Chandar

Definitive evidence that globular clusters (GCs) host intermediate-mass black holes (IMBHs) is elusive. Machine learning (ML) models trained on GC simulations can in principle predict IMBH host candidates based on observable features. This…

Astrophysics of Galaxies · Physics 2023-10-31 Mario Pasquato , Piero Trevisan , Abbas Askar , Pablo Lemos , Gaia Carenini , Michela Mapelli , Yashar Hezaveh