English
Related papers

Related papers: Synthetic Benchmarks for Scientific Research in Ex…

200 papers

The main objective of eXplainable Artificial Intelligence (XAI) is to provide effective explanations for black-box classifiers. The existing literature lists many desirable properties for explanations to be useful, but there is no consensus…

Artificial Intelligence · Computer Science 2021-06-02 Elvio G. Amparore , Alan Perotti , Paolo Bajardi

Recently, there has been a surge of explainable AI (XAI) methods driven by the need for understanding machine learning model behaviors in high-stakes scenarios. However, properly evaluating the effectiveness of the XAI methods inevitably…

Human-Computer Interaction · Computer Science 2024-03-12 Jiaqi Ma , Vivian Lai , Yiming Zhang , Chacha Chen , Paul Hamilton , Davor Ljubenkov , Himabindu Lakkaraju , Chenhao Tan

Deep Learning has already been successfully applied to analyze industrial sensor data in a variety of relevant use cases. However, the opaque nature of many well-performing methods poses a major obstacle for real-world deployment.…

Machine Learning · Computer Science 2023-10-20 Thomas Decker , Michael Lebacher , Volker Tresp

Despite the increasingly successful application of neural networks to many problems in the geosciences, their complex and nonlinear structure makes the interpretation of their predictions difficult, which limits model trust and does not…

Geophysics · Physics 2022-06-14 Antonios Mamalakis , Imme Ebert-Uphoff , Elizabeth A. Barnes

Decision explanations of machine learning black-box models are often generated by applying Explainable AI (XAI) techniques. However, many proposed XAI methods produce unverified outputs. Evaluation and verification are usually achieved with…

Machine Learning · Computer Science 2020-12-09 Udo Schlegel , Daniela Oelke , Daniel A. Keim , Mennatallah El-Assady

Evaluating time series attribution methods is difficult because real-world datasets rarely provide ground truth for which time points drive a prediction. A common workaround is to generate synthetic data where class-discriminating features…

Machine Learning · Computer Science 2026-03-10 Gregor Baer

Recent years have seen a surge of interest in the field of explainable AI (XAI), with a plethora of algorithms proposed in the literature. However, a lack of consensus on how to evaluate XAI hinders the advancement of the field. We…

Artificial Intelligence · Computer Science 2022-09-22 Q. Vera Liao , Yunfeng Zhang , Ronny Luss , Finale Doshi-Velez , Amit Dhurandhar

Attribution methods compute importance scores for input features to explain model predictions. However, assessing the faithfulness of these methods remains challenging due to the absence of attribution ground truth to model predictions. In…

Cryptography and Security · Computer Science 2025-10-02 Peiyu Yang , Naveed Akhtar , Jiantong Jiang , Ajmal Mian

Explainable AI (XAI) has emerged as a powerful tool for improving the performance of AI models, going beyond providing model transparency and interpretability. The scarcity of labeled data remains a fundamental challenge in developing…

Computation and Language · Computer Science 2025-06-05 Melkamu Abay Mersha , Mesay Gemeda Yigezu , Atnafu Lambebo Tonja , Hassan Shakil , Samer Iskander , Olga Kolesnikova , Jugal Kalita

Explainable artificial intelligence (XAI) is essential for trustworthy machine learning (ML), particularly in high-stakes domains such as healthcare and finance. Shapley value (SV) methods provide a principled framework for feature…

Machine Learning · Statistics 2025-10-03 Wangxuan Fan , Siqi Li , Doudou Zhou , Yohei Okada , Chuan Hong , Molei Liu , Nan Liu

For around a decade, non-symbolic methods have been the option of choice when explaining complex machine learning (ML) models. Unfortunately, such methods lack rigor and can mislead human decision-makers. In high-stakes uses of ML, the lack…

Artificial Intelligence · Computer Science 2026-05-28 Olivier Létoffé , Xuanxiang Huang , Joao Marques-Silva

AI explainability improves the transparency of models, making them more trustworthy. Such goals are motivated by the emergence of deep learning models, which are obscure by nature; even in the domain of images, where deep learning has…

Machine Learning · Computer Science 2022-03-01 Anna Arias-Duart , Ferran Parés , Dario Garcia-Gasulla , Victor Gimenez-Abalos

Understanding the reasoning behind deep learning model predictions is crucial in cheminformatics and drug discovery, where molecular design determines their properties. However, current evaluation frameworks for Explainable AI (XAI) in this…

Machine Learning · Computer Science 2025-05-29 Magdalena Proszewska , Tomasz Danel , Dawid Rymarczyk

We share observations and challenges from an ongoing effort to implement Explainable AI (XAI) in a domain-specific workflow for cybersecurity analysts. Specifically, we briefly describe a preliminary case study on the use of XAI for source…

Human-Computer Interaction · Computer Science 2024-08-12 Ashley Suh , Harry Li , Caitlin Kenney , Kenneth Alperin , Steven R. Gomez

There has recently been a surge of work in explanatory artificial intelligence (XAI). This research area tackles the important problem that complex machines and algorithms often cannot provide insights into their behavior and thought…

Artificial Intelligence · Computer Science 2019-02-05 Leilani H. Gilpin , David Bau , Ben Z. Yuan , Ayesha Bajwa , Michael Specter , Lalana Kagal

Explainable artificial intelligence (XAI) methods are currently evaluated with approaches mostly originated in interpretable machine learning (IML) research that focus on understanding models such as comparison against existing attribution…

Machine Learning · Computer Science 2020-11-20 Shideh Shams Amiri , Rosina O. Weber , Prateek Goel , Owen Brooks , Archer Gandley , Brian Kitchell , Aaron Zehm

While research on explainable AI (XAI) is booming and explanation techniques have proven promising in many application domains, standardised human-centred evaluation procedures are still missing. In addition, current evaluation procedures…

Human-Computer Interaction · Computer Science 2025-06-18 Ivania Donoso-Guzmán , Jeroen Ooge , Denis Parra , Katrien Verbert

Explainable artificial intelligence (XAI) enables data-driven understanding of factor associations with response variables, yet communicating XAI outputs to laypersons remains challenging, hindering trust in AI-based predictions. Large…

Artificial Intelligence · Computer Science 2026-03-13 Tomoaki Yamaguchi , Yutong Zhou , Masahiro Ryo , Keisuke Katsura

Many ML models are opaque to humans, producing decisions too complex for humans to easily understand. In response, explainable artificial intelligence (XAI) tools that analyze the inner workings of a model have been created. Despite these…

Computers and Society · Computer Science 2021-06-17 Kiana Alikhademi , Brianna Richardson , Emma Drobina , Juan E. Gilbert

We present FairX, an open-source Python-based benchmarking tool designed for the comprehensive analysis of models under the umbrella of fairness, utility, and eXplainability (XAI). FairX enables users to train benchmarking bias-mitigation…

Machine Learning · Computer Science 2024-09-04 Md Fahim Sikder , Resmi Ramachandranpillai , Daniel de Leng , Fredrik Heintz