English
Related papers

Related papers: Focus! Rating XAI Methods and Finding Biases

200 papers

With the ever-growing achievements in Artificial Intelligence (AI) and the recent boosted enthusiasm in Financial Technology (FinTech), applications such as credit scoring have gained substantial academic interest. Credit scoring helps…

Risk Management · Quantitative Finance 2020-12-08 Lara Marie Demajo , Vince Vella , Alexiei Dingli

The performance of deep neural networks for image recognition tasks such as predicting a smiling face is known to degrade with under-represented classes of sensitive attributes. We address this problem by introducing fairness-aware…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Tobias Hänel , Nishant Kumar , Dmitrij Schlesinger , Mengze Li , Erdem Ünal , Abouzar Eslami , Stefan Gumhold

Explainability and interpretability of AI models is an essential factor affecting the safety of AI. While various explainable AI (XAI) approaches aim at mitigating the lack of transparency in deep networks, the evidence of the effectiveness…

Artificial Intelligence · Computer Science 2020-03-03 Kamran Alipour , Jurgen P. Schulze , Yi Yao , Avi Ziskind , Giedrius Burachas

Deep learning models, particularly Convolutional Neural Networks (CNNs), have demonstrated exceptional performance in diagnosing skin diseases, often outperforming dermatologists. However, they have also unveiled biases linked to specific…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Anshul Pundhir , Balasubramanian Raman , Pravendra Singh

To equip Convolutional Neural Networks (CNNs) with explainability, it is essential to interpret how opaque models take specific decisions, understand what causes the errors, improve the architecture design, and identify unethical biases in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Mohammad Mahdi Dehshibi , Mona Ashtari-Majlan , Gereziher Adhane , David Masip

Novel AI-based arc fault diagnosis models have demonstrated outstanding performance in terms of classification accuracy. However, an inherent problem is whether these models can actually be trusted to find arc faults. In this light, this…

Artificial Intelligence · Computer Science 2025-07-22 Qianchao Wang , Yuxuan Ding , Chuanzhen Jia , Zhe Li , Yaping Du

Efforts to decode neural network vision models necessitate a comprehensive grasp of both the spatial and semantic facets governing feature responses within images. Most research has primarily centered around attribution methods, which…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Chris Hamblin , Thomas Fel , Srijani Saha , Talia Konkle , George Alvarez

AI-based image reconstruction models are increasingly deployed in clinical workflows to improve image quality from noisy data, such as low-dose X-rays or accelerated MRI scans. However, these models are typically evaluated using pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Matteo Wohlrapp , Niklas Bubeck , Daniel Rueckert , William Lotter

We take a formal approach to the explainability problem of machine learning systems. We argue against the practice of interpreting black-box models via attributing scores to input components due to inherently conflicting goals of…

Machine Learning · Computer Science 2023-06-13 Kai Jia , Pasapol Saowakon , Limor Appelbaum , Martin Rinard

Due to the sensitive nature of medicine, it is particularly important and highly demanded that AI methods are explainable. This need has been recognised and there is great research interest in xAI solutions with medical applications.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Luisa Gallée , Catharina Silvia Lisson , Christoph Gerhard Lisson , Daniela Drees , Felix Weig , Daniel Vogele , Meinrad Beer , Michael Götz

Explainable artificial intelligence (XAI) methods have become increasingly important in the context of explainable intrusion detection systems (X-IDSs) for improving the interpretability and trustworthiness of X-IDSs. However, existing…

Cryptography and Security · Computer Science 2025-05-14 Mohammed Alquliti , Erisa Karafili , BooJoong Kang

Interpretability is an important area of research for safe deployment of machine learning systems. One particular type of interpretability method attributes model decisions to input features. Despite active development, quantitative…

Machine Learning · Computer Science 2019-11-06 Mengjiao Yang , Been Kim

Widespread use of artificial intelligence (AI) algorithms and machine learning (ML) models on the one hand and a number of crucial issues pertaining to them warrant the need for explainable artificial intelligence (XAI). A key…

Artificial Intelligence · Computer Science 2023-12-13 Jinqiang Yu , Graham Farr , Alexey Ignatiev , Peter J. Stuckey

Attention mechanisms are dominating the explainability of deep models. They produce probability distributions over the input, which are widely deemed as feature-importance indicators. However, in this paper, we find one critical limitation…

Machine Learning · Computer Science 2022-07-06 Yibing Liu , Haoliang Li , Yangyang Guo , Chenqi Kong , Jing Li , Shiqi Wang

With the rising necessity of explainable artificial intelligence (XAI), we see an increase in task-dependent XAI methods on varying abstraction levels. XAI techniques on a global level explain model behavior and on a local level explain…

Human-Computer Interaction · Computer Science 2023-07-18 Udo Schlegel , Daniela Oelke , Daniel A. Keim , Mennatallah El-Assady

The proliferation of complex, black-box AI models has intensified the need for techniques that can explain their decisions. Feature attribution methods have become a popular solution for providing post-hoc explanations, yet the field has…

Machine Learning · Computer Science 2025-11-13 Xinpeng Li , Kai Ming Ting

Feature attribution methods are a popular approach to explain the behavior of machine learning models. They assign importance scores to each input feature, quantifying their influence on the model's prediction. However, evaluating these…

Machine Learning · Computer Science 2025-06-02 Magamed Taimeskhanov , Damien Garreau

Predictive Process Monitoring (PPM) often uses deep learning models to predict the future behavior of ongoing processes, such as predicting process outcomes. While these models achieve high accuracy, their lack of interpretability…

Artificial Intelligence · Computer Science 2025-06-23 Soobin Chae , Suhwan Lee , Hanna Hauptmann , Hajo A. Reijers , Xixi Lu

Most efforts in interpretability in deep learning have focused on (1) extracting explanations of a specific downstream task in relation to the input features and (2) imposing constraints on the model, often at the expense of predictive…

Machine Learning · Computer Science 2022-02-22 Marco Bertolini , Djork-Arné Clevert , Floriane Montanari

Predicting default is essential for banks to ensure profitability and financial stability. While modern machine learning methods often outperform traditional regression techniques, their lack of transparency limits their use in regulated…

Machine Learning · Computer Science 2025-09-16 Sagi Schwartz , Qinling Wang , Fang Fang