English
Related papers

Related papers: Explaining and visualizing black-box models throug…

200 papers

Deep learning has become the de facto standard and dominant paradigm in image analysis tasks, achieving state-of-the-art performance. However, this approach often results in "black-box" models, whose decision-making processes are difficult…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Nguyen Van Tu , Pham Nguyen Hai Long , Vo Hoai Viet

A particular class of Explainable AI (XAI) methods provide saliency maps to highlight part of the image a Convolutional Neural Network (CNN) model looks at to classify the image as a way to explain its working. These methods provide an…

Machine Learning · Computer Science 2021-06-25 Sam Zabdiel Sunder Samuel , Vidhya Kamakshi , Namrata Lodhi , Narayanan C Krishnan

Explainable Artificial Intelligence (XAI) has become increasingly significant for improving the interpretability and trustworthiness of machine learning models. While saliency maps have stolen the show for the last few years in the XAI…

Artificial Intelligence · Computer Science 2023-09-08 Antonin Poché , Lucas Hervier , Mohamed-Chafik Bakkay

Explainable AI~(XAI) methods such as SHAP can help discover feature attributions in black-box models. If the method reveals a significant attribution from a ``protected feature'' (e.g., gender, race) on the model output, the model is…

Machine Learning · Computer Science 2024-08-14 Jun Yuan , Aritra Dasgupta

Artificial Intelligence (AI) has continued to achieve tremendous success in recent times. However, the decision logic of these frameworks is often not transparent, making it difficult for stakeholders to understand, interpret or explain…

Machine Learning · Computer Science 2025-01-20 Fuseini Mumuni , Alhassan Mumuni

We share observations and challenges from an ongoing effort to implement Explainable AI (XAI) in a domain-specific workflow for cybersecurity analysts. Specifically, we briefly describe a preliminary case study on the use of XAI for source…

Human-Computer Interaction · Computer Science 2024-08-12 Ashley Suh , Harry Li , Caitlin Kenney , Kenneth Alperin , Steven R. Gomez

Most of state of the art methods applied on time series consist of deep learning methods that are too complex to be interpreted. This lack of interpretability is a major drawback, as several applications in the real world are critical…

Machine Learning · Computer Science 2021-04-05 Thomas Rojat , Raphaël Puget , David Filliat , Javier Del Ser , Rodolphe Gelin , Natalia Díaz-Rodríguez

Cybersecurity vendors consistently apply AI (Artificial Intelligence) to their solutions and many cybersecurity domains can benefit from AI technology. However, black-box AI techniques present some difficulties in comprehension and adoption…

Cryptography and Security · Computer Science 2023-03-03 Carlos Mendes , Tatiane Nogueira Rios

The rationale behind a deep learning model's output is often difficult to understand by humans. EXplainable AI (XAI) aims at solving this by developing methods that improve interpretability and explainability of machine learning models.…

Artificial Intelligence · Computer Science 2023-08-08 Rafaël Brandt , Daan Raatjens , Georgi Gaydadjiev

As machine learning algorithms are deployed ubiquitously to a variety of domains, it is imperative to make these often black-box models transparent. Several recent works explain black-box models by capturing the most influential features…

Explainable AI (XAI) and interpretable machine learning methods help to build trust in model predictions and derived insights, yet also present a perverse incentive for analysts to manipulate XAI metrics to support pre-specified…

Machine Learning · Computer Science 2025-07-16 Rahul Sharma , Sergey Redyuk , Sumantrak Mukherjee , Andrea Šipka , Eyke Hüllermeier , Sebastian Vollmer , David Selby

Corporate mergers and acquisitions (M&A) account for billions of dollars of investment globally every year, and offer an interesting and challenging domain for artificial intelligence. However, in these highly sensitive domains, it is…

Computation and Language · Computer Science 2020-10-26 Linyi Yang , Eoin M. Kenny , Tin Lok James Ng , Yi Yang , Barry Smyth , Ruihai Dong

Both humans and machine learning models learn from experience, particularly in safety- and reliability-critical domains. While psychology seeks to understand human cognition, the field of Explainable AI (XAI) develops methods to interpret…

Human-Computer Interaction · Computer Science 2025-11-25 Roussel Rahman , Aashwin Ananda Mishra , Wan-Lin Hu

Artificial intelligence (AI) enables machines to learn from human experience, adjust to new inputs, and perform human-like tasks. AI is progressing rapidly and is transforming the way businesses operate, from process automation to cognitive…

Machine Learning · Computer Science 2021-12-17 Ambreen Hanif

Explainable artificial intelligence (XAI) aims to make machine learning models more transparent. While many approaches focus on generating explanations post-hoc, interpretable approaches, which generate the explanations intrinsically…

Computation and Language · Computer Science 2024-12-12 Pascal Tilli , Ngoc Thang Vu

Although modern machine learning and deep learning methods allow for complex and in-depth data analytics, the predictive models generated by these methods are often highly complex, and lack transparency. Explainable AI (XAI) methods are…

Machine Learning · Computer Science 2021-06-17 Mythreyi Velmurugan , Chun Ouyang , Catarina Moreira , Renuka Sindhgatta

A longstanding challenge surrounding deep learning algorithms is unpacking and understanding how they make their decisions. Explainable Artificial Intelligence (XAI) offers methods to provide explanations of internal functions of algorithms…

Artificial Intelligence · Computer Science 2022-08-16 Amin Nayebi , Sindhu Tipirneni , Brandon Foreman , Chandan K. Reddy , Vignesh Subbian

In recent years, deep learning has achieved unprecedented success in various computer vision tasks, particularly in object detection. However, the black-box nature and high complexity of deep neural networks pose significant challenges for…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 FatemehSadat Seyedmomeni , Mohammad Ali Keyvanrad

Explainable Artificial Intelligence (XAI) is becoming increasingly essential for enhancing the transparency of machine learning (ML) models. Among the various XAI techniques, counterfactual explanations (CFs) hold a pivotal role due to…

Machine Learning · Computer Science 2026-01-29 Fatima Ezzeddine , Obaida Ammar , Silvia Giordano , Omran Ayoub

Explainability is increasingly seen as an essential feature of rule-based smart environments. While counterfactual explanations, which describe what could have been done differently to achieve a desired outcome, are a powerful tool in…

Artificial Intelligence · Computer Science 2025-10-06 Anna Trapp , Mersedeh Sadeghi , Andreas Vogelsang