English
Related papers

Related papers: Post-hoc explanation of black-box classifiers usin…

200 papers

With the rapid growth of generative AI in numerous applications, explainable AI (XAI) plays a crucial role in ensuring the responsible development and deployment of generative AI technologies. XAI has undergone notable advancements and…

Machine Learning · Computer Science 2025-01-22 Yen-Lung Huang , Ming-Hsi Weng , Hao-Tsung Yang

Last years have been characterized by an upsurge of opaque automatic decision support systems, such as Deep Neural Networks (DNNs). Although they have great generalization and prediction skills, their functioning does not allow obtaining…

There has recently been a surge of work in explanatory artificial intelligence (XAI). This research area tackles the important problem that complex machines and algorithms often cannot provide insights into their behavior and thought…

Artificial Intelligence · Computer Science 2019-02-05 Leilani H. Gilpin , David Bau , Ben Z. Yuan , Ayesha Bajwa , Michael Specter , Lalana Kagal

Post-hoc explanation methods are widely used to interpret black-box predictions, but their generation is often computationally expensive and their reliability is not guaranteed. We propose epistemic uncertainty as a low-cost proxy for…

Artificial Intelligence · Computer Science 2026-04-01 Georgii Mikriukov , Grégoire Montavon , Marina M. -C. Höhne

The evaluation of the fidelity of eXplainable Artificial Intelligence (XAI) methods to their underlying models is a challenging task, primarily due to the absence of a ground truth for explanations. However, assessing fidelity is a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 M. Miró-Nicolau , A. Jaume-i-Capó , G. Moyà-Alcover

Although deep neural networks hold the state-of-the-art in several remote sensing tasks, their black-box operation hinders the understanding of their decisions, concealing any bias and other shortcomings in datasets and model performance.…

Machine Learning · Computer Science 2021-09-21 Ioannis Kakogeorgiou , Konstantinos Karantzalos

Explainable AI (XAI) aims to provide interpretations for predictions made by learning machines, such as deep neural networks, in order to make the machines more transparent for the user and furthermore trustworthy also for applications in…

Machine Learning · Computer Science 2020-06-17 Kirill Bykov , Marina M. -C. Höhne , Klaus-Robert Müller , Shinichi Nakajima , Marius Kloft

EXplainable AI has received significant attention in recent years. Machine learning models often operate as black boxes, lacking explainability and transparency while supporting decision-making processes. Local post-hoc explainability…

Artificial Intelligence · Computer Science 2024-05-24 Gianvincenzo Alfano , Sergio Greco , Domenico Mandaglio , Francesco Parisi , Reza Shahbazian , Irina Trubitsyna

Black box models are increasingly being used in the daily lives of human beings living in society. Along with this increase, there has been the emergence of Explainable Artificial Intelligence (XAI) methods aimed at generating additional…

Machine Learning · Computer Science 2024-07-04 José Ribeiro , Lucas Cardoso , Vitor Santos , Eduardo Carvalho , Níkolas Carneiro , Ronnie Alves

The ability to explain the prediction of deep learning models to end-users is an important feature to leverage the power of artificial intelligence (AI) for the medical decision-making process, which is usually considered non-transparent…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Truong Thanh Hung Nguyen , Van Binh Truong , Vo Thanh Khang Nguyen , Quoc Hung Cao , Quoc Khanh Nguyen

There has been a significant surge of interest recently around the concept of explainable artificial intelligence (XAI), where the goal is to produce an interpretation for a decision made by a machine learning algorithm. Of particular…

Machine Learning · Computer Science 2019-10-31 Zhong Qiu Lin , Mohammad Javad Shafiee , Stanislav Bochkarev , Michael St. Jules , Xiao Yu Wang , Alexander Wong

Although modern machine learning and deep learning methods allow for complex and in-depth data analytics, the predictive models generated by these methods are often highly complex, and lack transparency. Explainable AI (XAI) methods are…

Machine Learning · Computer Science 2021-06-17 Mythreyi Velmurugan , Chun Ouyang , Catarina Moreira , Renuka Sindhgatta

Strategies based on Explainable Artificial Intelligence - XAI have emerged in computing to promote a better understanding of predictions made by black box models. Most XAI measures used today explain these types of models, generating…

Machine Learning · Computer Science 2021-11-18 José Ribeiro , Raíssa Silva , Lucas Cardoso , Ronnie Alves

The advancements in deep learning-based methods for visual perception tasks have seen astounding growth in the last decade, with widespread adoption in a plethora of application areas from autonomous driving to clinical decision support…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Kumar Abhishek , Deeksha Kamath

Explainable Artificial Intelligence (XAI) is increasingly rec ognized as essential for deploying machine learning systems in safety critical environments. In Automatic Target Recognition (ATR), where models operate on image, video, radar,…

Artificial Intelligence · Computer Science 2026-05-08 Vanessa Buhrmester , David Muench , Dimitri Bulatov , Michael Arens

The development of machine learning applications has increased significantly in recent years, motivated by the remarkable ability of learning-powered systems to discover and generalize intricate patterns hidden in massive datasets. Modern…

Machine Learning · Computer Science 2025-04-25 Evandro S. Ortigossa , Fábio F. Dias , Brian Barr , Claudio T. Silva , Luis Gustavo Nonato

Explainable AI (XAI) methods aim to describe the decision process of deep neural networks. Early XAI methods produced visual explanations, whereas more recent techniques generate multimodal explanations that include textual information and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Alina Elena Baia , Valentina Poggioni , Andrea Cavallaro

Not only automation of manufacturing processes but also automation of automation procedures itself become increasingly relevant to automation research. In this context, automated capability assessment, mainly leveraged by deep learning…

Artificial Intelligence · Computer Science 2022-01-31 Raoul Schönhof , Artem Werner , Jannes Elstner , Boldizsar Zopcsak , Ramez Awad , Marco Huber

Explainable AI (XAI) holds significant promise for enhancing the transparency and trustworthiness of AI-driven threat detection in Security Operations Centers (SOCs). However, identifying the appropriate level and format of explanation,…

Cryptography and Security · Computer Science 2025-07-22 Nidhi Rastogi , Shirid Pant , Devang Dhanuka , Amulya Saxena , Pranjal Mairal

A longstanding challenge surrounding deep learning algorithms is unpacking and understanding how they make their decisions. Explainable Artificial Intelligence (XAI) offers methods to provide explanations of internal functions of algorithms…

Artificial Intelligence · Computer Science 2022-08-16 Amin Nayebi , Sindhu Tipirneni , Brandon Foreman , Chandan K. Reddy , Vignesh Subbian