English
Related papers

Related papers: Neural Network Attribution Methods for Problems in…

200 papers

The complexity and opacity of neural networks (NNs) pose significant challenges, particularly in high-stakes fields such as healthcare, finance, and law, where understanding decision-making processes is crucial. To address these issues, the…

Machine Learning · Computer Science 2025-11-13 Helena Monke , Benjamin Sae-Chew , Benjamin Fresz , Marco F. Huber

Attribution methods are among the most prevalent techniques in Explainable Artificial Intelligence (XAI) and are usually evaluated and compared using Fidelity metrics, with Insertion and Deletion being the most popular. These metrics rely…

Artificial Intelligence · Computer Science 2025-12-15 Agustin Martin Picard , Thibaut Boissin , Varshini Subhash , Rémi Cadène , Thomas Fel

The black-box nature of artificial intelligence (AI) models has been the source of many concerns in their use for critical applications. Explainable Artificial Intelligence (XAI) is a rapidly growing research field that aims to create…

Cryptography and Security · Computer Science 2023-06-13 Gaith Rjoub , Jamal Bentahar , Omar Abdel Wahab , Rabeb Mizouni , Alyssa Song , Robin Cohen , Hadi Otrok , Azzam Mourad

Explainable AI (XAI) is an active research area to interpret a neural network's decision by ensuring transparency and trust in the task-specified learned models. Recently, perturbation-based model analysis has shown better interpretation,…

Computer Vision and Pattern Recognition · Computer Science 2021-02-17 Mahesh Sudhakar , Sam Sattarzadeh , Konstantinos N. Plataniotis , Jongseong Jang , Yeonjeong Jeong , Hyunwoo Kim

Improving the interpretability of geospatial artificial intelligence (GeoAI) models has become critically important to open the "black box" of complex AI models, such as deep learning. This paper compares popular saliency map generation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Chia-Yu Hsu , Wenwen Li

Although neural networks are a powerful tool, their widespread use is hindered by the opacity of their decisions and their black-box nature, which result in a lack of trustworthiness. To alleviate this problem, methods in the field of…

Machine Learning · Computer Science 2025-11-13 Helena Monke , Benjamin Fresz , Marco Bernreuther , Yilin Chen , Marco F. Huber

Hypernetworks are models that generate or modulate the weights of another network. They provide a flexible mechanism for injecting context and task conditioning and have proven broadly useful across diverse applications without significant…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Eli Passov , Nathan S. Netanyahu , Yosi Keller

Explainable AI (xAI) interventions aim to improve interpretability for complex black-box models, not only to improve user trust but also as a means to extract scientific insights from high-performing predictive systems. In molecular…

Machine Learning · Computer Science 2025-04-04 Jonas Teufel , Annika Leinweber , Pascal Friederich

Data Attribution (DA) is an emerging approach in the field of eXplainable Artificial Intelligence (XAI), aiming to identify influential training datapoints which determine model outputs. It seeks to provide transparency about the model and…

Machine Learning · Computer Science 2025-12-22 Galip Ümit Yolcu , Moritz Weckbecker , Thomas Wiegand , Wojciech Samek , Sebastian Lapuschkin

A growing literature on human-AI decision-making investigates strategies for combining human judgment with statistical models to improve decision-making. Research in this area often evaluates proposed improvements to models, interfaces, or…

Computers and Society · Computer Science 2023-05-29 Luke Guerdan , Amanda Coston , Zhiwei Steven Wu , Kenneth Holstein

This paper proposes a set of criteria to evaluate the objectiveness of explanation methods of neural networks, which is crucial for the development of explainable AI, but it also presents significant challenges. The core challenge is that…

Machine Learning · Computer Science 2019-11-21 Hao Zhang , Jiayi Chen , Haotian Xue , Quanshi Zhang

Research into explainable artificial intelligence (XAI) for data analysis tasks suffer from a large number of contradictions and lack of concrete design recommendations stemming from gaps in understanding the tasks that require AI…

Artificial Intelligence · Computer Science 2025-07-15 Hamzah Ziadeh , Hendrik Knoche

GeoAI is evolving rapidly, fueled by diverse geospatial datasets like traffic patterns, environmental data, and crowdsourced OpenStreetMap (OSM) information. While sophisticated AI models are being developed, existing benchmarks are often…

Machine Learning · Computer Science 2025-12-18 Julia Moska , Oleksii Furman , Kacper Kozaczko , Szymon Leszkiewicz , Jakub Polczyk , Piotr Gramacki , Piotr Szymański

Neural networks have shown remarkable performance in computer vision, but their deployment in numerous scientific and technical fields is challenging due to their black-box nature. Scientists and practitioners need to evaluate the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Gabriel Kasmi , Laurent Dubus , Yves-Marie Saint Drenan , Philippe Blanc

Deep neural networks are very successful on many vision tasks, but hard to interpret due to their black box nature. To overcome this, various post-hoc attribution methods have been proposed to identify image regions most influential to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Sukrut Rao , Moritz Böhle , Bernt Schiele

The usage of eXplainable Artificial Intelligence (XAI) methods has become essential in practical applications, given the increasing deployment of Artificial Intelligence (AI) models and the legislative requirements put forward in the latest…

Machine Learning · Computer Science 2025-10-14 Ilaria Vascotto , Valentina Blasone , Alex Rodriguez , Alessandro Bonaita , Luca Bortolussi

We uncover a phenomenon largely overlooked by the scientific community utilizing AI: neural networks exhibit high susceptibility to minute perturbations, resulting in significant deviations in their outputs. Through an analysis of five…

Neural networks are increasingly finding their way into the realm of graphs and modeling relationships between features. Concurrently graph neural network explanation approaches are being invented to uncover relationships between the nodes…

Machine Learning · Computer Science 2024-01-02 Razieh Rezaei , Alireza Dizaji , Ashkan Khakzar , Anees Kazi , Nassir Navab , Daniel Rueckert

Training Data Attribution (TDA) seeks to trace model predictions back to influential training examples, enhancing interpretability and safety. We formulate TDA as a Bayesian information-theoretic problem: subsets are scored by the…

Machine Learning · Computer Science 2026-04-10 Dharmesh Tailor , Nicolò Felicioni , Kamil Ciosek

According to the latest trend of artificial intelligence, AI-systems needs to clarify regarding general,specific decisions,services provided by it. Only consumer is satisfied, with explanation , for example, why any classification result is…

Machine Learning · Computer Science 2025-02-06 Rossi Kamal