English
Related papers

Related papers: Neural Network Attribution Methods for Problems in…

200 papers

AI-for-science approaches have been applied to solve scientific problems (e.g., nuclear fusion, ecology, genomics, meteorology) and have achieved highly promising results. Spatial precipitation downscaling is one of the most important…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Xuanhong Chen , Kairui Feng , Naiyuan Liu , Bingbing Ni , Yifan Lu , Zhengyan Tong , Ziang Liu

Nowadays, deep neural networks are widely used in mission critical systems such as healthcare, self-driving vehicles, and military which have direct impact on human lives. However, the black-box nature of deep neural networks challenges its…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Arun Das , Paul Rad

A recent trend in machine learning has been to enrich learned models with the ability to explain their own predictions. The emerging field of Explainable AI (XAI) has so far mainly focused on supervised learning, in particular, deep neural…

Machine Learning · Computer Science 2022-07-13 Jacob Kauffmann , Malte Esders , Lukas Ruff , Grégoire Montavon , Wojciech Samek , Klaus-Robert Müller

Generative Artificial Intelligence (GenAI) is now widespread in education, yet the efficacy of GenAI systems remains constrained by the quality and interpretation of the labeled data used to train and evaluate them. Studies commonly report…

Computers and Society · Computer Science 2026-04-01 Danielle R. Thomas , Conrad Borchers , Kirk P. Vanacore , Kenneth R. Koedinger , René F. Kizilcec

The field of explainable artificial intelligence (XAI) aims to explain how black-box machine learning models work. Much of the work centers around the holy grail of providing post-hoc feature attributions to any model architecture. While…

Machine Learning · Computer Science 2023-11-15 Brian Barr , Noah Fatsi , Leif Hancox-Li , Peter Richter , Daniel Proano , Caleb Mok

Explainable artificial intelligence (XAI) methods have been applied to interpret deep learning model results. However, applications that integrate XAI with established hydrologic knowledge for process understanding remain limited. Here we…

Geophysics · Physics 2025-09-24 Sheng Ye , Jiyu Li , Yifan Chai , Lin Liu , Murugesu Sivapalan , Qihua Ran

Deep Neural Networks (DNNs) are known to be strong predictors, but their prediction strategies can rarely be understood. With recent advances in Explainable Artificial Intelligence (XAI), approaches are available to explore the reasoning…

Machine Learning · Computer Science 2023-03-01 Christopher J. Anders , David Neumann , Wojciech Samek , Klaus-Robert Müller , Sebastian Lapuschkin

Explainable AI (XAI) is slowly becoming a key component for many AI applications. Rule-based and modified backpropagation XAI approaches however often face challenges when being applied to modern model architectures including innovative…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Frederik Pahde , Galip Ümit Yolcu , Alexander Binder , Wojciech Samek , Sebastian Lapuschkin

Insects are a crucial part of our ecosystem. Sadly, in the past few decades, their numbers have worryingly decreased. In an attempt to gain a better understanding of this process and monitor the insects populations, Deep Learning may offer…

Artificial Intelligence · Computer Science 2022-06-16 Teodor Chiaburu , Felix Biessmann , Frank Hausser

Grasslands are known for their high biodiversity and ability to provide multiple ecosystem services. Challenges in automating the identification of indicator plants are key obstacles to large-scale grassland monitoring. These challenges…

Machine Learning · Computer Science 2023-12-15 Shanghua Liu , Anna Hedström , Deepak Hanike Basavegowda , Cornelia Weltzien , Marina M. -C. Höhne

Different prediction models might perform equally well (Rashomon set) in the same task, but offer conflicting interpretations and conclusions about the data. The Rashomon effect in the context of Explainable AI (XAI) has been recognized as…

Machine Learning · Computer Science 2024-07-29 Sichao Li , Amanda S. Barnard , Quanling Deng

Attribution methods explain neural network predictions by identifying influential input features, but their evaluation suffers from threshold selection bias that can reverse method rankings and undermine conclusions. Current protocols…

Machine Learning · Computer Science 2025-09-04 Serra Aksoy

Explainable artificial intelligence (XAI) aims to provide human-interpretable insights into the behavior of deep neural networks (DNNs), typically by estimating a simplified causal structure of the model. In existing work, this causal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Robin Hesse , Simone Schaub-Meyer , Janina Hesse , Bernt Schiele , Stefan Roth

The increasing reliance on Deep Learning models, combined with their inherent lack of transparency, has spurred the development of a novel field of study known as eXplainable AI (XAI) methods. These methods seek to enhance the trust of…

The evaluation of eXplainable Artificial Intelligence (XAI) methods is a rapidly growing field, characterized by a wide variety of approaches. This diversity highlights the complexity of the XAI evaluation, which, unlike traditional AI…

Artificial Intelligence · Computer Science 2026-02-10 Miquel Miró-Nicolau , Gabriel Moyà-Alcover , Anna Arias-Duart

Challenges persist in providing interpretable explanations for neural network reasoning in explainable AI (xAI). Existing methods like Integrated Gradients produce noisy maps, and LIME, while intuitive, may deviate from the model's…

Artificial Intelligence · Computer Science 2026-01-14 Caroline Mazini Rodrigues , Nicolas Boutry , Laurent Najman

Deep neural networks are very successful on many vision tasks, but hard to interpret due to their black box nature. To overcome this, various post-hoc attribution methods have been proposed to identify image regions most influential to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Sukrut Rao , Moritz Böhle , Bernt Schiele

In an era increasingly dominated by digital platforms, the spread of misinformation poses a significant challenge, highlighting the need for solutions capable of assessing information veracity. Our research contributes to the field of…

Computation and Language · Computer Science 2024-10-22 Darius Feher , Abdullah Khered , Hao Zhang , Riza Batista-Navarro , Viktor Schlegel

Neural additive model (NAM) is a recently proposed explainable artificial intelligence (XAI) method that utilizes neural network-based architectures. Given the advantages of neural networks, NAMs provide intuitive explanations for their…

Machine Learning · Computer Science 2024-11-12 Hoki Kim , Jinseong Park , Yujin Choi , Seungyun Lee , Jaewook Lee

In recent years, several efforts have been aimed at improving the robustness of vision models to domains and environments unseen during training. An important practical problem pertains to models deployed in a new geography that is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Tarun Kalluri , Wangdong Xu , Manmohan Chandraker