English
Related papers

Related papers: Trepan Reloaded: A Knowledge-driven Approach to Ex…

200 papers

When explaining the decisions of deep neural networks, simple stories are tempting but dangerous. Especially in computer vision, the most popular explanation approaches give a false sense of comprehension to its users and provide an overly…

Machine Learning · Computer Science 2021-09-17 Matthias Kirchler , Martin Graf , Marius Kloft , Christoph Lippert

Explainability of algorithmic decision-making systems is both a regulatory objective and an area of intense research. The article argues that a crucial condition for the acceptability of algorithmic decision-making systems is that decisions…

Computers and Society · Computer Science 2026-03-03 Sarra Tajouri , Yves Meinard , Alexis Tsoukiàs , Thierry Kirat

A wide variety of model explanation approaches have been proposed in recent years, all guided by very different rationales and heuristics. In this paper, we take a new route and cast interpretability as a statistical inference problem. We…

Machine Learning · Computer Science 2024-01-01 Hugo Henri Joseph Senetaire , Damien Garreau , Jes Frellsen , Pierre-Alexandre Mattei

Artificial Intelligence models are increasingly used in manufacturing to inform decision-making. Responsible decision-making requires accurate forecasts and an understanding of the models' behavior. Furthermore, the insights into models'…

Artificial Intelligence · Computer Science 2022-04-13 Jože M. Rožanec , Elena Trajkova , Inna Novalija , Patrik Zajec , Klemen Kenda , Blaž Fortuna , Dunja Mladenić

Medical toxicology is the clinical specialty that treats the toxic effects of substances, be it an overdose, a medication error, or a scorpion sting. The volume of toxicological knowledge and research has, as with other medical specialties,…

Artificial Intelligence · Computer Science 2021-02-03 Michael Chary , Ed W Boyer , Michele M Burns

As artificial intelligence systems increasingly inform high-stakes decisions across sectors, transparency has become foundational to responsible and trustworthy AI implementation. Leveraging our role as a leading institute in advancing AI…

Machine Learning · Computer Science 2025-08-01 Dhanesh Ramachandram , Himanshu Joshi , Judy Zhu , Dhari Gandhi , Lucas Hartman , Ananya Raval

Concept bottleneck models have been successfully used for explainable machine learning by encoding information within the model with a set of human-defined concepts. In the context of human-assisted or autonomous driving, explainability…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Jessica Echterhoff , An Yan , Kyungtae Han , Amr Abdelraouf , Rohit Gupta , Julian McAuley

The use of complex machine learning models can make systems opaque to users. Machine learning research proposes the use of post-hoc explanations. However, it is unclear if they give users insights into otherwise uninterpretable models. One…

Human-Computer Interaction · Computer Science 2019-05-09 Martin Schuessler , Philipp Weiß

In commentary driving, drivers verbalise their observations, assessments and intentions. By speaking out their thoughts, both learning and expert drivers are able to create a better understanding and awareness of their surroundings. In the…

Artificial Intelligence · Computer Science 2022-10-24 Daniel Omeiza , Sule Anjomshoae , Helena Webb , Marina Jirotka , Lars Kunze

Graph Neural Networks (GNNs) have become a powerful tool for modeling and analyzing data with graph structures. The wide adoption in numerous applications underscores the value of these models. However, the complexity of these methods often…

Artificial Intelligence · Computer Science 2025-12-10 Tien Cuong Bui

Although neural networks are a powerful tool, their widespread use is hindered by the opacity of their decisions and their black-box nature, which result in a lack of trustworthiness. To alleviate this problem, methods in the field of…

Machine Learning · Computer Science 2025-11-13 Helena Monke , Benjamin Fresz , Marco Bernreuther , Yilin Chen , Marco F. Huber

Graph Neural Networks (GNNs) have emerged as the predominant approach for learning over graph-structured data. However, most GNNs operate as black-box models and require post-hoc explanations, which may not suffice in high-stakes scenarios…

Machine Learning · Computer Science 2025-10-14 Maya Bechler-Speicher , Amir Globerson , Ran Gilad-Bachrach

Artificial intelligence (AI) continues to transform data analysis in many domains. Progress in each domain is driven by a growing body of annotated data, increased computational resources, and technological innovations. In medicine, the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Ahmad Chaddad , Qizong lu , Jiali Li , Yousef Katib , Reem Kateb , Camel Tanougast , Ahmed Bouridane , Ahmed Abdulkadir

Probabilistic inferences distill knowledge from graphs to aid human make important decisions. Due to the inherent uncertainty in the model and the complexity of the knowledge, it is desirable to help the end-users understand the inference…

Social and Information Networks · Computer Science 2019-08-21 Chao Chen , Yifei Liu , Xi Zhang , Sihong Xie

Decision tree models, including random forests and gradient-boosted decision trees, are widely used in machine learning due to their high predictive performance. However, their complex structures often make them difficult to interpret,…

Artificial Intelligence · Computer Science 2026-01-08 Akihiro Takemura , Masayuki Otani , Katsumi Inoue

The growing adoption of Graph Neural Networks (GNNs) in high-stakes domains like healthcare and finance demands reliable explanations of their decision-making processes. While inherently interpretable GNN architectures like Graph…

Machine Learning · Computer Science 2025-05-27 Rishabh Bhattacharya , Hari Shankar , Vaishnavi Shivkumar , Ponnurangam Kumaraguru

The advancement of robots, particularly those functioning in complex human-centric environments, relies on control solutions that are driven by machine learning. Understanding how learning-based controllers make decisions is crucial since…

Machine Learning · Computer Science 2023-11-14 Tsun-Hsuan Wang , Wei Xiao , Tim Seyde , Ramin Hasani , Daniela Rus

Today, the dominant paradigm for training neural networks involves minimizing task loss on a large dataset. Using world knowledge to inform a model, and yet retain the ability to perform end-to-end training remains an open question. In this…

Machine Learning · Computer Science 2020-08-21 Tao Li , Vivek Srikumar

Neural network interpretability is a vital component for applications across a wide variety of domains. In such cases it is often useful to analyze a network which has already been trained for its specific purpose. In this work, we develop…

Machine Learning · Computer Science 2019-11-19 Lawrence Phillips , Garrett Goh , Nathan Hodas

The integration of artificial intelligence into business processes has significantly enhanced decision-making capabilities across various industries such as finance, healthcare, and retail. However, explaining the decisions made by these AI…

Artificial Intelligence · Computer Science 2024-10-29 Arne Grobrugge , Nidhi Mishra , Johannes Jakubik , Gerhard Satzger