English
Related papers

Related papers: FINCH: Locally Visualizing Higher-Order Feature In…

200 papers

Recent work has demonstrated the promise of combining local explanations with active learning for understanding and supervising black-box models. Here we show that, under specific conditions, these algorithms may misrepresent the quality of…

Artificial Intelligence · Computer Science 2020-07-21 Teodora Popordanoska , Mohit Kumar , Stefano Teso

Labeling neural network submodules with human-legible descriptions is useful for many downstream tasks: such descriptions can surface failures, guide interventions, and perhaps even explain important model behaviors. To date, most…

Computation and Language · Computer Science 2023-12-11 Sarah Schwettmann , Tamar Rott Shaham , Joanna Materzynska , Neil Chowdhury , Shuang Li , Jacob Andreas , David Bau , Antonio Torralba

This paper provides empirical concerns about post-hoc explanations of black-box ML models, one of the major trends in AI explainability (XAI), by showing its lack of interpretability and societal consequences. Using a representative…

Human-Computer Interaction · Computer Science 2021-10-01 Jean-Marie John-Mathews

Despite the popularisation of machine learning models, more often than not, they still operate as black boxes with no insight into what is happening inside the model. There exist a few methods that allow to visualise and explain why a model…

Machine Learning · Computer Science 2021-06-18 Błażej Leporowski , Alexandros Iosifidis

Machine learning models in safety-critical settings like healthcare are often blackboxes: they contain a large number of parameters which are not transparent to users. Post-hoc explainability methods where a simple, human-interpretable…

Machine Learning · Computer Science 2022-06-03 Aparna Balagopalan , Haoran Zhang , Kimia Hamidieh , Thomas Hartvigsen , Frank Rudzicz , Marzyeh Ghassemi

Causal approaches to post-hoc explainability for black-box prediction models (e.g., deep neural networks trained on image pixel data) have become increasingly popular. However, existing approaches have two important shortcomings: (i) the…

Machine Learning · Computer Science 2025-08-12 Numair Sani , Daniel Malinsky , Ilya Shpitser

The growing capability and accessibility of machine learning has led to its application to many real-world domains and data about people. Despite the benefits algorithmic systems may bring, models can reflect, inject, or exacerbate implicit…

Machine Learning · Computer Science 2021-10-28 Ángel Alexander Cabrera , Will Epperson , Fred Hohman , Minsuk Kahng , Jamie Morgenstern , Duen Horng Chau

Many processes, from gene interaction in biology to computer networks to social media, can be modeled more precisely as temporal hypergraphs than by regular graphs. This is because hypergraphs generalize graphs by extending edges to connect…

Human-Computer Interaction · Computer Science 2021-05-12 Maximilian T. Fischer , Devanshu Arya , Dirk Streeb , Daniel Seebacher , Daniel A. Keim , Marcel Worring

In this paper we propose a new framework for evaluating the performance of explanation methods on the decisions of a deepfake detector. This framework assesses the ability of an explanation method to spot the regions of a fake image with…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Konstantinos Tsigos , Evlampios Apostolidis , Spyridon Baxevanakis , Symeon Papadopoulos , Vasileios Mezaris

Predominately in explainable artificial intelligence (XAI) research, the Shapley value (SV) is applied to determine feature attributions for any black box model. Shapley interaction indices extend the SV to define any-order feature…

Machine Learning · Computer Science 2023-10-31 Fabian Fumagalli , Maximilian Muschalik , Patrick Kolpaczki , Eyke Hüllermeier , Barbara Hammer

In recent years, deep neural networks have been widely used for building high-performance Artificial Intelligence (AI) systems for computer vision applications. Object detection is a fundamental task in computer vision, which has been…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Milad Moradi , Ke Yan , David Colwell , Matthias Samwald , Rhona Asgari

Black-box Artificial Intelligence (AI) methods, e.g. deep neural networks, have been widely utilized to build predictive models that can extract complex relationships in a dataset and make predictions for new unseen data records. However,…

Artificial Intelligence · Computer Science 2020-09-22 Milad Moradi , Matthias Samwald

With the increasing number of deep learning applications, there is a growing demand for explanations. Visual explanations provide information about which parts of an image are relevant for a classifier's decision. However, highlighting of…

Machine Learning · Computer Science 2019-10-07 Johannes Rabold , Hannah Deininger , Michael Siebers , Ute Schmid

Deep neural networks (DNNs) have been shown to outperform traditional machine learning algorithms in a broad variety of application domains due to their effectiveness in modeling complex problems and handling high-dimensional datasets. Many…

Inferring behavior model of a running software system is quite useful for several automated software engineering tasks, such as program comprehension, anomaly detection, and testing. Most existing dynamic model inference techniques are…

Machine Learning · Computer Science 2020-08-31 Mohammad Jafar Mashhadi , Hadi Hemmati

Establishing correspondences across images is a fundamental challenge in computer vision, underpinning tasks like Structure-from-Motion, image editing, and point tracking. Traditional methods are often specialized for specific…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Fei Xue , Sven Elflein , Laura Leal-Taixé , Qunjie Zhou

Modern data analytics underpinned by machine learning techniques has become a key enabler to the automation of data-led decision making. As an important branch of state-of-the-art data analytics, business process predictions are also faced…

Artificial Intelligence · Computer Science 2021-07-22 Chun Ouyang , Renuka Sindhgatta , Catarina Moreira

The growing complexity of machine learning and deep learning models has led to an increased reliance on opaque "black box" systems, making it difficult to understand the rationale behind predictions. This lack of transparency is…

Machine Learning · Computer Science 2025-02-06 Pratinav Seth , Yashwardhan Rathore , Neeraj Kumar Singh , Chintan Chitroda , Vinay Kumar Sankarapu

Black-box deep learning approaches have showcased significant potential in the realm of medical image analysis. However, the stringent trustworthiness requirements intrinsic to the medical field have catalyzed research into the utilization…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Yequan Bie , Luyang Luo , Hao Chen

Techniques that explain the predictions of black-box machine learning models are crucial to make the models transparent, thereby increasing trust in AI systems. The input features to the models often have a nested structure that consists of…

Machine Learning · Computer Science 2025-05-26 Yuya Yoshikawa , Masanari Kimura , Ryotaro Shimizu , Yuki Saito