English
Related papers

Related papers: SAFE: Saliency-Aware Counterfactual Explanations f…

200 papers

Autonomous driving systems are typically verified based on scenarios. To represent the positions and movements of cars in these scenarios, diagrams that utilize icons are typically employed. However, the interpretation of such diagrams is…

Software Engineering · Computer Science 2025-01-17 Toshiaki Aoki , Takashi Tomita , Tatsuji Kawai , Daisuke Kawakami , Nobuo Chida

We address the need to generate faithful explanations of "black box" Deep Learning models. Several tests have been proposed to determine aspects of faithfulness of explanation methods, but they lack cross-domain applicability and a rigorous…

Machine Learning · Computer Science 2023-06-27 Harshinee Sriram , Cristina Conati

Visual perception is the most critical input for driving decisions. In this study, our aim is to understand relationship between saliency and driving decisions. We present a novel attention-based saliency map prediction model for making…

Computer Vision and Pattern Recognition · Computer Science 2020-02-26 Ekrem Aksoy , Ahmet Yazıcı , Mahmut Kasap

In the realm of practical fine-grained visual classification applications rooted in deep learning, a common scenario involves training a model using a pre-existing dataset. Subsequently, a new dataset becomes available, prompting the desire…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Zheming Zuo , Joseph Smith , Jonathan Stonehouse , Boguslaw Obara

Modern deep neural networks have now reached human-level performance across a variety of tasks. However, unlike humans they lack the ability to explain their decisions by showing where and telling what concepts guided them. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Itay Benou , Tammy Riklin-Raviv

We develop a method for generating causal post-hoc explanations of black-box classifiers based on a learned low-dimensional representation of the data. The explanation is causal in the sense that changing learned latent factors produces a…

Machine Learning · Computer Science 2020-10-23 Matthew O'Shaughnessy , Gregory Canal , Marissa Connor , Mark Davenport , Christopher Rozell

Graph neural networks (GNNs) have various practical applications, such as drug discovery, recommendation engines, and chip design. However, GNNs lack transparency as they cannot provide understandable explanations for their predictions. To…

Machine Learning · Computer Science 2023-06-09 Samidha Verma , Burouj Armgaan , Sourav Medya , Sayan Ranu

Counterfactual explanations (CFEs) are a popular approach for interpreting machine learning predictions by identifying minimal feature changes that alter model outputs. However, in real-world settings, users often refine feasibility…

Machine Learning · Computer Science 2025-05-28 Christos Fragkathoulas , Evaggelia Pitoura

Explaining the output of a complicated machine learning model like a deep neural network (DNN) is a central challenge in machine learning. Several proposed local explanation methods address this issue by identifying what dimensions of a…

Computer Vision and Pattern Recognition · Computer Science 2018-10-09 Julius Adebayo , Justin Gilmer , Ian Goodfellow , Been Kim

Attribution-based explanation techniques capture key patterns to enhance visual interpretability; however, these patterns often lack the granularity needed for insight in fine-grained tasks, particularly in cases of model misclassification,…

Artificial Intelligence · Computer Science 2025-11-12 Lintong Zhang , Kang Yin , Seong-Whan Lee

Recent advancements in signal processing and machine learning domains have resulted in an extensive surge of interest in deep learning models due to their unprecedented performance and high accuracy for different and challenging problems of…

Computer Vision and Pattern Recognition · Computer Science 2018-03-01 Atefeh Shahroudnejad , Arash Mohammadi , Konstantinos N. Plataniotis

Explainability and uncertainty quantification are key to trustable artificial intelligence. However, the reasoning behind uncertainty estimates is generally left unexplained. Identifying the drivers of uncertainty complements explanations…

Machine Learning · Computer Science 2025-05-13 Pascal Iversen , Simon Witzke , Katharina Baum , Bernhard Y. Renard

One of the significant challenges of deep neural networks is that the complex nature of the network prevents human comprehension of the outcome of the network. Consequently, the applicability of complex machine learning models is limited in…

Computer Vision and Pattern Recognition · Computer Science 2020-06-22 Shailja Thakur , Sebastian Fischmeister

In mission-critical domains such as law enforcement and medical diagnosis, the ability to explain and interpret the outputs of deep learning models is crucial for ensuring user trust and supporting informed decision-making. Despite…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Bharat Chandra Yalavarthi , Nalini Ratha

Counterfactual Explanations (CEs) are a powerful technique used to explain Machine Learning models by showing how the input to a model should be minimally changed for the model to produce a different output. Similar proposals have been made…

Artificial Intelligence · Computer Science 2025-09-01 Nicola Gigante , Francesco Leofante , Andrea Micheli

Machine learning models that operate on graph-structured data, such as molecular graphs or social networks, often make accurate predictions but offer little insight into why certain predictions are made. Counterfactual explanations address…

Machine Learning · Computer Science 2025-11-21 David Bechtoldt , Sidney Bender

The opaqueness of the multi-hop fact verification model imposes imperative requirements for explainability. One feasible way is to extract rationales, a subset of inputs, where the performance of prediction drops dramatically when being…

Computation and Language · Computer Science 2022-12-05 Jiasheng Si , Yingjie Zhu , Deyu Zhou

The existence of a Control Barrier Function (CBF) for a control-affine system provides a powerful design tool to ensure safety. Any controller that satisfies the CBF condition and ensures that the trajectories of the closed-loop system are…

Optimization and Control · Mathematics 2023-06-14 Mohammed Alyaseen , Nikolay Atanasov , Jorge Cortes

Credit scoring is a major application of machine learning for financial institutions to decide whether to approve or reject a credit loan. For sake of reliability, it is necessary for credit scoring models to be both accurate and globally…

Machine Learning · Computer Science 2021-02-25 Qiang Liu , Zhaocheng Liu , Haoli Zhang , Yuntian Chen , Jun Zhu

Artificial intelligence is increasingly leveraged across various domains to automate decision-making processes that significantly impact human lives. In medical image analysis, deep learning models have demonstrated remarkable performance.…

Machine Learning · Computer Science 2025-07-28 Julia Siekiera , Stefan Kramer