English
Related papers

Related papers: Representational Difference Explanations

200 papers

The evaluation of the fidelity of eXplainable Artificial Intelligence (XAI) methods to their underlying models is a challenging task, primarily due to the absence of a ground truth for explanations. However, assessing fidelity is a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 M. Miró-Nicolau , A. Jaume-i-Capó , G. Moyà-Alcover

Artificial intelligence (AI) has rapidly developed through advancements in computational power and the growth of massive datasets. However, this progress has also heightened challenges in interpreting the "black-box" nature of AI models. To…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Shilin Sun , Wenbin An , Feng Tian , Fang Nan , Qidong Liu , Jun Liu , Nazaraf Shah , Ping Chen

Many high-performance models suffer from a lack of interpretability. There has been an increasing influx of work on explainable artificial intelligence (XAI) in order to disentangle what is meant and expected by XAI. Nevertheless, there is…

Machine Learning · Computer Science 2019-10-23 Adrien Bennetot , Jean-Luc Laurent , Raja Chatila , Natalia Díaz-Rodríguez

Explainable Artificial Intelligence (XAI) aims to provide insights into the decision-making process of AI models, allowing users to understand their results beyond their decisions. A significant goal of XAI is to improve the performance of…

Artificial Intelligence · Computer Science 2023-06-12 Andrea Apicella , Luca Di Lorenzo , Francesco Isgrò , Andrea Pollastro , Roberto Prevete

Despite the popularisation of machine learning models, more often than not, they still operate as black boxes with no insight into what is happening inside the model. There exist a few methods that allow to visualise and explain why a model…

Machine Learning · Computer Science 2021-06-18 Błażej Leporowski , Alexandros Iosifidis

Recently, post hoc explanation methods have emerged to enhance model transparency by attributing model outputs to input features. However, these methods face challenges due to their specificity to certain neural network architectures and…

Machine Learning · Computer Science 2025-05-16 Seongun Kim , Sol A Kim , Geonhyeong Kim , Enver Menadjiev , Chanwoo Lee , Seongwook Chung , Nari Kim , Jaesik Choi

Learning compatible representations enables the interchangeable use of semantic features as models are updated over time. This is particularly relevant in search and retrieval systems where it is crucial to avoid reprocessing of the gallery…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Niccolò Biondi , Federico Pernici , Simone Ricci , Alberto Del Bimbo

XAI with natural language processing aims to produce human-readable explanations as evidence for AI decision-making, which addresses explainability and transparency. However, from an HCI perspective, the current approaches only focus on…

Computation and Language · Computer Science 2022-09-05 Jialin Yu , Alexandra I. Cristea , Anoushka Harit , Zhongtian Sun , Olanrewaju Tahir Aduragba , Lei Shi , Noura Al Moubayed

Reinforcement Learning (RL) has demonstrated substantial potential across diverse fields, yet understanding its decision-making process, especially in real-world scenarios where rationality and safety are paramount, is an ongoing challenge.…

Artificial Intelligence · Computer Science 2024-02-21 Yu Xiong , Zhipeng Hu , Ye Huang , Runze Wu , Kai Guan , Xingchen Fang , Ji Jiang , Tianze Zhou , Yujing Hu , Haoyu Liu , Tangjie Lyu , Changjie Fan

This paper aims to clarify the representational status of Deep Learning Models (DLMs). While commonly referred to as 'representations', what this entails is ambiguous due to a conflation of functional and relational conceptions of…

Artificial Intelligence · Computer Science 2025-03-25 Eamon Duede

Dimensionality reduction is a popular preprocessing and a widely used tool in data mining. Transparency, which is usually achieved by means of explanations, is nowadays a widely accepted and crucial requirement of machine learning based…

Machine Learning · Computer Science 2023-02-23 André Artelt , Alexander Schulz , Barbara Hammer

Contrastive explanations clarify why an event occurred in contrast to another. They are more inherently intuitive to humans to both produce and comprehend. We propose a methodology to produce contrastive explanations for classification…

Computation and Language · Computer Science 2021-09-15 Alon Jacovi , Swabha Swayamdipta , Shauli Ravfogel , Yanai Elazar , Yejin Choi , Yoav Goldberg

With the advent of deep learning, text generation language models have improved dramatically, with text at a similar level as human-written text. This can lead to rampant misinformation because content can now be created cheaply and…

Computation and Language · Computer Science 2023-01-24 Sai Gurrapu , Lifu Huang , Feras A. Batarseh

Decision explanations of machine learning black-box models are often generated by applying Explainable AI (XAI) techniques. However, many proposed XAI methods produce unverified outputs. Evaluation and verification are usually achieved with…

Machine Learning · Computer Science 2020-12-09 Udo Schlegel , Daniela Oelke , Daniel A. Keim , Mennatallah El-Assady

Artificial intelligence models encounter significant challenges due to their black-box nature, particularly in safety-critical domains such as healthcare, finance, and autonomous vehicles. Explainable Artificial Intelligence (XAI) addresses…

Artificial Intelligence · Computer Science 2025-03-14 Melkamu Mersha , Khang Lam , Joseph Wood , Ali AlShami , Jugal Kalita

The lack of transparency and explainability hinders the clinical adoption of Machine learning (ML) algorithms. While explainable artificial intelligence (XAI) methods have been proposed, little research has focused on the agreement between…

Machine Learning · Computer Science 2023-11-29 Aida Brankovic , Wenjie Huang , David Cook , Sankalp Khanna , Konstanty Bialkowski

In order to gain insights about the decision-making of different visual recognition backbones, we propose two methodologies, sub-explanation counting and cross-testing, that systematically applies deep explanation algorithms on a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Mingqi Jiang , Saeed Khorram , Li Fuxin

Deep Learning has already been successfully applied to analyze industrial sensor data in a variety of relevant use cases. However, the opaque nature of many well-performing methods poses a major obstacle for real-world deployment.…

Machine Learning · Computer Science 2023-10-20 Thomas Decker , Michael Lebacher , Volker Tresp

Evaluating synthetic tabular data is challenging, since they can differ from the real data in so many ways. There exist numerous metrics of synthetic data quality, ranging from statistical distances to predictive performance, often…

Machine Learning · Computer Science 2025-04-30 Jan Kapar , Niklas Koenen , Martin Jullum

Image recognition is a classic and common task in the computer vision field, which has been widely applied in the past decade. Most existing methods in literature aim to learn discriminative features from labeled images for classification,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Jiayin Sun , Hong Wang , Qiulei Dong