English
Related papers

Related papers: Survey of explainable machine learning with visual…

200 papers

The emergence of explainability methods has enabled a better comprehension of how deep neural networks operate through concepts that are easily understood and implemented by the end user. While most explainability methods have been designed…

Neurons and Cognition · Quantitative Biology 2022-03-17 Fernanda L. Ribeiro , Steffen Bollmann , Ross Cunnington , Alexander M. Puckett

Lending decisions are usually made with proprietary models that provide minimally acceptable explanations to users. In a future world without such secrecy, what decision support tools would one want to use for justified lending decisions?…

Machine Learning · Computer Science 2021-06-07 Chaofan Chen , Kangcheng Lin , Cynthia Rudin , Yaron Shaposhnik , Sijia Wang , Tong Wang

A major concern of Machine Learning (ML) models is their opacity. They are deployed in an increasing number of applications where they often operate as black boxes that do not provide explanations for their predictions. Among others, the…

Machine Learning · Computer Science 2022-11-10 Pepa Atanasova

eXplanation Based Learning (XBL) is an interactive learning approach that provides a transparent method of training deep learning models by interacting with their explanations. XBL augments loss functions to penalize a model based on…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Misgina Tsighe Hagos , Niamh Belton , Kathleen M. Curran , Brian Mac Namee

A task of interest in machine learning (ML) is that of ascribing explanations to the predictions made by ML models. Furthermore, in domains deemed high risk, the rigor of explanations is paramount. Indeed, incorrect explanations can and…

Artificial Intelligence · Computer Science 2025-07-11 Mohamed Siala , Jordi Planes , Joao Marques-Silva

Building explainable systems is a critical problem in the field of Natural Language Processing (NLP), since most machine learning models provide no explanations for the predictions. Existing approaches for explainable machine learning…

Computation and Language · Computer Science 2019-06-12 Hui Liu , Qingyu Yin , William Yang Wang

Artificial Intelligence (AI) and its data-centric branch of machine learning (ML) have greatly evolved over the last few decades. However, as AI is used increasingly in real world use cases, the importance of the interpretability of and…

Machine Learning · Computer Science 2022-12-01 N. Ranasinghe , A. Ramanan , S. Fernando , P. N. Hameed , D. Herath , T. Malepathirana , P. Suganthan , M. Niranjan , S. Halgamuge

Issues regarding explainable AI involve four components: users, laws & regulations, explanations and algorithms. Together these components provide a context in which explanation methods can be evaluated regarding their adequacy. The goal of…

Artificial Intelligence · Computer Science 2018-03-30 Gabrielle Ras , Marcel van Gerven , Pim Haselager

With the continue development of Convolutional Neural Networks (CNNs), there is a growing concern regarding representations that they encode internally. Analyzing these internal representations is referred to as model interpretation. While…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Hamed Behzadi-Khormouji , José Oramas

Large Language Models (LLMs) have benefited enormously from scaling, yet these gains are bounded by five fundamental limitations: (1) hallucination, (2) context compression, (3) reasoning degradation, (4) retrieval fragility, and (5)…

The popularity of Deep Learning for real-world applications is ever-growing. With the introduction of high performance hardware, applications are no longer limited to image recognition. With the introduction of more complex problems comes…

Machine Learning · Computer Science 2019-09-13 Liam Hiley , Alun Preece , Yulia Hicks

While the uptake of data-driven approaches for materials science and chemistry is at an exciting, early stage, to realise the true potential of machine learning models for successful scientific discovery, they must have qualities beyond…

Materials Science · Physics 2022-06-28 Felipe Oviedo , Juan Lavista Ferres , Tonio Buonassisi , Keith Butler

Understanding how the human brain represents visual concepts, and in which brain regions these representations are encoded, remains a long-standing challenge. Decades of work have advanced our understanding of visual representations, yet…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Navve Wasserman , Matias Cosarinsky , Yuval Golbari , Aude Oliva , Antonio Torralba , Tamar Rott Shaham , Michal Irani

Machine learning models that first learn a representation of a domain in terms of human-understandable concepts, then use it to make predictions, have been proposed to facilitate interpretation and interaction with models trained on…

Machine Learning · Computer Science 2020-12-08 Isaac Lage , Finale Doshi-Velez

As the use of deep learning techniques has grown across various fields over the past decade, complaints about the opaqueness of the black-box models have increased, resulting in an increased focus on transparency in deep learning models.…

Computation and Language · Computer Science 2024-03-19 Siwen Luo , Hamish Ivison , Caren Han , Josiah Poon

This work proposes a novel general framework, in the context of eXplainable Artificial Intelligence (XAI), to construct explanations for the behaviour of Machine Learning (ML) models in terms of middle-level features. One can isolate two…

Machine Learning · Computer Science 2021-03-04 Andrea Apicella , Salvatore Giugliano , Francesco Isgrò , Roberto Prevete

Explanation methods aim to make neural networks more trustworthy and interpretable. In this paper, we demonstrate a property of explanation methods which is disconcerting for both of these purposes. Namely, we show that explanations can be…

Following the recent popularity of Large Language Models (LLMs), several attempts have been made to extend them to the visual domain. From having a visual assistant that could guide us through unfamiliar environments to generative models…

This paper contributes to interpretable machine learning via visual knowledge discovery in parallel coordinates. The concepts of hypercubes and hyper-blocks are used as easily understandable by end-users in the visual form in parallel…

Machine Learning · Computer Science 2021-07-06 Boris Kovalerchuk , Dustin Hayes

Deep learning is increasingly used as a building block of security systems. Unfortunately, neural networks are hard to interpret and typically opaque to the practitioner. The machine learning community has started to address this problem by…

Machine Learning · Computer Science 2020-04-28 Alexander Warnecke , Daniel Arp , Christian Wressnegger , Konrad Rieck