English
Related papers

Related papers: Sparks of Explainability: Recent Advancements in E…

200 papers

Recent breakthroughs in NLP research, such as the advent of Transformer models have indisputably contributed to major advancements in several tasks. However, few works research robustness and explainability issues of their evaluation…

Computation and Language · Computer Science 2022-10-31 Maria Lymperaiou , George Manoliadis , Orfeas Menis Mastromichalakis , Edmund G. Dervakos , Giorgos Stamou

Probabilistic inferences distill knowledge from graphs to aid human make important decisions. Due to the inherent uncertainty in the model and the complexity of the knowledge, it is desirable to help the end-users understand the inference…

Social and Information Networks · Computer Science 2019-08-21 Chao Chen , Yifei Liu , Xi Zhang , Sihong Xie

Over the past decades, classification models have proven to be essential machine learning tools given their potential and applicability in various domains. In these years, the north of the majority of the researchers had been to improve…

Machine Learning · Computer Science 2020-12-11 Mário Popolin Neto , Fernando V. Paulovich

Large Vision Language Models (VLMs), such as CLIP, have significantly contributed to various computer vision tasks, including object recognition and object detection. Their open vocabulary feature enhances their value. However, their…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Ali Rasekh , Sepehr Kazemi Ranjbar , Milad Heidari , Wolfgang Nejdl

Understanding complex machine learning models such as deep neural networks with explanations is crucial in various applications. Many explanations stem from the model perspective, and may not necessarily effectively communicate why the…

Machine Learning · Computer Science 2022-02-28 Chih-Kuan Yeh , Been Kim , Pradeep Ravikumar

With the rise of deep neural networks, the challenge of explaining the predictions of these networks has become increasingly recognized. While many methods for explaining the decisions of deep neural networks exist, there is currently no…

Machine Learning · Computer Science 2022-07-13 Ian E. Nielsen , Dimah Dera , Ghulam Rasool , Nidhal Bouaynaya , Ravi P. Ramachandran

This paper surveys visual methods of explainability of Machine Learning (ML) with focus on moving from quasi-explanations that dominate in ML to domain-specific explanation supported by granular visuals. ML interpretation is fundamentally a…

Machine Learning · Computer Science 2021-06-15 Boris Kovalerchuk , Muhammad Aurangzeb Ahmad , Ankur Teredesai

While deep neural networks have achieved remarkable performance, they tend to lack transparency in prediction. The pursuit of greater interpretability in neural networks often results in a degradation of their original performance. Some…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Hefeng Wu , Hao Jiang , Keze Wang , Ziyi Tang , Xianghuan He , Liang Lin

Classifying images with an interpretable decision-making process is a long-standing problem in computer vision. In recent years, Prototypical Part Networks has gained traction as an approach for self-explainable neural networks, due to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Zhijie Zhu , Lei Fan , Maurice Pagnucco , Yang Song

In this paper, we investigate the degree of explainability of graph neural networks (GNNs). Existing explainers work by finding global/local subgraphs to explain a prediction, but they are applied after a GNN has already been trained. Here,…

Machine Learning · Computer Science 2022-12-21 Indro Spinelli , Simone Scardapane , Aurelio Uncini

Recently, face recognition systems have demonstrated remarkable performances and thus gained a vital role in our daily life. They already surpass human face verification accountability in many scenarios. However, they lack explanations for…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Martin Knoche , Torben Teepe , Stefan Hörmann , Gerhard Rigoll

Most recent work on interpretability of complex machine learning models has focused on estimating $\textit{a posteriori}$ explanations for previously trained models around specific predictions. $\textit{Self-explaining}$ models where…

Machine Learning · Computer Science 2018-12-05 David Alvarez-Melis , Tommi S. Jaakkola

Large language models (LLMs) achieve strong performance across many natural language processing tasks, yet their decision processes remain difficult to interpret. This lack of transparency creates challenges for trust, debugging, and…

Computation and Language · Computer Science 2026-04-20 Venkata Abhinandan Kancharla

We introduce provenance networks, a novel class of neural models designed to provide end-to-end, training-data-driven explainability. Unlike conventional post-hoc methods, provenance networks learn to link each prediction directly to its…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Ali Kayyam , Anusha Madan Gopal , M. Anthony Lewis

Concept-based explanations translate the internal representations of deep learning models into a language that humans are familiar with: concepts. One popular method for finding concepts is Concept Activation Vectors (CAVs), which are…

Machine Learning · Computer Science 2025-02-14 Angus Nicolson , Lisa Schut , J. Alison Noble , Yarin Gal

In meta-learning approaches, it is difficult for a practitioner to make sense of what kind of representations the model employs. Without this ability, it can be difficult to both understand what the model knows as well as to make meaningful…

Machine Learning · Computer Science 2022-04-05 Pedro Sandoval-Segura , Wallace Lawson

Deep neural networks (DNNs) have achieved remarkable success in object detection tasks, but their increasing complexity poses significant challenges for deployment on resource-constrained platforms. While model compression techniques such…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Abhinav Shukla , Nachiket Tapas

To solve ever more complex problems, Deep Neural Networks are scaled to billions of parameters, leading to huge computational costs. An effective approach to reduce computational requirements and increase efficiency is to prune unnecessary…

Despite the fast progress of explanation techniques in modern Deep Neural Networks (DNNs) where the main focus is handling "how to generate the explanations", advanced research questions that examine the quality of the explanation itself…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Yuyang Gao , Tong Steven Sun , Guangji Bai , Siyi Gu , Sungsoo Ray Hong , Liang Zhao

Mechanistic interpretability aims to reverse engineer neural networks by uncovering which high-level algorithms they implement. Causal abstraction provides a precise notion of when a network implements an algorithm, i.e., a causal model of…

Machine Learning · Computer Science 2025-03-17 Theodora-Mara Pîslar , Sara Magliacane , Atticus Geiger