English
Related papers

Related papers: Semantic Prototypes: Enhancing Transparency Withou…

200 papers

Explainability for Large Language Models (LLMs) is a critical yet challenging aspect of natural language processing. As LLMs are increasingly integral to diverse applications, their "black-box" nature sparks significant concerns regarding…

Computation and Language · Computer Science 2024-02-23 Haoyan Luo , Lucia Specia

The widespread adoption of black-box models in Artificial Intelligence has enhanced the need for explanation methods to reveal how these obscure models reach specific decisions. Retrieving explanations is fundamental to unveil possible…

Artificial Intelligence · Computer Science 2021-02-26 Francesco Bodria , Fosca Giannotti , Riccardo Guidotti , Francesca Naretto , Dino Pedreschi , Salvatore Rinzivillo

In this paper, we propose a textual clue approach to help metaphor detection, in order to improve the semantic processing of this figure. The previous works in the domain studied the semantic regularities only, overlooking an obvious set of…

cmp-lg · Computer Science 2008-02-03 Stéphane Ferrari

Black-box deep neural networks excel in text classification, yet their application in high-stakes domains is hindered by their lack of interpretability. To address this, we propose Text Bottleneck Models (TBM), an intrinsically…

Computation and Language · Computer Science 2024-04-04 Josh Magnus Ludan , Qing Lyu , Yue Yang , Liam Dugan , Mark Yatskar , Chris Callison-Burch

Concept Bottleneck Models (CBMs) aim for ante-hoc interpretability by learning a bottleneck layer that predicts interpretable concepts before the decision. State-of-the-art approaches typically select which concepts to learn via human…

Machine Learning · Computer Science 2026-03-10 Antonio De Santis , Schrasing Tong , Marco Brambilla , Lalana Kagal

Explaining deep learning models is of vital importance for understanding artificial intelligence systems, improving safety, and evaluating fairness. To better understand and control the CNN model, many methods for…

Machine Learning · Computer Science 2022-11-24 Zhihao Wang , Chuang Zhu

Concept-based explanations work by mapping complex model computations to human-understandable concepts. Evaluating such explanations is very difficult, as it includes not only the quality of the induced space of possible concepts but also…

Computation and Language · Computer Science 2025-06-05 Antonin Poché , Alon Jacovi , Agustin Martin Picard , Victor Boutin , Fanny Jourdan

There has been a large number of studies in interpretable and explainable ML for cybersecurity, in particular, for intrusion detection. Many of these studies have significant amount of overlapping and repeated evaluations and analysis. At…

Cryptography and Security · Computer Science 2024-07-08 Omer Subasi , Johnathan Cree , Joseph Manzano , Elena Peterson

Point cloud understanding aims to acquire robust and general feature representations from unlabeled data. Masked point modeling-based methods have recently shown significant performance across various downstream tasks. These pre-training…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Yixin Zha , Chuxin Wang , Wenfei Yang , Tianzhu Zhang

Deep neural networks learn fragile "shortcut" features, rendering them difficult to interpret (black box) and vulnerable to adversarial attacks. This paper proposes semantic features as a general architectural solution to this problem. The…

Machine Learning · Computer Science 2024-04-18 Maciej Satkiewicz

We propose Black Box Explanations through Transparent Approximations (BETA), a novel model agnostic framework for explaining the behavior of any black-box classifier by simultaneously optimizing for fidelity to the original model and…

Artificial Intelligence · Computer Science 2017-07-06 Himabindu Lakkaraju , Ece Kamar , Rich Caruana , Jure Leskovec

Visual concept discovery has long been deemed important to improve interpretability of neural networks, because a bank of semantically meaningful concepts would provide us with a starting point for building machine learning models that…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Haiyang Huang , Zhi Chen , Cynthia Rudin

Vision models are interpretable when they classify objects on the basis of features that a person can directly understand. Recently, methods relying on visual feature prototypes have been developed for this purpose. However, in contrast to…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Peter Hase , Chaofan Chen , Oscar Li , Cynthia Rudin

Opaque models belonging to the machine learning world are ever more exploited in the most different application areas. These models, acting as black boxes (BB) from the human perspective, cannot be entirely trusted if the application is…

Artificial Intelligence · Computer Science 2022-11-02 Federico Sabbatini , Roberta Calegari

The challenge of creating interpretable models has been taken up by two main research communities: ML researchers primarily focused on lower-level explainability methods that suit the needs of engineers, and HCI researchers who have more…

Machine Learning · Computer Science 2024-07-16 Juan D. Pinto , Luc Paquette

Deep learning models have achieved remarkable success in different areas of machine learning over the past decade; however, the size and complexity of these models make them difficult to understand. In an effort to make them more…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Vikram V. Ramaswamy , Sunnie S. Y. Kim , Nicole Meister , Ruth Fong , Olga Russakovsky

Despite recent advances in machine learning and explainable AI, a gap remains in personalized preventive healthcare: predictions, interventions, and recommendations should be both understandable and verifiable for all stakeholders in the…

Enhancing model interpretability can address spurious correlations by revealing how models draw their predictions. Concept Bottleneck Models (CBMs) can provide a principled way of disclosing and guiding model behaviors through…

Machine Learning · Computer Science 2024-07-15 Jeeyung Kim , Ze Wang , Qiang Qiu

Understanding what knowledge is implicitly encoded in deep learning models is essential for improving the interpretability of AI systems. This paper examines common methods to explain the knowledge encoded in word embeddings, which are core…

Computation and Language · Computer Science 2025-08-20 Hanna Herasimchyk , Alhassan Abdelhalim , Sören Laue , Michaela Regneri

In this introductory article we present the basics of an approach to implementing computational interpreting of natural language aiming to model the meanings of words and phrases. Unlike other approaches, we attempt to define the meanings…

Computation and Language · Computer Science 2019-08-12 Michael Kapustin , Pavlo Kapustin