English
Related papers

Related papers: Interpretability is in the Mind of the Beholder: A…

200 papers

The main focus of Hierarchical Reinforcement Learning (HRL) is studying how large Markov Decision Processes (MDPs) can be more efficiently solved when addressed in a modular way, by combining partial solutions computed for smaller subtasks.…

Machine Learning · Computer Science 2025-12-05 Roberto Cipollone , Luca Iocchi , Matteo Leonetti

The reasonable definition of semantic interpretability presents the core challenge in explainable AI. This paper proposes a method to modify a traditional convolutional neural network (CNN) into an interpretable compositional CNN, in order…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Wen Shen , Zhihua Wei , Shikun Huang , Binbin Zhang , Jiaqi Fan , Ping Zhao , Quanshi Zhang

Argumentation is a very active research field of Artificial Intelligence concerned with the representation and evaluation of arguments used in dialogues between humans and/or artificial agents. Acceptability semantics of formal…

Artificial Intelligence · Computer Science 2025-03-05 Zlatina Mileva , Antonis Bikakis , Fabio Aurelio D'Asaro , Mark Law , Alessandra Russo

Neural rationale models are popular for interpretable predictions of NLP tasks. In these, a selector extracts segments of the input text, called rationales, and passes these segments to a classifier for prediction. Since the rationale is…

Computation and Language · Computer Science 2022-07-26 Yiming Zheng , Serena Booth , Julie Shah , Yilun Zhou

Deep neural networks have achieved success across a wide range of applications, including as models of human behavior and neural representations in vision tasks. However, neural network training and human learning differ in fundamental…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Lukas Muttenthaler , Klaus Greff , Frieda Born , Bernhard Spitzer , Simon Kornblith , Michael C. Mozer , Klaus-Robert Müller , Thomas Unterthiner , Andrew K. Lampinen

In recent years, cross-modal reasoning (CMR), the process of understanding and reasoning across different modalities, has emerged as a pivotal area with applications spanning from multimedia analysis to healthcare diagnostics. As the…

Artificial Intelligence · Computer Science 2023-09-15 Dizhan Xue , Shengsheng Qian , Zuyi Zhou , Changsheng Xu

Semantic Role Labeling (SRL) aims at recognizing the predicate-argument structure of a sentence and can be decomposed into two subtasks: predicate disambiguation and argument labeling. Prior work deals with these two tasks independently,…

Computation and Language · Computer Science 2022-09-07 Nan Wang , Jiwei Li , Yuxian Meng , Xiaofei Sun , Han Qiu , Ziyao Wang , Guoyin Wang , Jun He

Causal representation learning (CRL) offers the promise of uncovering the underlying causal model by which observed data was generated, but the practical applicability of existing methods remains limited by the strong assumptions required…

Machine Learning · Computer Science 2026-01-30 Yuhang Liu , Zhen Zhang , Dong Gong , Erdun Gao , Biwei Huang , Mingming Gong , Anton van den Hengel , Kun Zhang , Javen Qinfeng Shi

Improving the interpretability of brain decoding approaches is of primary interest in many neuroimaging studies. Despite extensive studies of this type, at present, there is no formal definition for interpretability of brain decoding…

Machine Learning · Statistics 2016-06-21 Seyed Mostafa Kia , Andrea Passerini

This paper presents a systematic literature review (SLR) on the explainability and interpretability of machine learning (ML) models within the context of predictive process mining, using the PRISMA framework. Given the rapid advancement of…

Machine Learning · Computer Science 2024-01-01 Nijat Mehdiyev , Maxim Majlatow , Peter Fettke

With the perpetual increase of complexity of the state-of-the-art deep neural networks, it becomes a more and more challenging task to maintain their interpretability. Our work aims to evaluate the effects of adversarial training utilized…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Delyan Boychev

Explainability is a topic of growing importance in NLP. In this work, we provide a unified perspective of explainability as a communication problem between an explainer and a layperson about a classifier's decision. We use this framework to…

Computation and Language · Computer Science 2020-10-13 Marcos V. Treviso , André F. T. Martins

Learning arguments is highly relevant to the field of explainable artificial intelligence. It is a family of symbolic machine learning techniques that is particularly human-interpretable. These techniques learn a set of arguments as an…

Artificial Intelligence · Computer Science 2022-02-02 Jonas Bei , David Pomerenke , Lukas Schreiner , Sepideh Sharbaf , Pieter Collins , Nico Roos

Machine reading comprehension (MRC) aims to teach machines to read and comprehend human languages, which is a long-standing goal of natural language processing (NLP). With the burst of deep neural networks and the evolution of…

Computation and Language · Computer Science 2020-05-14 Zhuosheng Zhang , Hai Zhao , Rui Wang

As the use of machine learning (ML) models in product development and data-driven decision-making processes became pervasive in many domains, people's focus on building a well-performing model has increasingly shifted to understanding how…

Human-Computer Interaction · Computer Science 2020-06-02 Sungsoo Ray Hong , Jessica Hullman , Enrico Bertini

Explaining deep learning models is of vital importance for understanding artificial intelligence systems, improving safety, and evaluating fairness. To better understand and control the CNN model, many methods for…

Machine Learning · Computer Science 2022-11-24 Zhihao Wang , Chuang Zhu

As various post hoc explanation methods are increasingly being leveraged to explain complex models in high-stakes settings, it becomes critical to develop a deeper understanding of whether and when the explanations output by these methods…

Machine Learning · Computer Science 2025-04-18 Satyapriya Krishna , Tessa Han , Alex Gu , Steven Wu , Shahin Jabbari , Himabindu Lakkaraju

Interpretability aims to explain the behavior of deep neural networks. Despite rapid growth, there is mounting concern that much of this work has not translated into practical impact, raising questions about its relevance and utility. This…

Interpretability research often adopts a neuron-centric lens, treating individual neurons as the fundamental units of explanation. However, neuron-level explanations can be undermined by superposition, where single units respond to mixtures…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Julien Colin , Lore Goetschalckx , Thomas Fel , Victor Boutin , Thomas Serre , Nuria Oliver

Humans recognize objects after observing only a few examples, a remarkable capability enabled by their inherent language understanding of the real-world environment. Developing verbalized and interpretable representation can significantly…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Cheng-Fu Yang , Da Yin , Wenbo Hu , Heng Ji , Nanyun Peng , Bolei Zhou , Kai-Wei Chang