English
Related papers

Related papers: PRIME: Prioritizing Interpretability in Failure Mo…

200 papers

Machine learning models have had discernible achievements in a myriad of applications. However, most of these models are black-boxes, and it is obscure how the decisions are made by them. This makes the models unreliable and untrustworthy.…

Machine Learning · Computer Science 2020-03-23 Raha Moraffah , Mansooreh Karami , Ruocheng Guo , Adrienne Raglin , Huan Liu

Interpretability is a pressing issue for decision systems. Many post hoc methods have been proposed to explain the predictions of a single machine learning model. However, business processes and decision systems are rarely centered around a…

Machine Learning · Computer Science 2023-03-22 Gianluigi Lopardo , Damien Garreau , Frederic Precioso , Greger Ottosson

Interpretable machine learning has emerged as central in leveraging artificial intelligence within high-stakes domains such as healthcare, where understanding the rationale behind model predictions is as critical as achieving high…

Machine Learning · Computer Science 2024-04-30 Christel Sirocchi , Martin Urschler , Bastian Pfeifer

Interpretable part-prototype models are computer vision models that are explainable by design. The models learn prototypical parts and recognise these components in an image, thereby combining classification and explanation. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Meike Nauta , Christin Seifert

We study the problem of computer-assisted teaching with explanations. Conventional approaches for machine teaching typically only provide feedback at the instance level e.g., the category or label of the instance. However, it is intuitive…

Computer Vision and Pattern Recognition · Computer Science 2018-02-21 Oisin Mac Aodha , Shihan Su , Yuxin Chen , Pietro Perona , Yisong Yue

Interpretable AI tools are often motivated by the goal of understanding model behavior in out-of-distribution (OOD) contexts. Despite the attention this area of study receives, there are comparatively few cases where these tools have…

Machine Learning · Computer Science 2023-09-25 Stephen Casper , Yuxiao Li , Jiawei Li , Tong Bu , Kevin Zhang , Kaivalya Hariharan , Dylan Hadfield-Menell

Capturing interpretable variations has long been one of the goals in disentanglement learning. However, unlike the independence assumption, interpretability has rarely been exploited to encourage disentanglement in the unsupervised setting.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Xinqi Zhu , Chang Xu , Dacheng Tao

A wide variety of model explanation approaches have been proposed in recent years, all guided by very different rationales and heuristics. In this paper, we take a new route and cast interpretability as a statistical inference problem. We…

Machine Learning · Computer Science 2024-01-01 Hugo Henri Joseph Senetaire , Damien Garreau , Jes Frellsen , Pierre-Alexandre Mattei

Complex machine learning models are deployed in several critical domains including healthcare and autonomous vehicles nowadays, albeit as functional black boxes. Consequently, there has been a recent surge in interpreting decisions of such…

Artificial Intelligence · Computer Science 2021-01-20 Zijian Zhang , Jaspreet Singh , Ujwal Gadiraju , Avishek Anand

Structured-output learning is a challenging problem; particularly so because of the difficulty in obtaining large datasets of fully labelled instances for training. In this paper we try to overcome this difficulty by presenting a…

Computer Vision and Pattern Recognition · Computer Science 2014-06-24 Roman Shapovalov , Dmitry Vetrov , Anton Osokin , Pushmeet Kohli

Recent developments in machine learning have introduced models that approach human performance at the cost of increased architectural complexity. Efforts to make the rationales behind the models' predictions transparent have inspired an…

Computation and Language · Computer Science 2020-09-29 Pepa Atanasova , Jakob Grue Simonsen , Christina Lioma , Isabelle Augenstein

In complex inferential tasks like question answering, machine learning models must confront two challenges: the need to implement a compositional reasoning process, and, in many applications, the need for this reasoning process to be…

Computer Vision and Pattern Recognition · Computer Science 2019-03-08 Ronghang Hu , Jacob Andreas , Trevor Darrell , Kate Saenko

Text classification is crucial for applications such as sentiment analysis and toxic text filtering, but it still faces challenges due to the complexity and ambiguity of natural language. Recent advancements in deep learning, particularly…

Computation and Language · Computer Science 2024-08-29 Lingyu Gao

Object-centric representations using slots have shown the advances towards efficient, flexible and interpretable abstraction from low-level perceptual features in a compositional scene. Current approaches randomize the initial state of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Ning Gao , Bernard Hohmann , Gerhard Neumann

Prototypical part learning is emerging as a promising approach for making semantic segmentation interpretable. The model selects real patches seen during training as prototypes and constructs the dense prediction map based on the similarity…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Hugo Porta , Emanuele Dalsasso , Diego Marcos , Devis Tuia

This paper shows that a popular approach to the supervised embedding of documents for classification, namely, contrastive Word Mover's Embedding, can be significantly enhanced by adding interpretability. This interpretability is achieved by…

Computation and Language · Computer Science 2021-11-02 Ruijie Jiang , Julia Gouvea , Eric Miller , David Hammer , Shuchin Aeron

Explaining black-box Artificial Intelligence (AI) models is a cornerstone for trustworthy AI and a prerequisite for its use in safety critical applications such that AI models can reliably assist humans in critical decisions. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Poulami Sinhamahapatra , Lena Heidemann , Maureen Monnet , Karsten Roscher

Model interpretability is an increasingly important component of practical machine learning. Some of the most common forms of interpretability systems are example-based, local, and global explanations. One of the main challenges in…

Machine Learning · Computer Science 2019-01-08 Gregory Plumb , Denali Molitor , Ameet Talwalkar

With the proliferation of models for natural language processing tasks, it is even harder to understand the differences between models and their relative merits. Simply looking at differences between holistic metrics such as accuracy, BLEU,…

Computation and Language · Computer Science 2020-12-10 Jinlan Fu , Pengfei Liu , Graham Neubig

Application of interpretable machine learning techniques on medical datasets facilitate early and fast diagnoses, along with getting deeper insight into the data. Furthermore, the transparency of these models increase trust among…

Machine Learning · Computer Science 2025-06-05 Sreejita Ghosh , Elizabeth S. Baranowski , Michael Biehl , Wiebke Arlt , Peter Tino , Kerstin Bunte