English
Related papers

Related papers: Quantifying Model Complexity via Functional Decomp…

200 papers

Interpretation of deep learning models is a very challenging problem because of their large number of parameters, complex connections between nodes, and unintelligible feature representations. Despite this, many view interpretability as a…

Machine Learning · Computer Science 2021-03-05 Michael Tsang , James Enouen , Yan Liu

Interpretability is a pressing issue for decision systems. Many post hoc methods have been proposed to explain the predictions of a single machine learning model. However, business processes and decision systems are rarely centered around a…

Machine Learning · Computer Science 2023-03-22 Gianluigi Lopardo , Damien Garreau , Frederic Precioso , Greger Ottosson

Multi-hop reading comprehension requires not only the ability to reason over raw text but also the ability to combine multiple evidence. We propose a novel learning approach that helps language models better understand difficult multi-hop…

Computation and Language · Computer Science 2022-11-08 Xiao-Yu Guo , Yuan-Fang Li , Gholamreza Haffari

Modern statistical learning techniques have often emphasized prediction performance over interpretability, giving rise to "black box" models that may be difficult to understand, and to generalize to other settings. We conceptually divide a…

Methodology · Statistics 2019-09-16 Wenjia Wang , Yi-Hui Zhou

Most of the work on interpretable machine learning has focused on designing either inherently interpretable models, which typically trade-off accuracy for interpretability, or post-hoc explanation systems, whose explanation quality can be…

Machine Learning · Computer Science 2020-11-10 Gregory Plumb , Maruan Al-Shedivat , Angel Alexander Cabrera , Adam Perer , Eric Xing , Ameet Talwalkar

Interpreting a nonparametric regression model with many predictors is known to be a challenging problem. There has been renewed interest in this topic due to the extensive use of machine learning algorithms and the difficulty in…

Machine Learning · Statistics 2018-09-11 Xiaoyu Liu , Jie Chen , Joel Vaughan , Vijayan Nair , Agus Sudjianto

We propose using mechanistic interpretability -- techniques for reverse engineering model weights into human-interpretable algorithms -- to derive and compactly prove formal guarantees on model performance. We prototype this approach by…

Machine Learning · Computer Science 2024-12-25 Jason Gross , Rajashree Agrawal , Thomas Kwa , Euan Ong , Chun Hei Yip , Alex Gibson , Soufiane Noubir , Lawrence Chan

Interpretation of a machine learning induced models is critical for feature engineering, debugging, and, arguably, compliance. Yet, best of breed machine learning models tend to be very complex. This paper presents a method for model…

Machine Learning · Computer Science 2018-02-27 Noa Avigdor-Elgrabli , Alex Libov , Michael Viderman , Ran Wolff

SHAP is a popular method for measuring variable importance in machine learning models. In this paper, we study the algorithm used to estimate SHAP scores and outline its connection to the functional ANOVA decomposition. We use this…

Methodology · Statistics 2022-11-14 Andrew Herren , P. Richard Hahn

The interpretability of machine learning models has gained increasing attention, particularly in scientific domains where high precision and accountability are crucial. This research focuses on distinguishing between two critical data…

Machine Learning · Computer Science 2024-07-02 Jiajun Zhu , Siqi Miao , Rex Ying , Pan Li

Mechanistic interpretability aims to explain neural model behaviour by reverse-engineering learned computational structure into human-understandable components. Without a formal framework, however, mechanistic explanations cannot be…

Machine Learning · Computer Science 2026-05-12 Ward Gauderis , Thomas Dooms , Steven T. Holmer , Kola Ayonrinde , Geraint A. Wiggins

Transparency and explainability in image classification are essential for establishing trust in machine learning models and detecting biases and errors. State-of-the-art explainability methods generate saliency maps to show where a specific…

Machine Learning · Computer Science 2024-07-30 Matteo Bianchi , Antonio De Santis , Andrea Tocchetti , Marco Brambilla

Answering complex questions often requires multi-step reasoning in order to obtain the final answer. Most research into decompositions of complex questions involves open-domain systems, which have shown success in using these decompositions…

Computation and Language · Computer Science 2022-12-21 Kangda Wei , Dawn Lawrie , Benjamin Van Durme , Yunmo Chen , Orion Weller

Despite excellent performance of deep neural networks (DNNs) in image classification, detection, and prediction, characterizing how DNNs make a given decision remains an open problem, resulting in a number of interpretability methods.…

Machine Learning · Computer Science 2023-09-13 Lennart Brocki , Neo Christopher Chung

In order to trust the predictions of a machine learning algorithm, it is necessary to understand the factors that contribute to those predictions. In the case of probabilistic and uncertainty-aware models, it is necessary to understand not…

Machine Learning · Statistics 2024-08-19 Danny Wood , Theodore Papamarkou , Matt Benatan , Richard Allmendinger

This paper addresses the issue of building a part-based representation of a dataset of images. More precisely, we look for a non-negative, sparse decomposition of the images on a reduced set of atoms, in order to unveil a morphological and…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Bastien Ponchon , Santiago Velasco-Forero , Samy Blusseau , Jesus Angulo , Isabelle Bloch

Post-hoc explanation methods are an important class of approaches that help understand the rationale underlying a trained model's decision. But how useful are they for an end-user towards accomplishing a given task? In this vision paper, we…

Artificial Intelligence · Computer Science 2021-05-11 Maximilian Idahl , Lijun Lyu , Ujwal Gadiraju , Avishek Anand

Interpretable machine learning has become a very active area of research due to the rising popularity of machine learning algorithms and their inherently challenging interpretability. Most work in this area has been focused on the…

Machine Learning · Statistics 2023-11-09 Quay Au , Julia Herbinger , Clemens Stachl , Bernd Bischl , Giuseppe Casalicchio

With the ever-increasing complexity of neural language models, practitioners have turned to methods for understanding the predictions of these models. One of the most well-adopted approaches for model interpretability is feature-based…

Computation and Language · Computer Science 2021-06-10 Muhammad Bilal Zafar , Michele Donini , Dylan Slack , Cédric Archambeau , Sanjiv Das , Krishnaram Kenthapadi

We model the process of human full interpretation of object images, namely the ability to identify and localize all semantic features and parts that are recognized by human observers. The task is approached by dividing the interpretation of…

Computer Vision and Pattern Recognition · Computer Science 2018-02-02 Guy Ben-Yosef , Liav Assif , Shimon Ullman