English
Related papers

Related papers: Comparing Feature Importance and Rule Extraction f…

200 papers

The impressive performance of neural networks on natural language processing tasks attributes to their ability to model complicated word and phrase compositions. To explain how the model handles semantic compositions, we study hierarchical…

Computation and Language · Computer Science 2020-06-16 Xisen Jin , Zhongyu Wei , Junyi Du , Xiangyang Xue , Xiang Ren

Deep learning methods have become very popular for the processing of natural images, and were then successfully adapted to the neuroimaging field. As these methods are non-transparent, interpretability methods are needed to validate them…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Elina Thibeau-Sutre , Sasha Collin , Ninon Burgos , Olivier Colliot

Interpretability research aims to bridge the gap between empirical success and our scientific understanding of the inner workings of large language models (LLMs). However, most existing research focuses on analyzing a single mechanism, such…

Computation and Language · Computer Science 2024-06-10 Francesco Ortu , Zhijing Jin , Diego Doimo , Mrinmaya Sachan , Alberto Cazzaniga , Bernhard Schölkopf

In the age of music streaming platforms, the task of automatically tagging music audio has garnered significant attention, driving researchers to devise methods aimed at enhancing performance metrics on standard datasets. Most recent…

Sound · Computer Science 2024-02-26 Vassilis Lyberatos , Spyridon Kantarelis , Edmund Dervakos , Giorgos Stamou

This paper aims to catalyze the discussions about text feature extraction techniques using neural network architectures. The research questions discussed in the paper focus on the state-of-the-art neural network techniques that have proven…

Computation and Language · Computer Science 2017-04-28 Vineet John

We provide a novel notion of what it means to be interpretable, looking past the usual association with human understanding. Our key insight is that interpretability is not an absolute concept and so we define it relative to a target model,…

Artificial Intelligence · Computer Science 2017-07-14 Amit Dhurandhar , Vijay Iyengar , Ronny Luss , Karthikeyan Shanmugam

Information retrieval models have witnessed a paradigm shift from unsupervised statistical approaches to feature-based supervised approaches to completely data-driven ones that make use of the pre-training of large language models. While…

Information Retrieval · Computer Science 2024-03-05 Saran Pandian , Debasis Ganguly , Sean MacAvaney

As machine learning models increasingly impact society, their opaque nature poses challenges to trust and accountability, particularly in fairness contexts. Understanding how individual features influence model outcomes is crucial for…

Machine Learning · Computer Science 2026-02-11 Camille Little , Madeline Navarro , Santiago Segarra , Genevera Allen

The explainability of machine learning algorithms is crucial, and numerous methods have emerged recently. Local, post-hoc methods assign an attribution score to each feature, indicating its importance for the prediction. However, these…

Machine Learning · Computer Science 2024-08-12 Giorgio Visani , Vincenzo Stanzione , Damien Garreau

Recent advances in interpretable Machine Learning (iML) and eXplainable AI (XAI) construct explanations based on the importance of features in classification tasks. However, in a high-dimensional feature space this approach may become…

Machine Learning · Statistics 2018-06-21 Jasper van der Waa , Marcel Robeer , Jurriaan van Diggelen , Matthieu Brinkhuis , Mark Neerincx

Training data influence estimation methods quantify the contribution of training documents to a model's output, making them a promising source of information for example-based explanations. As humans cannot interpret thousands of documents,…

Computation and Language · Computer Science 2026-04-10 Loris Schoenegger , Benjamin Roth

In this paper we apply the previously introduced approximation method based on the ANOVA (analysis of variance) decomposition and Grouped Transformations to synthetic and real data. The advantage of this method is the interpretability of…

Machine Learning · Statistics 2022-01-31 Daniel Potts , Michael Schmischke

Interpretability has arisen as a key desideratum of machine learning models alongside performance. Approaches so far have been primarily concerned with fixed dimensional inputs emphasizing feature relevance or selection. In contrast, we…

Machine Learning · Computer Science 2018-07-03 Guang-He Lee , David Alvarez-Melis , Tommi S. Jaakkola

Feature importance is commonly used to explain machine predictions. While feature importance can be derived from a machine learning model with a variety of methods, the consistency of feature importance via different methods remains…

Computation and Language · Computer Science 2019-10-21 Vivian Lai , Jon Z. Cai , Chenhao Tan

Machine-learning models have demonstrated great success in learning complex patterns that enable them to make predictions about unobserved data. In addition to using models for prediction, the ability to interpret what a model has learned…

Machine Learning · Statistics 2019-11-15 W. James Murdoch , Chandan Singh , Karl Kumbier , Reza Abbasi-Asl , Bin Yu

As complex machine learning models continue to find applications in high-stakes decision-making scenarios, it is crucial that we can explain and understand their predictions. Post-hoc explanation methods provide useful insights by…

Machine Learning · Statistics 2024-10-16 Beepul Bharti , Paul Yi , Jeremias Sulam

Automated decision-making systems are becoming increasingly ubiquitous, which creates an immediate need for their interpretability and explainability. However, it remains unclear whether users know what insights an explanation offers and,…

Human-Computer Interaction · Computer Science 2024-09-27 Yueqing Xuan , Edward Small , Kacper Sokol , Danula Hettiachchi , Mark Sanderson

Advanced machine learning models have recently achieved high predictive accuracy for weather and climate prediction. However, these complex models often lack inherent transparency and interpretability, acting as "black boxes" that impede…

Atmospheric and Oceanic Physics · Physics 2024-03-29 Ruyi Yang , Jingyu Hu , Zihao Li , Jianli Mu , Tingzhao Yu , Jiangjiang Xia , Xuhong Li , Aritra Dasgupta , Haoyi Xiong

Explainability has become a valuable tool in the last few years, helping humans better understand AI-guided decisions. However, the classic explainability tools are sometimes quite limited when considering high-dimensional inputs and neural…

Machine Learning · Computer Science 2023-11-23 Odelia Melamed , Rich Caruana

To date, there has been no formal study of the statistical cost of interpretability in machine learning. As such, the discourse around potential trade-offs is often informal and misconceptions abound. In this work, we aim to initiate a…

Machine Learning · Computer Science 2020-10-29 Gintare Karolina Dziugaite , Shai Ben-David , Daniel M. Roy