English
Related papers

Related papers: Have We Learned to Explain?: How Interpretability …

200 papers

Modern applications require methods that are computationally feasible on large datasets but also preserve statistical efficiency. Frequently, these two concerns are seen as contradictory: approximation methods that enable computation are…

Methodology · Statistics 2021-06-11 Darren Homrighausen , Daniel J. McDonald

Model explanations can be valuable for interpreting and debugging predictive models. We study a specific kind called Concept Explanations, where the goal is to interpret a model using human-understandable concepts. Although popular for…

Machine Learning · Computer Science 2024-04-08 Vihari Piratla , Juyeon Heo , Katherine M. Collins , Sukriti Singh , Adrian Weller

Complex black-box predictive models may have high accuracy, but opacity causes problems like lack of trust, lack of stability, sensitivity to concept drift. On the other hand, interpretable models require more work related to feature…

Machine Learning · Computer Science 2019-03-01 Alicja Gosiewska , Aleksandra Gacek , Piotr Lubon , Przemyslaw Biecek

Interpretability has arisen as a key desideratum of machine learning models alongside performance. Approaches so far have been primarily concerned with fixed dimensional inputs emphasizing feature relevance or selection. In contrast, we…

Machine Learning · Computer Science 2018-07-03 Guang-He Lee , David Alvarez-Melis , Tommi S. Jaakkola

Concept-based explanation methods aim at making machine learning models more transparent by finding the most important semantic features of an input (e.g., colors, patterns, shapes) for a given prediction task. However, these methods…

Machine Learning · Computer Science 2025-10-02 Jacopo Teneggi , Zhenzhen Wang , Paul H. Yi , Tianmin Shu , Jeremias Sulam

Balancing predictive power and interpretability has long been a challenging research area, particularly in powerful yet complex models like neural networks, where nonlinearity obstructs direct interpretation. This paper introduces a novel…

Machine Learning · Computer Science 2025-02-20 Antoine Ledent , Peng Liu

This paper proposes a new framework for learning a rule ensemble model that is both accurate and interpretable. A rule ensemble is an interpretable model based on the linear combination of weighted rules. In practice, we often face the…

Machine Learning · Computer Science 2023-06-21 Kentaro Kanamori

Effectiveness and interpretability are two essential properties for trustworthy AI systems. Most recent studies in visual reasoning are dedicated to improving the accuracy of predicted answers, and less attention is paid to explaining the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Shi Chen , Qi Zhao

Recent advancements in machine learning have emphasized the need for transparency in model predictions, particularly as interpretability diminishes when using increasingly complex architectures. In this paper, we propose leveraging…

Machine Learning · Computer Science 2025-07-18 Chenrui Zhu , Louenas Bounia , Vu Linh Nguyen , Sébastien Destercke , Arthur Hoarau

The rapid evolution of machine learning (ML) has led to the widespread adoption of complex "black box" models, such as deep neural networks and ensemble methods. These models exhibit exceptional predictive performance, making them…

Machine Learning · Computer Science 2025-03-28 Moncef Garouani , Josiane Mothe , Ayah Barhrhouj , Julien Aligon

Interpretable representations are the backbone of many explainers that target black-box predictive systems based on artificial intelligence and machine learning algorithms. They translate the low-level data representation necessary for good…

Machine Learning · Computer Science 2024-04-29 Kacper Sokol , Peter Flach

With the blooming of various Pre-trained Language Models (PLMs), Machine Reading Comprehension (MRC) has embraced significant improvements on various benchmarks and even surpass human performances. However, the existing works only target on…

Computation and Language · Computer Science 2020-11-16 Yiming Cui , Ting Liu , Shijin Wang , Guoping Hu

The field of machine learning is subject to an increasing interest in models that are not only accurate but also interpretable and robust, thus allowing their end users to understand and trust AI systems. This paper presents a novel method…

Machine Learning · Computer Science 2026-04-24 Valentin Lemaire , Gaël Aglin , Siegfried Nijssen

Although deep language representations have become the dominant form of language featurization in recent years, in many settings it is important to understand a model's decision-making process. This necessitates not only an interpretable…

Computation and Language · Computer Science 2023-06-05 Victoria Lin , Louis-Philippe Morency

Real-world data is frequently noisy and ambiguous. In crowdsourcing, for example, human annotators may assign conflicting class labels to the same instances. Partial-label learning (PLL) addresses this challenge by training classifiers when…

Machine Learning · Computer Science 2026-01-12 Tobias Fuchs , Nadja Klein

Rule-based models, e.g., decision trees, are widely used in scenarios demanding high model interpretability for their transparent inner structures and good model expressivity. However, rule-based models are hard to optimize, especially on…

Machine Learning · Computer Science 2024-01-31 Zhuo Wang , Wei Zhang , Ning Liu , Jianyong Wang

To learn about real world phenomena, scientists have traditionally used models with clearly interpretable elements. However, modern machine learning (ML) models, while powerful predictors, lack this direct elementwise interpretability (e.g.…

Machine Learning · Statistics 2024-07-16 Timo Freiesleben , Gunnar König , Christoph Molnar , Alvaro Tejero-Cantero

Users in many domains use machine learning (ML) predictions to help them make decisions. Effective ML-based decision-making often requires explanations of ML models and their predictions. While there are many algorithms that explain models,…

Machine Learning · Computer Science 2023-12-21 Alexandra Zytek , Wei-En Wang , Dongyu Liu , Laure Berti-Equille , Kalyan Veeramachaneni

In modern data science, it is often not enough to obtain only a data-driven model with a good prediction quality. On the contrary, it is more interesting to understand the properties of the model, which parts could be replaced to obtain…

Neural and Evolutionary Computing · Computer Science 2021-07-09 Alexander Hvatov , Mikhail Maslyaev , Iana S. Polonskaya , Mikhail Sarafanov , Mark Merezhnikov , Nikolay O. Nikitin

Decisions in organizations are about evaluating alternatives and choosing the one that would best serve organizational goals. To the extent that the evaluation of alternatives could be formulated as a predictive task with appropriate…

Human-Computer Interaction · Computer Science 2022-06-30 Charles Wan , Rodrigo Belo , Leid Zejnilović