English
Related papers

Related papers: Pyreal: A Framework for Interpretable ML Explanati…

200 papers

While recent advancements in Neural Ranking Models have resulted in significant improvements over traditional statistical retrieval models, it is generally acknowledged that the use of large neural architectures and the application of…

Information Retrieval · Computer Science 2025-05-13 Sourav Saha , Harsh Agarwal , V Venktesh , Avishek Anand , Swastik Mohanty , Debapriyo Majumdar , Mandar Mitra

The lack of interpretability and transparency are preventing economists from using advanced tools like neural networks in their empirical research. In this paper, we propose a class of interpretable neural network models that can achieve…

Econometrics · Economics 2020-12-01 Yucheng Yang , Zhong Zheng , Weinan E

Evaluation has always been a key challenge in the development of artificial intelligence (AI) based software, due to the technical complexity of the software artifact and, often, its embedding in complex sociotechnical processes. Recent…

Computers and Society · Computer Science 2018-10-23 Alun Preece , Rob Ashelford , Harry Armstrong , Dave Braines

We present a brief history of the field of interpretable machine learning (IML), give an overview of state-of-the-art interpretation methods, and discuss challenges. Research in IML has boomed in recent years. As young as the field is, it…

Machine Learning · Statistics 2022-01-24 Christoph Molnar , Giuseppe Casalicchio , Bernd Bischl

Decisions by Machine Learning (ML) models have become ubiquitous. Trusting these decisions requires understanding how algorithms take them. Hence interpretability methods for ML are an active focus of research. A central problem in this…

Machine Learning · Computer Science 2019-01-25 Philipp Schmidt , Felix Biessmann

Although deep models achieve high predictive performance, it is difficult for humans to understand the predictions they made. Explainability is important for real-world applications to justify their reliability. Many example-based…

Machine Learning · Statistics 2021-12-08 Tomoharu Iwata , Yuya Yoshikawa

Explainable recommender systems are designed to elucidate the explanation behind each recommendation, enabling users to comprehend the underlying logic. Previous works perform rating prediction and explanation generation in a multi-task…

Information Retrieval · Computer Science 2025-04-09 Shijie Liu , Ruixing Ding , Weihai Lu , Jun Wang , Mo Yu , Xiaoming Shi , Wei Zhang

Machine learning methods are being increasingly applied in sensitive societal contexts, where decisions impact human lives. Hence it has become necessary to build capabilities for providing easily-interpretable explanations of models'…

Machine Learning · Computer Science 2021-04-13 Alfredo Carrillo , Luis F. Cantú , Luis Tejerina , Alejandro Noriega

In artificial intelligence (AI), the complexity of many models and processes surpasses human understanding, making it challenging to determine why a specific prediction is made. This lack of transparency is particularly problematic in…

Machine Learning · Statistics 2025-06-30 Alexandra Stadler , Werner G. Müller , Radoslav Harman

Predictive Process Monitoring (PPM) often uses deep learning models to predict the future behavior of ongoing processes, such as predicting process outcomes. While these models achieve high accuracy, their lack of interpretability…

Artificial Intelligence · Computer Science 2025-06-23 Soobin Chae , Suhwan Lee , Hanna Hauptmann , Hajo A. Reijers , Xixi Lu

Machine learning (ML) is successful in achieving human-level performance in various fields. However, it lacks the ability to explain an outcome due to its black-box nature. While existing explainable ML is promising, almost all of these…

Machine Learning · Computer Science 2021-03-23 Zhixin Pan , Prabhat Mishra

This paper contributes with a pragmatic evaluation framework for explainable Machine Learning (ML) models for clinical decision support. The study revealed a more nuanced role for ML explanation models, when these are pragmatically embedded…

Artificial Intelligence · Computer Science 2022-12-22 Oskar Wysocki , Jessica Katharine Davies , Markel Vigo , Anne Caroline Armstrong , Dónal Landers , Rebecca Lee , André Freitas

Time series forecasting enables early warning and has driven asset performance management from traditional planned maintenance to predictive maintenance. However, the lack of interpretability in forecasting methods undermines users' trust…

Machine Learning · Computer Science 2026-03-04 Bo Liu , Shao-Bo Lin , Changmiao Wang , Xiaotong Liu

While the need for interpretable machine learning has been established, many common approaches are slow, lack fidelity, or hard to evaluate. Amortized explanation methods reduce the cost of providing interpretations by learning a global…

Machine Learning · Statistics 2021-03-03 Neil Jethani , Mukund Sudarshan , Yindalon Aphinyanaphongs , Rajesh Ranganath

In machine learning (ML), it is in general challenging to provide a detailed explanation on how a trained model arrives at its prediction. Thus, usually we are left with a black-box, which from a scientific standpoint is not satisfactory.…

Materials Science · Physics 2021-04-22 Luca M. Ghiringhelli

Machine learning is used more and more often for sensitive applications, sometimes replacing humans in critical decision-making processes. As such, interpretability of these algorithms is a pressing need. One popular algorithm to provide…

Machine Learning · Computer Science 2020-01-14 Damien Garreau , Ulrike von Luxburg

We often desire our models to be interpretable as well as accurate. Prior work on optimizing models for interpretability has relied on easy-to-quantify proxies for interpretability, such as sparsity or the number of operations required. In…

Machine Learning · Statistics 2018-11-01 Isaac Lage , Andrew Slavin Ross , Been Kim , Samuel J. Gershman , Finale Doshi-Velez

Algorithmic approaches to interpreting machine learning models have proliferated in recent years. We carry out human subject tests that are the first of their kind to isolate the effect of algorithmic explanations on a key aspect of model…

Computation and Language · Computer Science 2020-05-06 Peter Hase , Mohit Bansal

Explainability in AI is gaining attention in the computer science community in response to the increasing success of deep learning and the important need of justifying how such systems make predictions in life-critical applications. The…

Artificial Intelligence · Computer Science 2020-03-03 David Tuckey , Alessandra Russo , Krysia Broda

In this paper I argue that the search for explainable models and interpretable decisions in AI must be reformulated in terms of the broader project of offering a pragmatic and naturalistic account of understanding in AI. Intuitively, the…

Artificial Intelligence · Computer Science 2020-06-23 Andrés Páez