English
Related papers

Related papers: Explaining Predictions from Machine Learning Model…

200 papers

Explainability is needed to establish confidence in machine learning results. Some explainable methods take a post hoc approach to explain the weights of machine learning models, others highlight areas of the input contributing to…

Machine Learning · Computer Science 2024-07-15 Paul Whitten , Francis Wolff , Chris Papachristou

Large language models (LLMs) have demonstrated impressive capabilities in natural language processing. However, their internal mechanisms are still unclear and this lack of transparency poses unwanted risks for downstream applications.…

Computation and Language · Computer Science 2023-11-30 Haiyan Zhao , Hanjie Chen , Fan Yang , Ninghao Liu , Huiqi Deng , Hengyi Cai , Shuaiqiang Wang , Dawei Yin , Mengnan Du

While the uptake of data-driven approaches for materials science and chemistry is at an exciting, early stage, to realise the true potential of machine learning models for successful scientific discovery, they must have qualities beyond…

Materials Science · Physics 2022-06-28 Felipe Oviedo , Juan Lavista Ferres , Tonio Buonassisi , Keith Butler

Large language models have exhibited impressive performance across a broad range of downstream tasks in natural language processing. However, how a language model predicts the next token and generates content is not generally understandable…

Translating machine learning (ML) models effectively to clinical practice requires establishing clinicians' trust. Explainability, or the ability of an ML model to justify its outcomes and assist clinicians in rationalizing the model…

Machine Learning · Computer Science 2019-08-08 Sana Tonekaboni , Shalmali Joshi , Melissa D McCradden , Anna Goldenberg

Machine learning (ML) in general and deep learning (DL) in particular has become an extremely popular tool in several vision applications (like object detection, super resolution, segmentation, object tracking etc.). Almost in parallel, the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Manish Narwaria

Explainability is motivated by the lack of transparency of black-box Machine Learning approaches, which do not foster trust and acceptance of Machine Learning algorithms. This also happens in the Predictive Process Monitoring field, where…

Artificial Intelligence · Computer Science 2025-07-25 Williams Rizzi , Marco Comuzzi , Chiara Di Francescomarino , Chiara Ghidini , Suhwan Lee , Fabrizio Maria Maggi , Alexander Nolte

Artificial Intelligence (AI) increasingly shows its potential to outperform predicate logic algorithms and human control alike. In automatically deriving a system model, AI algorithms learn relations in data that are not detectable for…

Artificial Intelligence · Computer Science 2022-10-12 Simon Daniel Duque Anton , Daniel Schneider , Hans Dieter Schotten

Interpretability provides a means for humans to verify aspects of machine learning (ML) models and empower human+ML teaming in situations where the task cannot be fully automated. Different contexts require explanations with different…

Machine Learning · Computer Science 2024-07-15 Zixi Chen , Varshini Subhash , Marton Havasi , Weiwei Pan , Finale Doshi-Velez

Machine learning algorithms can now outperform classic economic models in predicting quantities ranging from bargaining outcomes, to choice under uncertainty, to an individual's future jobs and wages. Yet this predictive accuracy comes at a…

Theoretical Economics · Economics 2025-08-27 Annie Liang

Predictions obtained by, e.g., artificial neural networks have a high accuracy but humans often perceive the models as black boxes. Insights about the decision making are mostly opaque for humans. Particularly understanding the decision…

Machine Learning · Computer Science 2021-01-21 Nadia Burkart , Marco F. Huber

A hallmark property of explainable AI models is the ability to teach other agents, communicating knowledge of how to perform a task. While Large Language Models perform complex reasoning by generating explanations for their predictions, it…

Computation and Language · Computer Science 2023-11-15 Swarnadeep Saha , Peter Hase , Mohit Bansal

As machine learning algorithms getting adopted in an ever-increasing number of applications, interpretation has emerged as a crucial desideratum. In this paper, we propose a mathematical definition for the human-interpretable model. In…

Machine Learning · Computer Science 2021-06-01 Weishen Pan , Changshui Zhang

Interpretability in machine learning (ML) is crucial for high stakes decisions and troubleshooting. In this work, we provide fundamental principles for interpretable ML, and dispel common misunderstandings that dilute the importance of this…

Machine Learning · Computer Science 2021-09-02 Cynthia Rudin , Chaofan Chen , Zhi Chen , Haiyang Huang , Lesia Semenova , Chudi Zhong

Artificial Intelligence models are becoming increasingly more powerful and accurate, supporting or even replacing humans' decision making. But with increased power and accuracy also comes higher complexity, making it hard for users to…

Artificial Intelligence · Computer Science 2019-07-10 Vivian S. Silva , André Freitas , Siegfried Handschuh

The rapid integration of artificial intelligence (AI) into various industries has introduced new challenges in governance and regulation, particularly regarding the understanding of complex AI systems. A critical demand from decision-makers…

Machine Learning · Computer Science 2024-11-08 Cristian Munoz , Kleyton da Costa , Bernardo Modenesi , Adriano Koshiyama

Most recent work on interpretability of complex machine learning models has focused on estimating $\textit{a posteriori}$ explanations for previously trained models around specific predictions. $\textit{Self-explaining}$ models where…

Machine Learning · Computer Science 2018-12-05 David Alvarez-Melis , Tommi S. Jaakkola

This paper presents a comprehensive theoretical investigation into the parameterized complexity of explanation problems in various machine learning (ML) models. Contrary to the prevalent black-box perception, our study focuses on models…

Artificial Intelligence · Computer Science 2024-07-23 Sebastian Ordyniak , Giacomo Paesani , Mateusz Rychlicki , Stefan Szeider

Artificial intelligence and machine learning algorithms have become ubiquitous. Although they offer a wide range of benefits, their adoption in decision-critical fields is limited by their lack of interpretability, particularly with textual…

Machine Learning · Computer Science 2023-01-27 Diego Antognini

The relevance of machine learning (ML) in our daily lives is closely intertwined with its explainability. Explainability can allow end-users to have a transparent and humane reckoning of a ML scheme's capability and utility. It will also…

Machine Learning · Computer Science 2022-12-27 Payel Sadhukhan , Sarbani palit , Kausik Sengupta