English
Related papers

Related papers: Individual Explanations in Machine Learning Models…

200 papers

The unprecedented performance of machine learning models in recent years, particularly Deep Learning and transformer models, has resulted in their application in various domains such as finance, healthcare, and education. However, the…

Human-Computer Interaction · Computer Science 2023-12-20 Milad Rogha

Many Machine Learning algorithms, such as deep neural networks, have long been criticized for being "black-boxes"-a kind of models unable to provide how it arrive at a decision without further efforts to interpret. This problem has raised…

Machine Learning · Statistics 2019-07-04 Yihuang Kang , I-Ling Cheng , Wenjui Mao , Bowen Kuo , Pei-Ju Lee

Interpretable classification models are built with the purpose of providing a comprehensible description of the decision logic to an external oversight agent. When considered in isolation, a decision tree, a set of classification rules, or…

Machine Learning · Computer Science 2019-03-18 Riccardo Guidotti , Salvatore Ruggieri

The landscape in the context of several signal processing applications and even education appears to be significantly affected by the emergence of machine learning (ML) and in particular deep learning (DL).The main reason for this is the…

Signal Processing · Electrical Eng. & Systems 2023-02-07 Manish Narwaria

As machine learning (ML) systems take a more prominent and central role in contributing to life-impacting decisions, ensuring their trustworthiness and accountability is of utmost importance. Explanations sit at the core of these desirable…

Machine Learning · Computer Science 2021-06-16 Sahil Verma , Aditya Lahiri , John P. Dickerson , Su-In Lee

Understanding the interpretation of machine learning (ML) models has been of paramount importance when making decisions with societal impacts such as transport control, financial activities, and medical diagnosis. While current model…

Human-Computer Interaction · Computer Science 2024-05-07 Jun Yuan , Gromit Yeuk-Yin Chan , Brian Barr , Kyle Overton , Kim Rees , Luis Gustavo Nonato , Enrico Bertini , Claudio T. Silva

A rich line of research attempts to make deep neural networks more transparent by generating human-interpretable 'explanations' of their decision process, especially for interactive tasks like Visual Question Answering (VQA). In this work,…

Artificial Intelligence · Computer Science 2018-10-31 Arjun Chandrasekaran , Viraj Prabhu , Deshraj Yadav , Prithvijit Chattopadhyay , Devi Parikh

Many statistical models have high accuracy on test benchmarks, but are not explainable, struggle in low-resource scenarios, cannot be reused for multiple tasks, and cannot easily integrate domain expertise. These factors limit their use,…

Computation and Language · Computer Science 2021-09-29 Andrew Lee , Jonathan K. Kummerfeld , Lawrence C. An , Rada Mihalcea

Deep neural networks (DNNs) are known as black-box models. In other words, it is difficult to interpret the internal state of the model. Improving the interpretability of DNNs is one of the hot research topics. However, at present, the…

Machine Learning · Computer Science 2019-09-17 Masanari Kimura , Masayuki Tanaka

To plan safe maneuvers and act with foresight, autonomous vehicles must be capable of accurately predicting the uncertain future. In the context of autonomous driving, deep neural networks have been successfully applied to learning…

Robotics · Computer Science 2022-08-02 Salar Arbabi , Davide Tavernini , Saber Fallah , Richard Bowden

The challenge of creating interpretable models has been taken up by two main research communities: ML researchers primarily focused on lower-level explainability methods that suit the needs of engineers, and HCI researchers who have more…

Machine Learning · Computer Science 2024-07-16 Juan D. Pinto , Luc Paquette

As the use of machine learning (ML) models in product development and data-driven decision-making processes became pervasive in many domains, people's focus on building a well-performing model has increasingly shifted to understanding how…

Human-Computer Interaction · Computer Science 2020-06-02 Sungsoo Ray Hong , Jessica Hullman , Enrico Bertini

An increasing number of machine learning models have been deployed in domains with high stakes such as finance and healthcare. Despite their superior performances, many models are black boxes in nature which are hard to explain. There are…

Machine Learning · Computer Science 2022-04-01 Shivani Choudhary , Niladri Chatterjee , Subir Kumar Saha

Language Models (LMs) have significantly advanced natural language processing and enabled remarkable progress across diverse domains, yet their black-box nature raises critical concerns about the interpretability of their internal…

Computation and Language · Computer Science 2025-09-29 Avash Palikhe , Zichong Wang , Zhipeng Yin , Rui Guo , Qiang Duan , Jie Yang , Wenbin Zhang

Through extensive experience developing and explaining machine learning (ML) applications for real-world domains, we have learned that ML models are only as interpretable as their features. Even simple, highly interpretable model types such…

Machine Learning · Computer Science 2022-02-25 Alexandra Zytek , Ignacio Arnaldo , Dongyu Liu , Laure Berti-Equille , Kalyan Veeramachaneni

Explainable artificial intelligence (XAI) is a set of tools and algorithms that applied or embedded to machine learning models to understand and interpret the models. They are recommended especially for complex or advanced models including…

Machine Learning · Computer Science 2024-07-18 Ahmed M Salih , Yuhe Wang

Deep learning is becoming increasingly adopted in business and industry due to its ability to transform large quantities of data into high-performing models. These models, however, are generally regarded as black boxes, which, in spite of…

Machine Learning · Computer Science 2023-02-21 Stefan Druc , Peter Wooldridge , Adarsh Krishnamurthy , Soumik Sarkar , Aditya Balu

In this review, we examine the problem of designing interpretable and explainable machine learning models. Interpretability and explainability lie at the core of many machine learning and statistical applications in medicine, economics,…

Machine Learning · Computer Science 2023-03-02 Ričards Marcinkevičs , Julia E. Vogt

Black box models in machine learning have demonstrated excellent predictive performance in complex problems and high-dimensional settings. However, their lack of transparency and interpretability restrict the applicability of such models in…

Machine Learning · Computer Science 2020-06-09 Numair Sani , Jaron Lee , Razieh Nabi , Ilya Shpitser

Ensuring fairness of machine learning systems is a human-in-the-loop process. It relies on developers, users, and the general public to identify fairness problems and make improvements. To facilitate the process we need effective, unbiased,…

Human-Computer Interaction · Computer Science 2019-01-24 Jonathan Dodge , Q. Vera Liao , Yunfeng Zhang , Rachel K. E. Bellamy , Casey Dugan