English
Related papers

Related papers: Should Machine Learning Models Report to Us When T…

200 papers

Explainability is a critical factor in enhancing the trustworthiness and acceptance of artificial intelligence (AI) in healthcare, where decisions directly impact patient outcomes. Despite advancements in AI interpretability, clear…

Artificial Intelligence · Computer Science 2025-05-15 Michail Mamalakis , Héloïse de Vareilles , Graham Murray , Pietro Lio , John Suckling

The increasing number of regulations and expectations of predictive machine learning models, such as so called right to explanation, has led to a large number of methods promising greater interpretability. High demand has led to a…

In recent years, Artificial Intelligence technology has excelled in various applications across all domains and fields. However, the various algorithms in neural networks make it difficult to understand the reasons behind decisions. For…

Artificial Intelligence · Computer Science 2025-05-13 Bowen Long , Enjie Liu , Renxi Qiu , Yanqing Duan

Artificial Intelligence (AI) provides many opportunities to improve private and public life. Discovering patterns and structures in large troves of data in an automated manner is a core component of data science, and currently drives…

Artificial Intelligence · Computer Science 2019-10-11 Vaishak Belle

eXplainable AI focuses on generating explanations for the output of an AI algorithm to a user, usually a decision-maker. Such user needs to interpret the AI system in order to decide whether to trust the machine outcome. When addressing…

Human-Computer Interaction · Computer Science 2020-05-28 Irene Celino

Knowing more about the data used to build AI systems is critical for allowing different stakeholders to play their part in ensuring responsible and appropriate deployment and use. Meanwhile, a 2023 report shows that data transparency lags…

Computers and Society · Computer Science 2024-09-06 Sophia Worth , Ben Snaith , Arunav Das , Gefion Thuermer , Elena Simperl

Explainable Artificial Intelligence (XAI) methods help to understand the internal mechanism of machine learning models and how they reach a specific decision or made a specific action. The list of informative features is one of the most…

Artificial Intelligence · Computer Science 2024-06-18 Ahmed M Salih

With machine learning models being increasingly used to aid decision making even in high-stakes domains, there has been a growing interest in developing interpretable models. Although many supposedly interpretable models have been proposed,…

Artificial Intelligence · Computer Science 2021-08-17 Forough Poursabzi-Sangdeh , Daniel G. Goldstein , Jake M. Hofman , Jennifer Wortman Vaughan , Hanna Wallach

Artificial Intelligence (AI) has continued to achieve tremendous success in recent times. However, the decision logic of these frameworks is often not transparent, making it difficult for stakeholders to understand, interpret or explain…

Machine Learning · Computer Science 2025-01-20 Fuseini Mumuni , Alhassan Mumuni

In human-AI interactions, explanation is widely seen as necessary for enabling trust in AI systems. We argue that trust, however, may be a pre-requisite because explanation is sometimes impossible. We derive this result from a formalization…

Artificial Intelligence · Computer Science 2025-03-03 Nghi Truong , Phanish Puranam , Ilia Testlin

Explainable machine learning offers the potential to provide stakeholders with insights into model behavior by using various methods such as feature importance scores, counterfactual explanations, or influential training data. Yet there is…

Artificial intelligence (AI) applications in healthcare and medicine have increased in recent years. To enable access to personal data, Trusted Research environments (TREs) provide safe and secure environments in which researchers can…

Cryptography and Security · Computer Science 2022-08-23 Esma Mansouri-Benssassi , Simon Rogers , Jim Smith , Felix Ritchie , Emily Jefferson

Supervised machine learning models boast remarkable predictive capabilities. But can you trust your model? Will it work in deployment? What else can it tell you about the world? We want models to be not only good, but interpretable. And yet…

Machine Learning · Computer Science 2017-03-07 Zachary C. Lipton

Explaining black-box Artificial Intelligence (AI) models is a cornerstone for trustworthy AI and a prerequisite for its use in safety critical applications such that AI models can reliably assist humans in critical decisions. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Poulami Sinhamahapatra , Lena Heidemann , Maureen Monnet , Karsten Roscher

Explainable AI (XAI) research has been booming, but the question "$\textbf{To whom}$ are we making AI explainable?" is yet to gain sufficient attention. Not much of XAI is comprehensible to non-AI experts, who nonetheless, are the primary…

Human-Computer Interaction · Computer Science 2021-12-03 Helen Jiang , Erwen Senge

Artificial Intelligence (AI) is becoming the corner stone of many systems used in our daily lives such as autonomous vehicles, healthcare systems, and unmanned aircraft systems. Machine Learning is a field of AI that enables systems to…

Artificial Intelligence · Computer Science 2022-06-27 Lionel Nganyewou Tidjon , Foutse Khomh

The lack of explainability of Artificial Intelligence (AI) is one of the first obstacles that the industry and regulators must overcome to mitigate the risks associated with the technology. The need for eXplainable AI (XAI) is evident in…

Computers and Society · Computer Science 2025-02-24 Georgios Pavlidis

Artificial intelligence models encounter significant challenges due to their black-box nature, particularly in safety-critical domains such as healthcare, finance, and autonomous vehicles. Explainable Artificial Intelligence (XAI) addresses…

Artificial Intelligence · Computer Science 2025-03-14 Melkamu Mersha , Khang Lam , Joseph Wood , Ali AlShami , Jugal Kalita

Is explainability a false promise? This debate has emerged from the insufficient evidence that explanations help people in situations they are introduced for. More human-centered, application-grounded evaluations of explanations are needed…

Computation and Language · Computer Science 2024-11-06 Fateme Hashemi Chaleshtori , Atreya Ghosal , Alexander Gill , Purbid Bambroo , Ana Marasović

Explainable machine learning (ML) enables human learning from ML, human appeal of automated model decisions, regulatory compliance, and security audits of ML models. Explainable ML (i.e. explainable artificial intelligence or XAI) has been…

Machine Learning · Statistics 2019-12-03 Patrick Hall , Navdeep Gill , Nicholas Schmidt