English
Related papers

Related papers: Should Machine Learning Models Report to Us When T…

200 papers

Both humans and machine learning models learn from experience, particularly in safety- and reliability-critical domains. While psychology seeks to understand human cognition, the field of Explainable AI (XAI) develops methods to interpret…

Human-Computer Interaction · Computer Science 2025-11-25 Roussel Rahman , Aashwin Ananda Mishra , Wan-Lin Hu

Since Artificial Intelligence (AI) software uses techniques like deep lookahead search and stochastic optimization of huge neural networks to fit mammoth datasets, it often results in complex behavior that is difficult for people to…

Artificial Intelligence · Computer Science 2018-10-16 Daniel S. Weld , Gagan Bansal

Recent years have seen important advances in the quality of state-of-the-art models, but this has come at the expense of models becoming less interpretable. This survey presents an overview of the current state of Explainable AI (XAI),…

Computation and Language · Computer Science 2025-04-16 Marina Danilevsky , Kun Qian , Ranit Aharonov , Yannis Katsis , Ban Kawas , Prithviraj Sen

Explainable artificial intelligence (XAI) aims to help human decision-makers in understanding complex machine learning (ML) models. One of the hallmarks of XAI are measures of relative feature importance, which are theoretically justified…

Artificial Intelligence · Computer Science 2024-02-12 Joao Marques-Silva , Xuanxiang Huang

Growing concerns over the lack of transparency in AI, particularly in high-stakes fields like healthcare and finance, drive the need for explainable and trustworthy systems. While Large Language Models (LLMs) perform exceptionally well in…

Artificial Intelligence · Computer Science 2025-06-10 Fadi Al Machot , Martin Thomas Horsch , Habib Ullah

Deriving governing equations from empirical observations is a longstanding challenge in science. Although artificial intelligence (AI) has demonstrated substantial capabilities in function approximation, the discovery of explainable and…

Artificial Intelligence · Computer Science 2026-05-01 Gyoung S. Na , Chanyoung Park

Explainability has been a goal for Artificial Intelligence (AI) systems since their conception, with the need for explainability growing as more complex AI models are increasingly used in critical, high-stakes settings such as healthcare.…

Artificial Intelligence · Computer Science 2020-10-06 Shruthi Chari , Oshani Seneviratne , Daniel M. Gruen , Morgan A. Foreman , Amar K. Das , Deborah L. McGuinness

With artificial intelligence (AI) embedded in many everyday software systems, effectively and reliably developing and maintaining AI systems becomes an essential skill for software developers. However, the complexity inherent to AI poses…

Human-Computer Interaction · Computer Science 2025-04-22 Thomas Weber

Machine Learning has been a big success story during the AI resurgence. One particular stand out success relates to learning from a massive amount of data. In spite of early assertions of the unreasonable effectiveness of data, there is…

Artificial Intelligence · Computer Science 2017-07-19 Amit Sheth , Sujan Perera , Sanjaya Wijeratne , Krishnaprasad Thirunarayan

Machine learning systems, especially with overparameterized deep neural networks, can generalize to novel test instances drawn from the same distribution as the training data. However, they fare poorly when evaluated on out-of-support test…

Machine Learning · Computer Science 2023-04-28 Aviv Netanyahu , Abhishek Gupta , Max Simchowitz , Kaiqing Zhang , Pulkit Agrawal

Whether and how data scientists, statisticians and modellers should be accountable for the AI systems they develop remains a controversial and highly debated topic, especially given the complexity of AI systems and the difficulties in…

Artificial Intelligence · Computer Science 2023-09-12 Cassandra Bird , Daniel Williamson , Sabina Leonelli

Artificial intelligence (AI) has demonstrated strong potential in clinical diagnostics, often achieving accuracy comparable to or exceeding that of human experts. A key challenge, however, is that AI reasoning frequently diverges from…

Artificial Intelligence · Computer Science 2026-05-25 Belona Sonna , Alban Grastien

In this paper we argue that, to its detriment, transparency research overlooks many foundational concepts of artificial intelligence. As an illustrating example we focus on uncertainty quantification in the context of counterfactual…

Machine Learning · Computer Science 2026-05-19 Kacper Sokol , Santo M. A. R. Thies , Eyke Hüllermeier

A high-velocity paradigm shift towards Explainable Artificial Intelligence (XAI) has emerged in recent years. Highly complex Machine Learning (ML) models have flourished in many tasks of intelligence, and the questions have started to shift…

Machine Learning · Computer Science 2024-05-31 Jacob Dineen , Don Kridel , Daniel Dolk , David Castillo

In today's world, AI programs powered by Machine Learning are ubiquitous, and have achieved seemingly exceptional performance across a broad range of tasks, from medical diagnosis and credit rating in banking, to theft detection via video…

Machine Learning · Statistics 2024-12-02 Jérémie Sublime

The popularity of machine learning has increased the risk of unfair models getting deployed in high-stake applications, such as justice system, drug/vaccination design, and medical diagnosis. Although there are effective methods to train…

Machine Learning · Computer Science 2022-07-14 Mohit Bajaj , Lingyang Chu , Vittorio Romaniello , Gursimran Singh , Jian Pei , Zirui Zhou , Lanjun Wang , Yong Zhang

Recent reports claim that Large Language Models (LLMs) have achieved the ability to derive new science and exhibit human-level general intelligence. We argue that such claims are not rigorous scientific claims, as they do not satisfy…

Computers and Society · Computer Science 2026-02-11 Elchanan Mossel

Successful deep neural networks discover salient features of data. We show when and why they fail to learn out-of-distribution (OOD)-relevant representations from an in-distribution (ID) training window. This requires decoupling feature…

Machine Learning · Computer Science 2026-05-14 Leonel Aguilar , Jan Nagler , Christoph Hoelscher , Nino Antulov-Fantulin

Interest in the field of Explainable Artificial Intelligence has been growing for decades and has accelerated recently. As Artificial Intelligence models have become more complex, and often more opaque, with the incorporation of complex…

Artificial Intelligence · Computer Science 2020-03-18 Shruthi Chari , Daniel M. Gruen , Oshani Seneviratne , Deborah L. McGuinness

Explainable Artificial Intelligence (XAI) has experienced a significant growth over the last few years. This is due to the widespread application of machine learning, particularly deep learning, that has led to the development of highly…

Artificial Intelligence · Computer Science 2020-10-13 Giulia Vilone , Luca Longo