English
Related papers

Related papers: Unexplainability of Artificial Intelligence Judgme…

200 papers

The integration of artificial intelligence (AI) technologies into judicial decision-making, particularly in pretrial, sentencing, and parole contexts, has generated substantial concerns about transparency, reliability, and accountability.…

Artificial Intelligence · Computer Science 2026-04-15 Arthur Dyevre , Ahmad Shahvaroughi

The current literature on AI-advised decision making -- involving explainable AI systems advising human decision makers -- presents a series of inconclusive and confounding results. To synthesize these findings, we propose a simple theory…

Artificial Intelligence · Computer Science 2024-02-05 Raymond Fok , Daniel S. Weld

Explanation mechanisms from the field of Counterfactual Thinking are a widely-used paradigm for Explainable Artificial Intelligence (XAI), as they follow a natural way of reasoning that humans are familiar with. However, all common…

Artificial Intelligence · Computer Science 2022-07-20 Silvan Mertes , Christina Karle , Tobias Huber , Katharina Weitz , Ruben Schlagowski , Elisabeth André

Artificial intelligence (AI) has revolutionized decision-making processes and systems throughout society and, in particular, has emerged as a significant technology in high-impact scenarios of national interest. Yet, despite AI's impressive…

Machine Learning · Statistics 2024-08-05 Gregory Canal , Vladimir Leung , Philip Sage , Eric Heim , I-Jeng Wang

As machine learning and algorithmic decision making systems are increasingly being leveraged in high-stakes human-in-the-loop settings, there is a pressing need to understand the rationale of their predictions. Researchers have responded to…

Machine Learning · Computer Science 2020-12-07 Jonathan Dinu , Jeffrey Bigham , J. Zico Kolter

Data-driven decision-making consequential to individuals raises important questions of accountability and justice. Indeed, European law provides individuals limited rights to 'meaningful information about the logic' behind significant,…

Human-Computer Interaction · Computer Science 2018-02-01 Reuben Binns , Max Van Kleek , Michael Veale , Ulrik Lyngs , Jun Zhao , Nigel Shadbolt

In human-AI interactions, explanation is widely seen as necessary for enabling trust in AI systems. We argue that trust, however, may be a pre-requisite because explanation is sometimes impossible. We derive this result from a formalization…

Artificial Intelligence · Computer Science 2025-03-03 Nghi Truong , Phanish Puranam , Ilia Testlin

Explainable AI provides insight into the "why" for model predictions, offering potential for users to better understand and trust a model, and to recognize and correct AI predictions that are incorrect. Prior research on human and…

Machine Learning · Computer Science 2020-06-22 Yasmeen Alufaisan , Laura R. Marusich , Jonathan Z. Bakdash , Yan Zhou , Murat Kantarcioglu

Is AI set to redefine the legal profession? We argue that this claim is not supported by the current evidence. We dive into AI's increasingly prevalent roles in three types of legal tasks: information processing; tasks involving creativity,…

Computers and Society · Computer Science 2024-02-06 Sayash Kapoor , Peter Henderson , Arvind Narayanan

Artificial intelligence (AI) is increasingly being adopted in most industries, and for applications such as note taking and checking grammar, there is typically not a cause for concern. However, when constitutional rights are involved, as…

Among the various forms of reasoning studied in the context of artificial intelligence, qualitative reasoning makes it possible to infer new knowledge in the context of imprecise, incomplete information without numerical values. In this…

Artificial Intelligence · Computer Science 2026-02-10 Quentin Cohen-Solal , Alexandre Niveau , Maroua Bouzid

An impossibility theorem demonstrates that a particular problem or set of problems cannot be solved as described in the claim. Such theorems put limits on what is possible to do concerning artificial intelligence, especially the…

Artificial Intelligence · Computer Science 2023-06-19 Mario Brcic , Roman V. Yampolskiy

This paper argues that explainability is only one facet of a broader ideal that shapes our expectations towards artificial intelligence (AI). Fundamentally, the issue is to what extent AI exhibits systematicity--not merely in being…

Artificial Intelligence · Computer Science 2025-07-31 Matthieu Queloz

The problem of replicating the flexibility of human common-sense reasoning has captured the imagination of computer scientists since the early days of Alan Turing's foundational work on computation and the philosophy of artificial…

Artificial Intelligence · Computer Science 2015-11-24 Cameron E. Freer , Daniel M. Roy , Joshua B. Tenenbaum

Artificial Intelligence (AI) systems are increasingly deployed in legal contexts, where their opacity raises significant challenges for fairness, accountability, and trust. The so-called ``black box problem'' undermines the legitimacy of…

Artificial Intelligence · Computer Science 2025-10-14 Andrada Iulia Prajescu , Roberto Confalonieri

The inner alignment problem, which asserts whether an arbitrary artificial intelligence (AI) model satisfices a non-trivial alignment function of its outputs given its inputs, is undecidable. This is rigorously proved by Rice's theorem,…

Within the field of Requirements Engineering (RE), the increasing significance of Explainable Artificial Intelligence (XAI) in aligning AI-supported systems with user needs, societal expectations, and regulatory standards has garnered…

Artificial Intelligence · Computer Science 2023-07-27 Timo Speith , Markus Langer

We formalize Prescriptive Artificial Intelligence as a distinct paradigm for human-AI decision collaboration in high-stakes environments. Unlike predictive systems optimized for outcome accuracy, prescriptive systems are designed to…

Artificial Intelligence · Computer Science 2026-03-26 Pedro Passos , Patrick Moratori

In the interdisciplinary field of artificial intelligence (AI) the problem of clear terminology is especially momentous. This paper claims, that AI debates are still characterised by a lack of critical distance to metaphors like 'training',…

Computers and Society · Computer Science 2025-04-01 Rainer Rehak

We characterize three notions of explainable AI that cut across research fields: opaque systems that offer no insight into its algo- rithmic mechanisms; interpretable systems where users can mathemat- ically analyze its algorithmic…

Artificial Intelligence · Computer Science 2017-10-03 Derek Doran , Sarah Schulz , Tarek R. Besold