English
Related papers

Related papers: The Open-Box Fallacy: Why AI Deployment Needs a Ca…

200 papers

Developing and certifying safe - or so-called trustworthy - AI has become an increasingly salient issue, especially in light of upcoming regulation such as the EU AI Act. In this context, the black-box nature of machine learning models…

Explainability features are intended to provide insight into the internal mechanisms of an AI device, but there is a lack of evaluation techniques for assessing the quality of provided explanations. We propose a framework to assess and…

Artificial Intelligence · Computer Science 2025-06-18 Miguel A. Lago , Ghada Zamzmi , Brandon Eich , Jana G. Delfino

Purpose: The governance of artificial iintelligence (AI) systems requires a structured approach that connects high-level regulatory principles with practical implementation. Existing frameworks lack clarity on how regulations translate into…

Computers and Society · Computer Science 2025-09-16 Avinash Agarwal , Manisha J. Nene

This position paper argues that behavioural assurance, even when carefully designed, is being asked to carry safety claims it cannot verify. AI governance frameworks enacted between 2019 and early 2026 require reviewable evidence of…

Machine Learning · Computer Science 2026-05-15 Pratinav Seth , Vinay Kumar Sankarapu

As coding agents gain access to shells, repositories, and user files, least-privilege authorization becomes a prerequisite for safe deployment: an agent should receive enough authority to complete the task, without unnecessary authority…

Cryptography and Security · Computer Science 2026-05-18 Zheng Yan , Jingxiang Weng , Charles Chen , Dengyun Peng , Ethan Qin , Jiannan Guan , Jinhao Liu , Qiming Yu , Yixin Yuan , Fanqing Meng , Carl Che , Mengkang Hu

Artificial Intelligence (AI) systems are being deployed around the globe in critical fields such as healthcare and education. In some cases, expert practitioners in these domains are being tasked with introducing or using such systems, but…

Computers and Society · Computer Science 2021-06-16 Iain Barclay , Will Abramson

The field of "explainable artificial intelligence" (XAI) seemingly addresses the desire that decisions of machine learning systems should be human-understandable. However, in its current state, XAI itself needs scrutiny. Popular methods…

Machine Learning · Computer Science 2026-04-09 Stefan Haufe , Rick Wilming , Benedict Clark , Rustam Zhumagambetov , Ahcène Boubekki , Jörg Martin , Danny Panknin

The explosion in the performance of Machine Learning (ML) and the potential of its applications are strongly encouraging us to consider its use in industrial systems, including for critical functions such as decision-making in autonomous…

Computers and Society · Computer Science 2023-11-14 François Terrier

The widespread use of Artificial Intelligence-based tools in the healthcare sector raises many ethical and legal problems, one of the main reasons being their black-box nature and therefore the seemingly opacity and inscrutability of their…

The need for AI systems to provide explanations for their behaviour is now widely recognised as key to their adoption. In this paper, we examine the problem of trustworthy AI and explore what delivering this means in practice, with a focus…

Artificial Intelligence · Computer Science 2022-11-30 Rob Procter , Peter Tolmie , Mark Rouncefield

Firms are deploying more capable AI systems, but organizational controls often have not kept pace. These systems can generate greater productivity gains, but high-value uses require broader authority exposure -- data access, workflow…

General Economics · Economics 2026-04-28 Sukwoong Choi

Trust calibration -- aligning user trust judgment with model capability -- is crucial for safe deployment of explainable AI (XAI), yet is often evaluated via global trust ratings detached from objective performance evidence. We present a…

Human-Computer Interaction · Computer Science 2026-05-19 Alfio Ventura , Tim Katzke , Jan Corazza , Mustafa Yalçıner

Trustworthiness is a central requirement for the acceptance and success of human-centered artificial intelligence (AI). To deem an AI system as trustworthy, it is crucial to assess its behaviour and characteristics against a gold standard…

Recent AI systems compress the distance between capability growth and capability deployment. Earlier high-risk technologies were slowed by capital intensity, physical bottlenecks, organizational inertia, and specialized supply chains. By…

Artificial Intelligence · Computer Science 2026-05-05 Wesley Shu , Peng Wei

Explainable AI has become a common term in the literature, scrutinized by computer scientists and statisticians and highlighted by psychological or philosophical researchers. One major effort many researchers tackle is constructing general…

Artificial Intelligence · Computer Science 2025-09-12 Carina Newen , Daniel Bodemer , Sonja Glantz , Emmanuel Müller , Magdalena Wischnewski , Lenka Schnaubert

The recent spike in certified Artificial Intelligence (AI) tools for healthcare has renewed the debate around adoption of this technology. One thread of such debate concerns Explainable AI and its promise to render AI devices more…

Human-Computer Interaction · Computer Science 2022-07-01 Giovanni Cinà , Tabea Röber , Rob Goedhart , Ilker Birbil

The implementation of the AI Act requires practical mechanisms to verify compliance with legal obligations, yet concrete and operational mappings from high-level requirements to verifiable assessment activities remain limited, contributing…

Computers and Society · Computer Science 2026-04-06 Alessio Buscemi , Tom Deckenbrunnen , Fahria Kabir , Kateryna Mishchenko , Nishat Mowla

Evaluations of generative models are now ubiquitous, and their outcomes critically shape public and scientific expectations of AI's capabilities. Yet skepticism about their reliability continues to grow. How can we know that a reported…

Artificial Intelligence · Computer Science 2026-05-19 Nathanael Jo , Ashia Wilson

AI systems increasingly produce fluent, correct, end-to-end outcomes. Over time, this erodes users' ability to explain, verify, or intervene. We define this divergence as the Capability-Comprehension Gap: a decoupling where assisted…

Artificial Intelligence · Computer Science 2026-02-03 Fangzhou Lin , Qianwen Ge , Lingyu Xu , Peiran Li , Xiangbo Gao , Shuo Xing , Kazunori Yamada , Ziming Zhang , Haichong Zhang , Zhengzhong Tu

The growing societal reliance on artificial intelligence necessitates robust frameworks for ensuring its security, accountability, and trustworthiness. This thesis addresses the complex interplay between privacy, verifiability, and…

Cryptography and Security · Computer Science 2025-09-03 Tobin South