English
Related papers

Related papers: Beyond Explainability: The Case for AI Validation

200 papers

As AI systems advance and integrate into society, well-designed and transparent evaluations are becoming essential tools in AI governance, informing decisions by providing evidence about system capabilities and risks. Yet there remains a…

Remarkable success of modern image-based AI methods and the resulting interest in their applications in critical decision-making processes has led to a surge in efforts to make such intelligent systems transparent and explainable. The need…

Artificial Intelligence · Computer Science 2020-11-30 Adriano Lucieri , Muhammad Naseer Bajwa , Andreas Dengel , Sheraz Ahmed

Artificial intelligence (AI) technologies (re-)shape modern life, driving innovation in a wide range of sectors. However, some AI systems have yielded unexpected or undesirable outcomes or have been used in questionable manners. As a…

The explainability of AI has transformed from a purely technical issue to a complex issue closely related to algorithmic governance and algorithmic security. The lack of explainable AI (XAI) brings adverse effects that can cross all…

Computers and Society · Computer Science 2023-03-02 Yulu Pi

Reliable explainability is not only a technical goal but also a cornerstone of private AI governance. As AI models enter high-stakes sectors, private actors such as auditors, insurers, certification bodies, and procurement agencies require…

Artificial Intelligence · Computer Science 2025-11-21 Pratinav Seth , Vinay Kumar Sankarapu

Context: Artificial intelligence (AI) has made its way into everyday activities, particularly through new techniques such as machine learning (ML). These techniques are implementable with little domain knowledge. This, combined with the…

Software Engineering · Computer Science 2021-09-17 Lalli Myllyaho , Mikko Raatikainen , Tomi Männistö , Tommi Mikkonen , Jukka K. Nurminen

Within the field of Requirements Engineering (RE), the increasing significance of Explainable Artificial Intelligence (XAI) in aligning AI-supported systems with user needs, societal expectations, and regulatory standards has garnered…

Artificial Intelligence · Computer Science 2023-07-27 Timo Speith , Markus Langer

With the long term accumulation of high quality educational data, artificial intelligence has shown excellent performance in knowledge tracing. However, due to the lack of interpretability and transparency of some algorithms, this approach…

Computation and Language · Computer Science 2024-03-13 Yanhong Bai , Jiabao Zhao , Tingjiang Wei , Qing Cai , Liang He

Artificial intelligence (AI) has demonstrated strong potential in clinical diagnostics, often achieving accuracy comparable to or exceeding that of human experts. A key challenge, however, is that AI reasoning frequently diverges from…

Artificial Intelligence · Computer Science 2026-05-25 Belona Sonna , Alban Grastien

As Artificial Intelligence (AI) becomes increasingly embedded in financial decision-making, the opacity of complex models presents significant challenges for professionals and regulators. While the field of Explainable AI (XAI) attempts to…

Human-Computer Interaction · Computer Science 2026-02-03 Patricia Marcella Evite , Ekaterina Svetlova , Doina Bucur

Certainty around the regulatory environment is crucial to enable responsible AI innovation and foster the social acceptance of these powerful new technologies. One notable source of uncertainty is, however, that the existing legal liability…

Computers and Society · Computer Science 2020-05-20 Olivia J. Erdélyi , Gábor Erdélyi

Artificial Intelligence (AI) shows promising applications for the perception and planning tasks in autonomous driving (AD) due to its superior performance compared to conventional methods. However, inscrutable AI systems exacerbate the…

Robotics · Computer Science 2024-11-12 Anton Kuznietsov , Balint Gyevnar , Cheng Wang , Steven Peters , Stefano V. Albrecht

Prognostic and diagnostic AI-based medical devices hold immense promise for advancing healthcare, yet their rapid development has outpaced the establishment of appropriate validation methods. Existing approaches often fall short in…

Machine Learning · Computer Science 2024-09-10 Florian Hellmeier , Kay Brosien , Carsten Eickhoff , Alexander Meyer

Artificial intelligence (AI) has been clearly established as a technology with the potential to revolutionize fields from healthcare to finance - if developed and deployed responsibly. This is the topic of responsible AI, which emphasizes…

Artificial Intelligence · Computer Science 2023-12-05 Stephanie Baker , Wei Xiang

Interpretability, explainability and transparency are key issues to introducing Artificial Intelligence methods in many critical domains: This is important due to ethical concerns and trust issues strongly connected to reliability,…

Machine Learning · Computer Science 2023-01-25 George A. Vouros

Explainable Artificial Intelligence (XAI) is increasingly rec ognized as essential for deploying machine learning systems in safety critical environments. In Automatic Target Recognition (ATR), where models operate on image, video, radar,…

Artificial Intelligence · Computer Science 2026-05-08 Vanessa Buhrmester , David Muench , Dimitri Bulatov , Michael Arens

This paper develops a comprehensive framework for artificial intelligence systems that operate under strict epistemic constraints, moving beyond stochastic language prediction to support structured reasoning, propositional commitment, and…

Logic in Computer Science · Computer Science 2025-06-24 Craig Steven Wright

Artificial Intelligence (AI) tools for automating design artifact generation are increasingly used in Requirements Engineering (RE) to transform textual requirements into structured diagrams and models. While these AI tools, particularly…

Software Engineering · Computer Science 2025-07-15 Syed Tauhid Ullah Shah , Mohammad Hussein , Ann Barcomb , Mohammad Moshirpour

This position paper argues that reliable AI requires infrastructure for human validation of implicit knowledge. AI learns from both explicit knowledge (papers, documentation, structured databases) and implicit knowledge (reasoning patterns,…

Artificial Intelligence · Computer Science 2026-05-26 Hengyu Liu , Tianyi Li , Zhihong Cui , Yushuai Li , Zhangkai Wu , Torben Bach Pedersen , Kristian Torp , Christian S. Jensen