English
Related papers

Related papers: Towards Safe, Explainable, and Regulated Autonomou…

200 papers

With artificial intelligence (AI) embedded in many everyday software systems, effectively and reliably developing and maintaining AI systems becomes an essential skill for software developers. However, the complexity inherent to AI poses…

Human-Computer Interaction · Computer Science 2025-04-22 Thomas Weber

The unprecedented performance of machine learning models in recent years, particularly Deep Learning and transformer models, has resulted in their application in various domains such as finance, healthcare, and education. However, the…

Human-Computer Interaction · Computer Science 2023-12-20 Milad Rogha

Artificial Intelligence (AI) systems are increasingly deployed in legal contexts, where their opacity raises significant challenges for fairness, accountability, and trust. The so-called ``black box problem'' undermines the legitimacy of…

Artificial Intelligence · Computer Science 2025-10-14 Andrada Iulia Prajescu , Roberto Confalonieri

We examine the problem of explainable AI (xAI) and explore what delivering xAI means in practice, particularly in contexts that involve formal or informal and ad-hoc collaboration where agency and accountability in decision-making are…

Human-Computer Interaction · Computer Science 2020-10-06 Rob Procter , Mark Rouncefield , Peter Tolmie

Developing and certifying safe - or so-called trustworthy - AI has become an increasingly salient issue, especially in light of upcoming regulation such as the EU AI Act. In this context, the black-box nature of machine learning models…

As systems based on opaque Artificial Intelligence (AI) continue to flourish in diverse real-world applications, understanding these black box models has become paramount. In response, Explainable AI (XAI) has emerged as a field of research…

This paper discusses ongoing work in demonstrating research in mobile autonomy in challenging driving scenarios. In our approach, we address fundamental technical issues to overcome critical barriers to assurance and regulation for…

Computers and Society · Computer Science 2020-05-06 Matthew Gadd , Daniele De Martini , Letizia Marchegiani , Paul Newman , Lars Kunze

Given the sheer volume of surgical procedures and the significant rate of postoperative fatalities, assessing and managing surgical complications has become a critical public health concern. Existing artificial intelligence (AI) tools for…

Artificial Intelligence (AI) is an important part of our everyday lives. We use it in self-driving cars and smartphone assistants. People often call it a "black box" because its complex systems, especially deep neural networks, are hard to…

Nowadays, large-scale foundation models are being increasingly integrated into numerous safety-critical applications, including human-autonomy teaming (HAT) within transportation, medical, and defence domains. Consequently, the inherent…

Artificial Intelligence · Computer Science 2024-05-07 Xiangqi Kong , Yang Xing , Antonios Tsourdos , Ziyue Wang , Weisi Guo , Adolfo Perrusquia , Andreas Wikander

Artificial intelligence now outperforms humans in several scientific and engineering tasks, yet its internal representations often remain opaque. In this Perspective, we argue that explainable artificial intelligence (XAI), combined with…

Artificial Intelligence · Computer Science 2026-02-17 Ricardo Vinuesa , Steven L. Brunton , Gianmarco Mengaldo

Explainable artificial intelligence is an emerging and evolving concept. Its impact on construction, though yet to be realised, will be profound in the foreseeable future. Still, XAI has received limited attention in construction. As a…

Artificial Intelligence · Computer Science 2022-11-15 Peter ED Love , Jane Matthews , Weili Fang , Stuart Porter , Hanbin Luo , Lieyun Ding

Black-box nature of Artificial Intelligence (AI) models do not allow users to comprehend and sometimes trust the output created by such model. In AI applications, where not only the results but also the decision paths to the results are…

Artificial Intelligence · Computer Science 2024-10-28 Ibrahim Kok , Feyza Yildirim Okay , Ozgecan Muyanli , Suat Ozdemir

As autonomous technologies increasingly shape maritime operations, understanding why an AI system makes a decision becomes as crucial as what it decides. In complex and dynamic maritime environments, trust in AI depends not only on…

Artificial Intelligence · Computer Science 2025-09-19 Doreen Jirak , Pieter Maes , Armeen Saroukanoff , Dirk van Rooy

The field of "explainable artificial intelligence" (XAI) seemingly addresses the desire that decisions of machine learning systems should be human-understandable. However, in its current state, XAI itself needs scrutiny. Popular methods…

Machine Learning · Computer Science 2026-04-09 Stefan Haufe , Rick Wilming , Benedict Clark , Rustam Zhumagambetov , Ahcène Boubekki , Jörg Martin , Danny Panknin

The design of embedded safety-critical systems such as those used in next-generation automotive and autonomous platforms, is increasingly challenged by escalating system complexity, hardware-software heterogeneity, and the integration of…

Artificial Intelligence · Computer Science 2026-05-04 Behnaz Ranjbar , Kirankumar Raveendiran , Sudeep Pasricha , Samarjit Chakraborty , Cecilia Carbonelli , Akash Kumar

Artificial Intelligence in Medicine has made significant progress with emerging applications in medical imaging, patient care, and other areas. While these applications have proven successful in retrospective studies, very few of them were…

Artificial Intelligence · Computer Science 2023-08-11 Nicoletta Prentzas , Antonis Kakas , Constantinos S. Pattichis

Artificial intelligence (AI) enables machines to learn from human experience, adjust to new inputs, and perform human-like tasks. AI is progressing rapidly and is transforming the way businesses operate, from process automation to cognitive…

Machine Learning · Computer Science 2021-12-17 Ambreen Hanif

Security of (semi)-autonomous vehicles is a growing concern, first, due to the increased exposure of the functionality to the potential attackers; second, due to the reliance of car functionalities on diverse (semi)-autonomous systems;…

Cryptography and Security · Computer Science 2018-10-02 Anupam Chattopadhyay , Kwok-Yan Lam

EXplainable Artificial Intelligence (XAI) is a vibrant research topic in the artificial intelligence community, with growing interest across methods and domains. Much has been written about the subject, yet XAI still lacks shared…

Artificial Intelligence · Computer Science 2023-06-16 Matteo Rizzo , Alberto Veneri , Andrea Albarelli , Claudio Lucchese , Marco Nobile , Cristina Conati