中文
相关论文

相关论文: BaTCAVe: Trustworthy Explanations for Robot Behavi…

200 篇论文

Explainable AI (XAI) aims to provide interpretations for predictions made by learning machines, such as deep neural networks, in order to make the machines more transparent for the user and furthermore trustworthy also for applications in…

机器学习 · 计算机科学 2020-06-17 Kirill Bykov , Marina M. -C. Höhne , Klaus-Robert Müller , Shinichi Nakajima , Marius Kloft

Artificial Intelligence (AI) is an important part of our everyday lives. We use it in self-driving cars and smartphone assistants. People often call it a "black box" because its complex systems, especially deep neural networks, are hard to…

The opaqueness of many complex machine learning algorithms is often mentioned as one of the main obstacles to the ethical development of artificial intelligence (AI). But what does it mean for an algorithm to be opaque? Highly complex…

机器学习 · 计算机科学 2025-08-20 Andrés Páez

The growing adoption of artificial intelligence in healthcare has raised concerns about the transparency and trustworthiness of AI-driven medical diagnosis systems. Many existing models operate as black boxes, limiting clinicians' ability…

人机交互 · 计算机科学 2026-04-21 Altynbek Seitenov , Ainur Nurzhanova , Azhar Bekbussinova , Yerassyl Bolatkan

Indecipherable black boxes are common in machine learning (ML), but applications increasingly require explainable artificial intelligence (XAI). The core of XAI is to establish transparent and interpretable data-driven algorithms. This work…

最优化与控制 · 数学 2023-06-13 Howard Heaton , Samy Wu Fung

Interactive Artificial Intelligence (AI) agents are becoming increasingly prevalent in society. However, application of such systems without understanding them can be problematic. Black-box AI systems can lead to liability and…

计算机与社会 · 计算机科学 2023-01-16 Pradyumna Tambwekar , Matthew Gombolay

In the last years many accurate decision support systems have been constructed as black boxes, that is as systems that hide their internal logic to the user. This lack of explanation constitutes both a practical and an ethical issue. The…

计算机与社会 · 计算机科学 2018-06-22 Riccardo Guidotti , Anna Monreale , Salvatore Ruggieri , Franco Turini , Dino Pedreschi , Fosca Giannotti

Advances in AI technologies have resulted in superior levels of AI-based model performance. However, this has also led to a greater degree of model complexity, resulting in 'black box' models. In response to the AI black box problem, the…

人机交互 · 计算机科学 2022-10-25 Julie Gerlings , Millie Søndergaard Jensen , Arisa Shollo

Verified explanations are a principled way to explain the decisions taken by neural networks, which are otherwise black-box in nature. However, these techniques face significant scalability challenges, as they require multiple calls to…

机器学习 · 计算机科学 2026-05-11 Alessandro De Palma , Greta Dolcetti , Caterina Urban

There are concerns about the reliability and safety of artificial intelligence (AI) based on sub-symbolic neural networks because its decisions cannot be explained explicitly. This is the black box problem of modern AI. At the same time,…

人工智能 · 计算机科学 2024-05-21 V. L. Kalmykov , L. V. Kalmykov

Artificial intelligence models encounter significant challenges due to their black-box nature, particularly in safety-critical domains such as healthcare, finance, and autonomous vehicles. Explainable Artificial Intelligence (XAI) addresses…

人工智能 · 计算机科学 2025-03-14 Melkamu Mersha , Khang Lam , Joseph Wood , Ali AlShami , Jugal Kalita

Despite their impact on the society, deep neural networks are often regarded as black-box models due to their intricate structures and the absence of explanations for their decisions. This opacity poses a significant challenge to AI systems…

机器学习 · 计算机科学 2024-07-18 Biagio La Rosa

Modern AI systems frequently rely on opaque black-box models, most notably Deep Neural Networks, whose performance stems from complex architectures with millions of learned parameters. While powerful, their complexity poses a major…

机器学习 · 计算机科学 2026-02-23 David Dembinsky , Adriano Lucieri , Stanislav Frolov , Hiba Najjar , Ko Watanabe , Andreas Dengel

The shift from symbolic AI systems to black-box, sub-symbolic, and statistical ones has motivated a rapid increase in the interest toward explainable AI (XAI), i.e. approaches to make black-box AI systems explainable to human decision…

人工智能 · 计算机科学 2022-10-28 Federico Cabitza , Matteo Cameli , Andrea Campagner , Chiara Natali , Luca Ronzio

Last years have been characterized by an upsurge of opaque automatic decision support systems, such as Deep Neural Networks (DNNs). Although they have great generalization and prediction skills, their functioning does not allow obtaining…

The trustworthiness of neural networks is often challenged because they lack the ability to express uncertainty and explain their skill. This can be problematic given the increasing use of neural networks in high stakes decision-making such…

大气与海洋物理 · 物理学 2022-12-07 Mariana C. A. Clare , Maike Sonnewald , Redouane Lguensat , Julie Deshayes , Venkatramani Balaji

Designing and implementing explainable systems is seen as the next step towards increasing user trust in, acceptance of and reliance on Artificial Intelligence (AI) systems. While explaining choices made by black-box algorithms such as…

多智能体系统 · 计算机科学 2022-08-23 Sharadhi Alape Suryanarayana , David Sarne , Sarit Kraus

Deep Learning is a state-of-the-art technique to make inference on extensive or complex data. As a black box model due to their multilayer nonlinear structure, Deep Neural Networks are often criticized to be non-transparent and their…

人工智能 · 计算机科学 2019-11-28 Vanessa Buhrmester , David Münch , Michael Arens

This paper provides empirical concerns about post-hoc explanations of black-box ML models, one of the major trends in AI explainability (XAI), by showing its lack of interpretability and societal consequences. Using a representative…

人机交互 · 计算机科学 2021-10-01 Jean-Marie John-Mathews

Explainable Artificial Intelligence (XAI) techniques are frequently required by users in many AI systems with the goal of understanding complex models, their associated predictions, and gaining trust. While suitable for some specific tasks…

人机交互 · 计算机科学 2023-03-22 Savio Rozario , George Čevora