English
Related papers

Related papers: Solving the Black Box Problem: A Normative Framewo…

200 papers

Growing concerns over the lack of transparency in AI, particularly in high-stakes fields like healthcare and finance, drive the need for explainable and trustworthy systems. While Large Language Models (LLMs) perform exceptionally well in…

Artificial Intelligence · Computer Science 2025-06-10 Fadi Al Machot , Martin Thomas Horsch , Habib Ullah

Interpretability, trustworthiness, and usability are key considerations in high-stake security applications, especially when utilizing deep learning models. While these models are known for their high accuracy, they behave as black boxes in…

There are concerns about the reliability and safety of artificial intelligence (AI) based on sub-symbolic neural networks because its decisions cannot be explained explicitly. This is the black box problem of modern AI. At the same time,…

Artificial Intelligence · Computer Science 2024-05-21 V. L. Kalmykov , L. V. Kalmykov

Autonomous AI systems will be entering human society in the near future to provide services and work alongside humans. For those systems to be accepted and trusted, the users should be able to understand the reasoning process of the system,…

Machine Learning · Computer Science 2018-09-18 Rahul Iyer , Yuezhang Li , Huao Li , Michael Lewis , Ramitha Sundar , Katia Sycara

This paper provides empirical concerns about post-hoc explanations of black-box ML models, one of the major trends in AI explainability (XAI), by showing its lack of interpretability and societal consequences. Using a representative…

Human-Computer Interaction · Computer Science 2021-10-01 Jean-Marie John-Mathews

We present Learning to Explain (LTX), a model-agnostic framework designed for providing post-hoc explanations for vision models. The LTX framework introduces an "explainer" model that generates explanation maps, highlighting the crucial…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Oren Barkan , Yuval Asher , Amit Eshel , Yehonatan Elisha , Noam Koenigstein

The success of artificial intelligence (AI), and deep learning models in particular, has led to their widespread adoption across various industries due to their ability to process huge amounts of data and learn complex patterns. However,…

Artificial Intelligence · Computer Science 2023-09-22 Wei Jie Yeo , Wihan van der Heever , Rui Mao , Erik Cambria , Ranjan Satapathy , Gianmarco Mengaldo

In AI and law, systems that are designed for decision support should be explainable when pursuing justice. In order for these systems to be fair and responsible, they should make correct decisions and make them using a sound and transparent…

Artificial Intelligence · Computer Science 2021-05-17 Cor Steging , Silja Renooij , Bart Verheij

Although modern machine learning and deep learning methods allow for complex and in-depth data analytics, the predictive models generated by these methods are often highly complex, and lack transparency. Explainable AI (XAI) methods are…

Machine Learning · Computer Science 2021-06-17 Mythreyi Velmurugan , Chun Ouyang , Catarina Moreira , Renuka Sindhgatta

Explainable artificial intelligence (xAI) is seen as a solution to making AI systems less of a black box. It is essential to ensure transparency, fairness, and accountability, which are especially paramount in the financial sector. The aim…

Artificial Intelligence · Computer Science 2021-11-08 Ouren Kuiper , Martin van den Berg , Joost van der Burgt , Stefan Leijnen

This paper claims that machine learning models deployed in high stakes domains such as medicine must be interpretable, shareable, reproducible and accountable. We argue that these principles should form the foundational design criteria for…

Machine Learning · Computer Science 2025-08-25 Ayyüce Begüm Bektaş , Mithat Gönen

Cybersecurity vendors consistently apply AI (Artificial Intelligence) to their solutions and many cybersecurity domains can benefit from AI technology. However, black-box AI techniques present some difficulties in comprehension and adoption…

Cryptography and Security · Computer Science 2023-03-03 Carlos Mendes , Tatiane Nogueira Rios

While the increased integration of AI technologies into interactive systems enables them to solve an equally increasing number of tasks, the black box problem of AI models continues to spread throughout the interactive system as a whole.…

Human-Computer Interaction · Computer Science 2025-06-04 Sebe Vanbrabant , Gustavo Rovelo Ruiz , Davy Vanacken

State of the art Artificial Intelligence (AI) techniques have reached an impressive complexity. Consequently, researchers are discovering more and more methods to use them in real-world applications. However, the complexity of such systems…

Artificial Intelligence · Computer Science 2021-11-08 Marco Matarese , Francesco Rea , Alessandra Sciutti

Deep learning techniques are rapidly advanced recently, and becoming a necessity component for widespread systems. However, the inference process of deep learning is black-box, and not very suitable to safety-critical systems which must…

Machine Learning · Computer Science 2019-03-14 Hiroshi Kuwajima , Masayuki Tanaka , Masatoshi Okutomi

Neural networks are widely regarded as black-box models, creating significant challenges in understanding their inner workings, especially in natural language processing (NLP) applications. To address this opacity, model explanation…

Computation and Language · Computer Science 2025-01-10 Melkamu Mersha , Mingiziem Bitewa , Tsion Abay , Jugal Kalita

Large Language Models (LLMs) offer a promising approach to enhancing Explainable AI (XAI) by transforming complex machine learning outputs into easy-to-understand narratives, making model predictions more accessible to users, and helping…

Artificial Intelligence · Computer Science 2025-04-02 Ahsan Bilal , David Ebert , Beiyu Lin

Explainable AI (XAI) aims to address the human need for safe and reliable AI systems. However, numerous surveys emphasize the absence of a sound mathematical formalization of key XAI notions -- remarkably including the term "explanation"…

Artificial Intelligence · Computer Science 2023-09-19 Pietro Barbiero , Stefano Fioravanti , Francesco Giannini , Alberto Tonda , Pietro Lio , Elena Di Lavore

This paper presents a comprehensive theoretical investigation into the parameterized complexity of explanation problems in various machine learning (ML) models. Contrary to the prevalent black-box perception, our study focuses on models…

Artificial Intelligence · Computer Science 2024-07-23 Sebastian Ordyniak , Giacomo Paesani , Mateusz Rychlicki , Stefan Szeider

This paper presents a comprehensive theoretical investigation into the parameterized complexity of explanation problems in various machine learning (ML) models. Contrary to the prevalent black-box perception, our study focuses on models…

Artificial Intelligence · Computer Science 2025-11-06 Sebastian Ordyniak , Giacomo Paesani , Mateusz Rychlicki , Stefan Szeider