English
Related papers

Related papers: The Three Ghosts of Medical AI: Can the Black-Box …

200 papers

Artificial Intelligence (AI) is an important part of our everyday lives. We use it in self-driving cars and smartphone assistants. People often call it a "black box" because its complex systems, especially deep neural networks, are hard to…

Artificial intelligence models encounter significant challenges due to their black-box nature, particularly in safety-critical domains such as healthcare, finance, and autonomous vehicles. Explainable Artificial Intelligence (XAI) addresses…

Artificial Intelligence · Computer Science 2025-03-14 Melkamu Mersha , Khang Lam , Joseph Wood , Ali AlShami , Jugal Kalita

Machine learning models that incorporate concept learning as an intermediate step in their decision making process can match the performance of black-box predictive models while retaining the ability to explain outcomes in human…

Machine Learning · Computer Science 2021-06-28 Anita Mahinpei , Justin Clark , Isaac Lage , Finale Doshi-Velez , Weiwei Pan

Artificial intelligence has advanced rapidly across perception, language, reasoning, and multimodal domains. Yet despite these achievements, modern AI systems remain fundamentally limited in their ability to self-monitor, self-correct, and…

Artificial Intelligence · Computer Science 2025-12-03 Noorbakhsh Amiri Golilarz , Sindhuja Penchala , Shahram Rahimi

Black box neural networks are an indispensable part of modern robots. Nevertheless, deploying such high-stakes systems in real-world scenarios poses significant challenges when the stakeholders, such as engineers and legislative bodies,…

Robotics · Computer Science 2025-10-10 Som Sagar , Aditya Taparia , Harsh Mankodiya , Pranav Bidare , Yifan Zhou , Ransalu Senanayake

Artificial Intelligence (AI) is becoming the corner stone of many systems used in our daily lives such as autonomous vehicles, healthcare systems, and unmanned aircraft systems. Machine Learning is a field of AI that enables systems to…

Artificial Intelligence · Computer Science 2022-06-27 Lionel Nganyewou Tidjon , Foutse Khomh

The use of deep learning in computer vision tasks such as image classification has led to a rapid increase in the performance of such systems. Due to this substantial increment in the utility of these systems, the use of artificial…

Image and Video Processing · Electrical Eng. & Systems 2023-04-05 Vinay Jogani , Joy Purohit , Ishaan Shivhare , Seema C Shrawne

Explainability, the capability of an artificial intelligence system (AIS) to explain its outcomes in a manner that is comprehensible to human beings at an acceptable level, has been deemed essential for critical sectors, such as healthcare.…

Computers and Society · Computer Science 2025-09-23 Jiawen Wei , Elena Verona , Andrea Bertolini , Gianmarco Mengaldo

A consequence of the fragmented and siloed healthcare landscape is that patient care (and data) is split along multitude of different facilities and computer systems and enabling interoperability between these systems is hard. The lack…

Computers and Society · Computer Science 2020-01-22 Awais Ashfaq , Slawomir Nowaczyk

Modern healthcare is ripe for disruption by AI. A game changer would be automatic understanding the latent processes from electronic medical records, which are being collected for billions of people worldwide. However, these healthcare…

Neural and Evolutionary Computing · Computer Science 2018-02-06 Phuoc Nguyen , Truyen Tran , Svetha Venkatesh

Since its renaissance, deep learning has been widely used in various medical imaging tasks and has achieved remarkable success in many medical imaging applications, thereby propelling us into the so-called artificial intelligence (AI) era.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 S. Kevin Zhou , Hayit Greenspan , Christos Davatzikos , James S. Duncan , Bram van Ginneken , Anant Madabhushi , Jerry L. Prince , Daniel Rueckert , Ronald M. Summers

Large language models (LLMs) have shown considerable potential in supporting medical diagnosis. However, their effective integration into clinical workflows is hindered by physicians' difficulties in perceiving and trusting LLM…

Human-Computer Interaction · Computer Science 2026-01-28 Yuansong Xu , Yichao Zhu , Haokai Wang , Yuchen Wu , Yang Ouyang , Hanlu Li , Wenzhe Zhou , Xinyu Liu , Chang Jiang , Quan Li

Many deployed learned models are black boxes: given input, returns output. Internal information about the model, such as the architecture, optimisation procedure, or training data, is not disclosed explicitly as it might contain proprietary…

Machine Learning · Statistics 2018-02-15 Seong Joon Oh , Max Augustin , Bernt Schiele , Mario Fritz

The field of artificial intelligence (AI) has experienced remarkable progress in recent years, driven by the widespread adoption of open-source machine learning models in both research and industry. Considering the resource-intensive nature…

Machine Learning · Computer Science 2023-08-21 Dominik Hintersdorf , Lukas Struppek , Kristian Kersting

The concept of explainability is envisioned to satisfy society's demands for transparency on machine learning decisions. The concept is simple: like humans, algorithms should explain the rationale behind their decisions so that their…

Machine Learning · Computer Science 2021-04-14 Erwan Le Merrer , Gilles Tredan

Machine learning components are now central to AI-infused software systems, from recommendations and code assistants to clinical decision support. As regulations and governance frameworks increasingly require deleting sensitive data from…

Machine Learning · Computer Science 2026-04-21 Anna Mazhar , Sainyam Galhotra

Trustworthy artificial intelligence (AI) is essential in healthcare, particularly for high-stakes tasks like medical image segmentation. Explainable AI and uncertainty quantification significantly enhance AI reliability by addressing key…

Artificial Intelligence (AI) is one of the disruptive technologies that is shaping the future. It has growing applications for data-driven decisions in major smart city solutions, including transportation, education, healthcare, public…

Machine Learning · Computer Science 2021-11-02 M. Humayn Kabir , Khondokar Fida Hasan , Mohammad Kamrul Hasan , Keyvan Ansari

This paper presents a comparative analysis of hallucination detection systems for AI, focusing on automatic summarization and question answering tasks for Large Language Models (LLMs). We evaluate different hallucination detection systems…

Computation and Language · Computer Science 2024-11-11 Alexander Thomas , Seth Rosen , Vishnu Vettrivel

In this article, we perform a review of the state-of-the-art of hybrid machine learning in medical imaging. We start with a short summary of the general developments of the past in machine learning and how general and specialized approaches…

Machine Learning · Computer Science 2022-03-18 Andreas Maier , Harald Köstler , Marco Heisig , Patrick Krauss , Seung Hee Yang