English
Related papers

Related papers: No Black Boxes: Interpretable and Interactable Pre…

200 papers

In recent years, machine learning (ML) has become a key enabling technology for the sciences and industry. Especially through improvements in methodology, the availability of large databases and increased computational power, today's ML…

Artificial Intelligence · Computer Science 2019-09-27 Wojciech Samek , Klaus-Robert Müller

Clinical dialogue represents a complex duality requiring both the empathetic fluency of natural conversation and the rigorous precision of evidence-based medicine. While Large Language Models possess unprecedented linguistic capabilities,…

Other Quantitative Biology · Quantitative Biology 2025-12-02 Xiaoquan Zhi , Hongke Zhao , Likang Wu , Chuang Zhao , Hengshu Zhu

When developing AI systems that interact with humans, it is essential to design both a system that can understand humans, and a system that humans can understand. Most deep network based agent-modeling approaches are 1) not interpretable…

Machine Learning · Computer Science 2021-07-14 Ini Oguntola , Dana Hughes , Katia Sycara

Explainable artificial intelligence (XAI) is an emerging new domain in which a set of processes and tools allow humans to better comprehend the decisions generated by black box models. However, most of the available XAI tools are often…

Machine Learning · Computer Science 2021-07-22 Zoumpolia Dikopoulou , Serafeim Moustakidis , Patrik Karlsson

AI models underpin data-centric applications from image and text processing to scientific discovery in biology, physics, and chemistry. Yet developing them remains heavily manual, requiring practitioners to design architectures, build…

Artificial Intelligence · Computer Science 2026-05-28 Ruiyi Zhang , Peijia Qin , Qi Cao , Li Zhang , Pengtao Xie

The use of deep learning in computer vision tasks such as image classification has led to a rapid increase in the performance of such systems. Due to this substantial increment in the utility of these systems, the use of artificial…

Image and Video Processing · Electrical Eng. & Systems 2023-04-05 Vinay Jogani , Joy Purohit , Ishaan Shivhare , Seema C Shrawne

As the manufacturing industry advances with sensor integration and automation, the opaque nature of deep learning models in machine learning poses a significant challenge for fault detection and diagnosis. And despite the related predictive…

Artificial Intelligence · Computer Science 2024-06-11 Ahmed Maged , Salah Haridy , Herman Shen

Accurate early prediction of Acute Kidney Injury (AKI) is critical for timely clinical intervention. However, existing deep learning models struggle with irregularly sampled data and suffer from the opaque "black-box" nature of sequential…

Machine Learning · Computer Science 2026-04-23 Weizhi Nie , Haolin Chen

The black-box nature of machine learning models hinders the deployment of some high-accuracy models in medical diagnosis. It is risky to put one's life in the hands of models that medical researchers do not fully understand. However,…

Machine Learning · Computer Science 2021-10-22 Han Wu , Wenjie Ruan , Jiangtao Wang , Dingchang Zheng , Bei Liu , Yayuan Gen , Xiangfei Chai , Jian Chen , Kunwei Li , Shaolin Li , Sumi Helal

While large language models (LLMs) have shown promise in diagnostic dialogue, their capabilities for effective management reasoning - including disease progression, therapeutic response, and safe medication prescription - remain…

Despite strong performance in medical question-answering, the clinical adoption of Large Language Models (LLMs) is critically hampered by their opaque 'black-box' reasoning, limiting clinician trust. This challenge is compounded by the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Chao Ding , Mouxiao Bian , Pengcheng Chen , Hongliang Zhang , Tianbin Li , Lihao Liu , Jiayuan Chen , Zhuoran Li , Yabei Zhong , Yongqi Liu , Haiqing Huang , Dongming Shan , Junjun He , Jie Xu

Last years have been characterized by an upsurge of opaque automatic decision support systems, such as Deep Neural Networks (DNNs). Although they have great generalization and prediction skills, their functioning does not allow obtaining…

Reliable and interpretable decision-making is essential in medical imaging, where diagnostic outcomes directly influence patient care. Despite advances in deep learning, most medical AI systems operate as opaque black boxes, providing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Pirzada Suhail , Aditya Anand , Amit Sethi

Missing values are a fundamental problem in data science. Many datasets have missing values that must be properly handled because the way missing values are treated can have large impact on the resulting machine learning model. In medical…

Machine Learning · Computer Science 2023-04-25 Zhi Chen , Sarah Tan , Urszula Chajewska , Cynthia Rudin , Rich Caruana

Large language model (LLM) agents extend generative models with reasoning, tool use, and persistent memory, thereby enabling the automation of complex tasks. In healthcare, such systems could support documentation, care coordination, and…

Artificial Intelligence · Computer Science 2026-03-24 Wenxian Yang , Hanzheng Qiu , Bangqun Zhang , Chengquan Li , Zhiyong Huang , Xiaobin Feng , Rongshan Yu , Jiahong Dong

The automation of the medical evidence acquisition and diagnosis process has recently attracted increasing attention in order to reduce the workload of doctors and democratize access to medical care. However, most works proposed in the…

Computation and Language · Computer Science 2022-10-14 Arsene Fansi Tchango , Rishab Goel , Julien Martel , Zhi Wen , Gaetan Marceau Caron , Joumana Ghosn

AI systems have been widely adopted across various domains in the real world. However, in high-value, sensitive, or safety-critical applications such as self-management for personalized health or food recommendation with a specific purpose…

Artificial Intelligence · Computer Science 2022-06-28 Amit Sheth , Manas Gaur , Kaushik Roy , Revathy Venkataraman , Vedant Khandelwal

The need for transparency of predictive systems based on Machine Learning algorithms arises as a consequence of their ever-increasing proliferation in the industry. Whenever black-box algorithmic predictions influence human affairs, the…

Machine Learning · Computer Science 2020-02-11 Kacper Sokol , Peter Flach

Several approaches have been developed for answering users' specific questions about AI behavior and for assessing their core functionality in terms of primitive executable actions. However, the problem of summarizing an AI agent's broad…

Artificial Intelligence · Computer Science 2022-05-31 Pulkit Verma , Shashank Rao Marpally , Siddharth Srivastava

Effectively explaining decisions of black-box machine learning models is critical to responsible deployment of AI systems that rely on them. Recognizing their importance, the field of explainable AI (XAI) provides several techniques to…

Artificial Intelligence · Computer Science 2025-07-25 Yao Rong , Peizhu Qian , Vaibhav Unhelkar , Enkelejda Kasneci