English
Related papers

Related papers: Interpretability of artificial neural network mode…

200 papers

The increasing adoption of machine learning tools has led to calls for accountability via model interpretability. But what does it mean for a machine learning model to be interpretable by humans, and how can this be assessed? We focus on…

Machine Learning · Computer Science 2019-08-06 Dylan Slack , Sorelle A. Friedler , Carlos Scheidegger , Chitradeep Dutta Roy

The ability to interpret machine learning models has become increasingly important now that machine learning is used to inform consequential decisions. We propose an approach called model extraction for interpreting complex, blackbox…

Machine Learning · Computer Science 2018-03-14 Osbert Bastani , Carolyn Kim , Hamsa Bastani

The integration of artificial intelligence into business processes has significantly enhanced decision-making capabilities across various industries such as finance, healthcare, and retail. However, explaining the decisions made by these AI…

Artificial Intelligence · Computer Science 2024-10-29 Arne Grobrugge , Nidhi Mishra , Johannes Jakubik , Gerhard Satzger

The recent boom of large language models (LLMs) has re-ignited the hope that artificial intelligence (AI) systems could aid medical diagnosis. Yet despite dazzling benchmark scores, LLM assistants have yet to deliver measurable improvements…

Artificial Intelligence · Computer Science 2025-07-03 Matthew JY Kang , Wenli Yang , Monica R Roberts , Byeong Ho Kang , Charles B Malpas

This paper discusses the limitations of machine learning (ML), particularly deep artificial neural networks (ANNs), which are effective at approximating complex functions but often lack transparency and explanatory power. It highlights the…

Machine Learning · Computer Science 2024-01-18 Udesh Habaraduwa

Deep neural networks (DNNs) transform stimuli across multiple processing stages to produce representations that can be used to solve complex tasks, such as object recognition in images. However, a full understanding of how they achieve this…

Neurons and Cognition · Quantitative Biology 2018-11-01 David G. T. Barrett , Ari S. Morcos , Jakob H. Macke

In many scientific research fields, understanding and visualizing a black-box function in terms of the effects of all the input variables is of great importance. Existing visualization tools do not allow one to visualize the effects of all…

Machine Learning · Computer Science 2023-03-08 Shengtong Zhang , Daniel W. Apley

Recent advancements in machine learning and signal processing domains have resulted in an extensive surge of interest in Deep Neural Networks (DNNs) due to their unprecedented performance and high accuracy for different and challenging…

Machine Learning · Computer Science 2021-02-04 Atefeh Shahroudnejad

The success of neural networks builds to a large extent on their ability to create internal knowledge representations from real-world high-dimensional data, such as images, sound, or text. Approaches to extract and present these…

Artificial Intelligence · Computer Science 2023-01-03 Lars Holmberg , Paul Davidsson , Per Linde

The trade-off between accuracy and interpretability has long been a challenge in machine learning (ML). This tension is particularly significant for emerging interpretable-by-design methods, which aim to redesign ML algorithms for…

Machine Learning · Computer Science 2025-05-28 Geyu Liang , Senne Michielssen , Salar Fattahi

Machine learning is permeating every conceivable domain to promote data-driven decision support. The focus is often on advanced black-box models due to their assumed performance advantages, whereas interpretable models are often associated…

Machine Learning · Computer Science 2024-09-24 Sven Kruschel , Nico Hambauer , Sven Weinzierl , Sandra Zilker , Mathias Kraus , Patrick Zschech

The need for reliable model explanations is prominent for many machine learning applications, particularly for tabular and time-series data as their use cases often involve high-stakes decision making. Towards this goal, we introduce a…

Machine Learning · Computer Science 2023-05-29 Aya Abdelsalam Ismail , Sercan Ö. Arik , Jinsung Yoon , Ankur Taly , Soheil Feizi , Tomas Pfister

Machine learning (ML) techniques play a pivotal role in high-stakes domains such as healthcare, where accurate predictions can greatly enhance decision-making. However, most high-performing methods such as neural networks and ensemble…

Artificial Intelligence · Computer Science 2026-01-08 Sanne Wielinga , Jesse Heyninck

Human brains lie at the core of complex neurobiological systems, where the neurons, circuits, and subsystems interact in enigmatic ways. Understanding the structural and functional mechanisms of the brain has long been an intriguing pursuit…

Neurons and Cognition · Quantitative Biology 2022-07-26 Hejie Cui , Wei Dai , Yanqiao Zhu , Xiaoxiao Li , Lifang He , Carl Yang

Data-driven models are central to scientific discovery. In efforts to achieve state-of-the-art model accuracy, researchers are employing increasingly complex machine learning algorithms that often outperform simple regressions in…

Materials Science · Physics 2022-12-21 Eric S. Muckley , James E. Saal , Bryce Meredig , Christopher S. Roper , John H. Martin

The ability of deep learning (DL) to improve the practice of medicine and its clinical outcomes faces a looming obstacle: model interpretation. Without description of how outputs are generated, a collaborating physician can neither resolve…

Machine Learning · Computer Science 2020-06-30 Christopher Snyder , Sriram Vishwanath

Deep Neural Networks (DNNs) deliver state-of-the-art performance in many image recognition and understanding applications. However, despite their outstanding performance, these models are black-boxes and it is hard to understand how they…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Moustafa Alzantot , Amy Widdicombe , Simon Julier , Mani Srivastava

In this review, we examine the problem of designing interpretable and explainable machine learning models. Interpretability and explainability lie at the core of many machine learning and statistical applications in medicine, economics,…

Machine Learning · Computer Science 2023-03-02 Ričards Marcinkevičs , Julia E. Vogt

The Artificial Neural Networks (ANNs) have been originally designed to function like a biological neural network, but does an ANN really work in the same way as a biological neural network? As we know, the human brain holds information in…

Neural and Evolutionary Computing · Computer Science 2019-01-08 Usman Ahmad , Hong Song , Awais Bilal , Shahid Mahmood , Asad Ullah , Uzair Saeed

Neural networks have achieved remarkable success across various fields. However, the lack of interpretability limits their practical use, particularly in critical decision-making scenarios. Post-hoc interpretability, which provides…

Machine Learning · Computer Science 2025-11-21 Yang Ji , Ying Sun , Yuting Zhang , Zhigaoyuan Wang , Yuanxin Zhuang , Zheng Gong , Dazhong Shen , Chuan Qin , Hengshu Zhu , Hui Xiong