English
Related papers

Related papers: Enabling Regional Explainability by Automatic and …

200 papers

With the wide adoption of machine learning techniques, requirements have evolved beyond sheer high performance, often requiring models to be trustworthy. A common approach to increase the trustworthiness of such systems is to allow them to…

Machine Learning · Computer Science 2023-11-16 Andrea Pugnana , Carlos Mougan , Dan Saattrup Nielsen

In the context of human-in-the-loop Machine Learning applications, like Decision Support Systems, interpretability approaches should provide actionable insights without making the users wait. In this paper, we propose Accelerated…

Machine Learning · Computer Science 2021-12-24 David Dandolo , Chiara Masiero , Mattia Carletti , Davide Dalle Pezze , Gian Antonio Susto

Intelligent agents, such as robots, are increasingly deployed in real-world, human-centric environments. To foster appropriate human trust and meet legal and ethical standards, these agents must be able to explain their behavior. However,…

Machine Learning · Computer Science 2025-08-12 Zhang Xi-Jia , Yue Guo , Shufei Chen , Simon Stepputtis , Matthew Gombolay , Katia Sycara , Joseph Campbell

Artificial intelligence (AI) provides many opportunities to improve private and public life. Discovering patterns and structures in large troves of data in an automated manner is a core component of data science, and currently drives…

Machine Learning · Computer Science 2020-09-25 Vaishak Belle , Ioannis Papantonis

Although deep learning models have proven effective at solving problems in natural language processing, the mechanism by which they come to their conclusions is often unclear. As a result, these models are generally treated as black boxes,…

Computation and Language · Computer Science 2017-02-28 W. James Murdoch , Arthur Szlam

If a product deviates from its desired properties in the injection moulding process, its root cause analysis can be aided by models that relate the input machine settings with the output quality characteristics. The machine learning models…

Machine Learning · Computer Science 2025-05-08 Muhammad Muaz , Sameed Sajid , Tobias Schulze , Chang Liu , Nils Klasen , Benny Drescher

Most deep neural networks are considered to be black boxes, meaning their output is hard to interpret. In contrast, logical expressions are considered to be more comprehensible since they use symbols that are semantically close to natural…

Machine Learning · Computer Science 2020-12-16 Sophie Burkhardt , Jannis Brugger , Nicolas Wagner , Zahra Ahmadi , Kristian Kersting , Stefan Kramer

Interpretability is a pressing issue for decision systems. Many post hoc methods have been proposed to explain the predictions of a single machine learning model. However, business processes and decision systems are rarely centered around a…

Machine Learning · Computer Science 2023-03-22 Gianluigi Lopardo , Damien Garreau , Frederic Precioso , Greger Ottosson

Development of interpretable machine learning models for clinical healthcare applications has the potential of changing the way we understand, treat, and ultimately cure, diseases and disorders in many areas of medicine. These models can…

Machine Learning · Computer Science 2019-08-06 Qingzhu Gao , Humberto Gonzalez , Parvez Ahammad

The trade-off between accuracy and interpretability has long been a challenge in machine learning (ML). This tension is particularly significant for emerging interpretable-by-design methods, which aim to redesign ML algorithms for…

Machine Learning · Computer Science 2025-05-28 Geyu Liang , Senne Michielssen , Salar Fattahi

Model explainability is crucial for human users to be able to interpret how a proposed classifier assigns labels to data based on its feature values. We study generalized linear models constructed using sets of feature value rules, which…

Machine Learning · Statistics 2023-11-06 Sanjeeb Dash , Soumyadip Ghosh , Joao Goncalves , Mark S. Squillante

In medical imaging, particularly in early disease detection and prognosis tasks, discerning the rationale behind an AI model's predictions is crucial for evaluating the reliability of its decisions. Conventional explanation methods face…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Yingying Fang , Zihao Jin , Xiaodan Xing , Simon Walsh , Guang Yang

As machine learning methods see greater adoption and implementation in high stakes applications such as medical image diagnosis, the need for model interpretability and explanation has become more critical. Classical approaches that assess…

Machine Learning · Computer Science 2020-02-12 Sumedha Singla , Brian Pollack , Junxiang Chen , Kayhan Batmanghelich

In modern data science, it is often not enough to obtain only a data-driven model with a good prediction quality. On the contrary, it is more interesting to understand the properties of the model, which parts could be replaced to obtain…

Neural and Evolutionary Computing · Computer Science 2021-07-09 Alexander Hvatov , Mikhail Maslyaev , Iana S. Polonskaya , Mikhail Sarafanov , Mark Merezhnikov , Nikolay O. Nikitin

Explainable machine learning (XML) has emerged as a major challenge in artificial intelligence (AI). Although black-box models such as Deep Neural Networks and Gradient Boosting often exhibit exceptional predictive accuracy, their lack of…

Methodology · Statistics 2024-06-18 Evgenii Kuriabov , Jia Li

Although "black box" models such as Artificial Neural Networks, Support Vector Machines, and Ensemble Approaches continue to show superior performance in many disciplines, their adoption in the sensitive disciplines (e.g., finance,…

Artificial Intelligence · Computer Science 2019-05-31 Sheikh Rabiul Islam , William Eberle , Sid Bundy , Sheikh Khaled Ghafoor

Local explanation frameworks aim to rationalize particular decisions made by a black-box prediction model. Existing techniques are often restricted to a specific type of predictor or based on input saliency, which may be undesirably…

Machine Learning · Computer Science 2019-02-12 Brandon Carter , Jonas Mueller , Siddhartha Jain , David Gifford

We propose and implement an interpretable machine learning classification model for Explainable AI (XAI) based on expressive Boolean formulas. Potential applications include credit scoring and diagnosis of medical conditions. The Boolean…

Most of the work on interpretable machine learning has focused on designing either inherently interpretable models, which typically trade-off accuracy for interpretability, or post-hoc explanation systems, which lack guarantees about their…

Machine Learning · Computer Science 2019-06-05 Gregory Plumb , Maruan Al-Shedivat , Eric Xing , Ameet Talwalkar

As the use of deep learning techniques has grown across various fields over the past decade, complaints about the opaqueness of the black-box models have increased, resulting in an increased focus on transparency in deep learning models.…

Computation and Language · Computer Science 2024-03-19 Siwen Luo , Hamish Ivison , Caren Han , Josiah Poon