English
Related papers

Related papers: Interpretable Classification Models for Recidivism…

200 papers

Machine learning (ML) techniques play a pivotal role in high-stakes domains such as healthcare, where accurate predictions can greatly enhance decision-making. However, most high-performing methods such as neural networks and ensemble…

Artificial Intelligence · Computer Science 2026-01-08 Sanne Wielinga , Jesse Heyninck

Despite outstanding contribution to the significant progress of Artificial Intelligence (AI), deep learning models remain mostly black boxes, which are extremely weak in explainability of the reasoning process and prediction results.…

Machine Learning · Computer Science 2020-02-11 Sheng Shi , Xinfeng Zhang , Wei Fan

In healthcare there is a pursuit for employing interpretable algorithms to assist healthcare professionals in several decision scenarios. Following the Predictive, Descriptive and Relevant (PDR) framework, the definition of interpretable…

A hybrid model involves the cooperation of an interpretable model and a complex black box. At inference, any input of the hybrid model is assigned to either its interpretable or complex component based on a gating mechanism. The advantages…

Machine Learning · Computer Science 2023-03-09 Julien Ferry , Gabriel Laberge , Ulrich Aïvodji

Interpretable machine learning tackles the important problem that humans cannot understand the behaviors of complex machine learning models and how these models arrive at a particular decision. Although many approaches have been proposed, a…

Machine Learning · Computer Science 2019-05-21 Mengnan Du , Ninghao Liu , Xia Hu

The increasing adoption of machine learning tools has led to calls for accountability via model interpretability. But what does it mean for a machine learning model to be interpretable by humans, and how can this be assessed? We focus on…

Machine Learning · Computer Science 2019-08-06 Dylan Slack , Sorelle A. Friedler , Carlos Scheidegger , Chitradeep Dutta Roy

Decision-making in complex systems often relies on machine learning models, yet highly accurate models such as XGBoost and neural networks can obscure the reasoning behind their predictions. In operations research applications,…

Machine Learning · Computer Science 2025-02-28 Gaurav Arwade , Sigurdur Olafsson

Methods for interpreting machine learning black-box models increase the outcomes' transparency and in turn generates insight into the reliability and fairness of the algorithms. However, the interpretations themselves could contain…

Machine Learning · Computer Science 2019-06-05 Yujia Zhang , Kuangyan Song , Yiming Sun , Sarah Tan , Madeleine Udell

Rule-based models, e.g., decision trees, are widely used in scenarios demanding high model interpretability for their transparent inner structures and good model expressivity. However, rule-based models are hard to optimize, especially on…

Machine Learning · Computer Science 2024-01-31 Zhuo Wang , Wei Zhang , Ning Liu , Jianyong Wang

The popularity of machine learning has increased the risk of unfair models getting deployed in high-stake applications, such as justice system, drug/vaccination design, and medical diagnosis. Although there are effective methods to train…

Machine Learning · Computer Science 2022-07-14 Mohit Bajaj , Lingyang Chu , Vittorio Romaniello , Gursimran Singh , Jian Pei , Zirui Zhou , Lanjun Wang , Yong Zhang

Many safety failures in machine learning arise when models are used to assign predictions to people (often in settings like lending, hiring, or content moderation) without accounting for how individuals can change their inputs. In this…

Machine Learning · Computer Science 2025-07-04 Seung Hyun Cheon , Meredith Stewart , Bogdan Kulynych , Tsui-Wei Weng , Berk Ustun

Interpretability is essential for machine learning models to be trusted and deployed in critical domains. However, existing methods for interpreting text models are often complex, lack mathematical foundations, and their performance is not…

Computation and Language · Computer Science 2024-04-10 Gianluigi Lopardo , Frederic Precioso , Damien Garreau

Deep neural networks have been well-known for their superb handling of various machine learning and artificial intelligence tasks. However, due to their over-parameterized black-box nature, it is often difficult to understand the prediction…

Machine Learning · Computer Science 2022-07-18 Xuhong Li , Haoyi Xiong , Xingjian Li , Xuanyu Wu , Xiao Zhang , Ji Liu , Jiang Bian , Dejing Dou

Algorithmic approaches to interpreting machine learning models have proliferated in recent years. We carry out human subject tests that are the first of their kind to isolate the effect of algorithmic explanations on a key aspect of model…

Computation and Language · Computer Science 2020-05-06 Peter Hase , Mohit Bansal

Kinetic models of biochemical systems used in the modern literature often contain hundreds or even thousands of variables. While these models are convenient for detailed simulations, their size is often an obstacle to deriving mechanistic…

Molecular Networks · Quantitative Biology 2021-06-29 Gleb Pogudin , Xingjian Zhang

In recent years, the use of sophisticated statistical models that influence decisions in domains of high societal relevance is on the rise. Although these models can often bring substantial improvements in the accuracy and efficiency of…

Machine Learning · Computer Science 2021-04-13 Alfredo Carrillo , Luis F. Cantú , Alejandro Noriega

Most of the work on interpretable machine learning has focused on designing either inherently interpretable models, which typically trade-off accuracy for interpretability, or post-hoc explanation systems, which lack guarantees about their…

Machine Learning · Computer Science 2019-06-05 Gregory Plumb , Maruan Al-Shedivat , Eric Xing , Ameet Talwalkar

Deep learning approaches have recently been extensively explored for the prognostics of industrial assets. However, they still suffer from a lack of interpretability, which hinders their adoption in safety-critical applications. To improve…

Machine Learning · Computer Science 2024-05-29 Florent Forest , Katharina Rombach , Olga Fink

Interpretability has become incredibly important as machine learning is increasingly used to inform consequential decisions. We propose to construct global explanations of complex, blackbox models in the form of a decision tree…

Machine Learning · Computer Science 2019-01-28 Osbert Bastani , Carolyn Kim , Hamsa Bastani

Model explainability is crucial for human users to be able to interpret how a proposed classifier assigns labels to data based on its feature values. We study generalized linear models constructed using sets of feature value rules, which…

Machine Learning · Statistics 2023-11-06 Sanjeeb Dash , Soumyadip Ghosh , Joao Goncalves , Mark S. Squillante