English
Related papers

Related papers: Interpretable Random Forests via Rule Extraction

200 papers

The recent years have witnessed the rise of accurate but obscure decision systems which hide the logic of their internal decision processes to the users. The lack of explanations for the decisions of black box systems is a key ethical…

Artificial Intelligence · Computer Science 2018-05-29 Riccardo Guidotti , Anna Monreale , Salvatore Ruggieri , Dino Pedreschi , Franco Turini , Fosca Giannotti

Decision trees, owing to their interpretability, are attractive as control policies for (dynamical) systems. Unfortunately, constructing, or synthesising, such policies is a challenging task. Previous approaches do so by imitating a…

Artificial Intelligence · Computer Science 2025-04-23 Emir Demirović , Christian Schilling , Anna Lukina

Sophisticated gated recurrent neural network architectures like LSTMs and GRUs have been shown to be highly effective in a myriad of applications. We develop an un-gated unit, the statistical recurrent unit (SRU), that is able to learn long…

Machine Learning · Computer Science 2017-03-02 Junier B. Oliva , Barnabas Poczos , Jeff Schneider

Updating machine learning models with new information usually improves their predictive performance, yet, in many applications, it is also desirable to avoid changing the model predictions too much. This property is called stability. In…

Machine Learning · Computer Science 2024-02-22 Morten Blørstad , Berent Å. S. Lunde , Nello Blaser

Interpretability of AI models allows for user safety checks to build trust in these models. In particular, decision trees (DTs) provide a global view on the learned model and clearly outlines the role of the features that are critical to…

Machine Learning · Computer Science 2023-04-13 Hector Kohler , Riad Akrour , Philippe Preux

Deep models have advanced prediction in many domains, but their lack of interpretability remains a key barrier to the adoption in many real world applications. There exists a large body of work aiming to help humans understand these black…

Machine Learning · Computer Science 2019-08-15 Mike Wu , Sonali Parbhoo , Michael C. Hughes , Volker Roth , Finale Doshi-Velez

Combining neural networks with continuous logic and multicriteria decision making tools can reduce the black box nature of neural models. In this study, we show that nilpotent logical systems offer an appropriate mathematical framework for…

Artificial Intelligence · Computer Science 2020-05-01 Orsolya Csiszár , Gábor Csiszár , József Dombi

Combining machine learning with econometric analysis is becoming increasingly prevalent in both research and practice. A common empirical strategy involves the application of predictive modeling techniques to 'mine' variables of interest…

Econometrics · Economics 2020-12-22 Mochen Yang , Edward McFowland , Gordon Burtch , Gediminas Adomavicius

Decision forests are classical models to efficiently make decision on complex inputs with multiple features. While the global structure of the trees or forests is public, sensitive information have to be protected during the evaluation of…

Cryptography and Security · Computer Science 2021-08-20 Slim Bettaieb , Loic Bidoux , Olivier Blazy , Baptiste Cottier , David Pointcheval

In this paper, we study the problem of learning probabilistic logical rules for inductive and interpretable link prediction. Despite the importance of inductive link prediction, most previous works focused on transductive link prediction…

Machine Learning · Computer Science 2019-11-04 Ali Sadeghian , Mohammadreza Armandpour , Patrick Ding , Daisy Zhe Wang

Random forests are an ensemble method relevant for many problems, such as regression or classification. They are popular due to their good predictive performance (compared to, e.g., decision trees) requiring only minimal tuning of…

Methodology · Statistics 2022-10-20 Nikolaus Umlauf , Nadja Klein

A desirable property of interpretable models is small size, so that they are easily understandable by humans. This leads to the following challenges: (a) small sizes typically imply diminished accuracy, and (b) bespoke levers provided by…

Machine Learning · Computer Science 2024-08-26 Abhishek Ghose , Balaraman Ravindran

Decision tree learning is a widely used approach in machine learning, favoured in applications that require concise and interpretable models. Heuristic methods are traditionally used to quickly produce models with reasonably high accuracy.…

Interpreting machine learning models is challenging but crucial for ensuring the safety of deep networks in autonomous driving systems. Due to the prevalence of deep learning based perception models in autonomous vehicles, accurately…

Machine Learning · Computer Science 2023-01-27 Alex Gu , Tsui-Wei Weng , Pin-Yu Chen , Sijia Liu , Luca Daniel

Interpretability is the next frontier in machine learning research. In the search for white box models - as opposed to black box models, like random forests or neural networks - rule induction algorithms are a logical and promising option,…

Machine Learning · Computer Science 2024-08-30 Henri Bollaert , Marko Palangetić , Chris Cornelis , Salvatore Greco , Roman Słowiński

We present a novel method - LIBRE - to learn an interpretable classifier, which materializes as a set of Boolean rules. LIBRE uses an ensemble of bottom-up weak learners operating on a random subset of features, which allows for the…

Machine Learning · Computer Science 2019-11-18 Graziano Mita , Paolo Papotti , Maurizio Filippone , Pietro Michiardi

Owing to their inherently interpretable structure, decision trees are commonly used in applications where interpretability is essential. Recent work has focused on improving various aspects of decision trees, including their predictive…

Machine Learning · Statistics 2023-05-30 Dimitris Bertsimas , Vassilis Digalakis

The rapid evolution of machine learning (ML) has led to the widespread adoption of complex "black box" models, such as deep neural networks and ensemble methods. These models exhibit exceptional predictive performance, making them…

Machine Learning · Computer Science 2025-03-28 Moncef Garouani , Josiane Mothe , Ayah Barhrhouj , Julien Aligon

Text data are increasingly handled in an automated fashion by machine learning algorithms. But the models handling these data are not always well-understood due to their complexity and are more and more often referred to as "black-boxes."…

Machine Learning · Statistics 2021-07-27 Dina Mardaoui , Damien Garreau

It is well known that different algorithms perform differently well on an instance of an algorithmic problem, motivating algorithm selection (AS): Given an instance of an algorithmic problem, which is the most suitable algorithm to solve…

Machine Learning · Computer Science 2022-11-01 Lukas Fehring , Jonas Hanselle , Alexander Tornede