English
Related papers

Related papers: NN2Rules: Extracting Rule List from Neural Network…

200 papers

Machine learning models deployed in sensitive areas such as healthcare must be interpretable to ensure accountability and fairness. Rule lists (if Age < 35 $\wedge$ Priors > 0 then Recidivism = True, else if Next Condition . . . ) offer…

Machine Learning · Computer Science 2024-11-12 Sascha Xu , Nils Philipp Walter , Jilles Vreeken

Machine-learning models are ubiquitous. In some domains, for instance, in medicine, the models' predictions must be interpretable. Decision trees, classification rules, and subgroup discovery are three broad categories of supervised…

Machine Learning · Computer Science 2022-04-29 Vadim Arzamasov , Benjamin Jochum , Klemens Böhm

Understanding the behavior of a trained network and finding explanations for its outputs is important for improving the network's performance and generalization ability, and for ensuring trust in automated systems. Several approaches have…

Computation and Language · Computer Science 2018-08-30 Madhumita Sushil , Simon Šuster , Walter Daelemans

Machine learning models on behavioral and textual data can result in highly accurate prediction models, but are often very difficult to interpret. Rule-extraction techniques have been proposed to combine the desired predictive accuracy of…

Artificial Intelligence · Computer Science 2021-07-01 Yanou Ramon , David Martens , Theodoros Evgeniou , Stiene Praet

While deep neural networks (DNNs) have become a standard architecture for many machine learning tasks, their internal decision-making process and general interpretability is still poorly understood. Conversely, common decision trees are…

Machine Learning · Computer Science 2022-02-02 Coenraad Mouton , Marelie H. Davel

Traditional neural networks have an impressive classification performance, but what they learn cannot be inspected, verified or extracted. Neural Logic Networks on the other hand have an interpretable structure that enables them to learn a…

Machine Learning · Computer Science 2026-01-26 Vincent Perreault , Katsumi Inoue , Richard Labib , Alain Hertz

We propose a method for generating explainable rule sets from tree-ensemble learners using Answer Set Programming (ASP). To this end, we adopt a decompositional approach where the split structures of the base decision trees are exploited in…

Artificial Intelligence · Computer Science 2021-09-20 Akihiro Takemura , Katsumi Inoue

Learning interpretable models has become a major focus of machine learning research, given the increasing prominence of machine learning in socially important decision-making. Among interpretable models, rule lists are among the best-known…

Machine Learning · Computer Science 2024-06-19 Leonardo Pellegrina , Fabio Vandin

Humans have the ability to seamlessly combine low-level visual input with high-level symbolic reasoning often in the form of recognising objects, learning relations between them and applying rules. Neuro-symbolic systems aim to bring a…

Machine Learning · Computer Science 2022-03-01 Nuri Cingillioglu , Alessandra Russo

Neural networks are becoming a popular tool for solving many real-world problems such as object recognition and machine translation, thanks to its exceptional performance as an end-to-end solution. However, neural networks are complex…

Machine Learning · Computer Science 2020-09-29 Guoliang Dong , Jingyi Wang , Jun Sun , Yang Zhang , Xinyu Wang , Ting Dai , Jin Song Dong , Xingen Wang

Tree Ensemble (TE) models, such as Gradient Boosted Trees, often achieve optimal performance on tabular datasets, yet their lack of transparency poses challenges for comprehending their decision logic. This paper introduces TE2Rules (Tree…

Machine Learning · Computer Science 2024-01-25 G Roshan Lal , Xiaotong Chen , Varun Mithal

We propose an approach for biomedical information extraction that marries the advantages of machine learning models, e.g., learning directly from data, with the benefits of rule-based approaches, e.g., interpretability. Our approach starts…

Computation and Language · Computer Science 2016-07-01 Marco A. Valenzuela-Escarcega , Gus Hahn-Powell , Dane Bell , Mihai Surdeanu

Understanding the decision-making process of a machine/deep learning model is crucial, particularly in security-sensitive applications. In this study, we introduce a neural network framework that combines the global and exact…

Artificial Intelligence · Computer Science 2023-09-22 Adrien Benamira , Tristan Guérand , Thomas Peyrin , Hans Soegeng

This literature review studies the field of automated process extraction, i.e., transforming textual descriptions into structured processes using Natural Language Processing (NLP). We found that Machine Learning (ML) / Deep Learning (DL)…

Computation and Language · Computer Science 2024-09-24 William Van Woensel , Soroor Motie

Understanding how animals learn is a central challenge in neuroscience, with growing relevance to the development of animal- or human-aligned artificial intelligence. However, existing approaches tend to assume fixed parametric forms for…

Machine Learning · Computer Science 2026-02-06 Yuhan Helena Liu , Victor Geadah , Jonathan Pillow

Artificial Neural Network is among the most popular algorithm for supervised learning. However, Neural Networks have a well-known drawback of being a "Black Box" learner that is not comprehensible to the Users. This lack of transparency…

Machine Learning · Computer Science 2011-10-04 Ridwan Al Iqbal

The predictive power of neural networks often costs model interpretability. Several techniques have been developed for explaining model outputs in terms of input features; however, it is difficult to translate such interpretations into…

Machine Learning · Computer Science 2017-08-17 Benjamin J. Lengerich , Sandeep Konam , Eric P. Xing , Stephanie Rosenthal , Manuela Veloso

Linear layers in neural networks (NNs) trained by gradient descent can be expressed as a key-value memory system which stores all training datapoints and the initial weights, and produces outputs using unnormalised dot attention over the…

Machine Learning · Computer Science 2022-06-20 Kazuki Irie , Róbert Csordás , Jürgen Schmidhuber

It is still not fully understood exactly how neural networks are able to solve the complex tasks that have recently pushed AI research forward. We present a novel method for determining how information is structured inside a neural network.…

Neural and Evolutionary Computing · Computer Science 2019-02-04 Peter E. Lillian , Richard Meyes , Tobias Meisen

On the one hand, artificial neural networks (ANNs) are commonly labelled as black-boxes, lacking interpretability; an issue that hinders human understanding of ANNs' behaviors. A need exists to generate a meaningful sequential logic of the…

Machine Learning · Computer Science 2021-11-19 Duy T. Nguyen , Kathryn E. Kasmarik , Hussein A. Abbass