English
Related papers

Related papers: Rule Generation for Classification: Scalability, I…

200 papers

The increasing use of machine learning in high-stakes domains -- where people's livelihoods are impacted -- creates an urgent need for interpretable, fair, and highly accurate algorithms. With these needs in mind, we propose a mixed integer…

Machine Learning · Computer Science 2023-07-26 Nathanael Jo , Sina Aghaei , Andrés Gómez , Phebe Vayanos

Conventional rule learning algorithms aim at finding a set of simple rules, where each rule covers as many examples as possible. In this paper, we argue that the rules found in this way may not be the optimal explanations for each of the…

Machine Learning · Computer Science 2023-01-27 Van Quoc Phuong Huynh , Johannes Fürnkranz , Florian Beck

Our goal in this paper is to automatically extract a set of decision rules (rule set) that best explains a classification data set. First, a large set of decision rules is extracted from a set of decision trees trained on the data set. The…

Neural and Evolutionary Computing · Computer Science 2022-09-19 Paul-Amaury Matt , Rosina Ziegler , Danilo Brajovic , Marco Roth , Marco F. Huber

This paper studies the estimation of ranked-list discrete choice models with single and multiple purchases. In this setting, each consumer type is characterized by a ranking over a subset of products and a desired number of purchases, and…

Data Structures and Algorithms · Computer Science 2026-05-11 Luciano Costa , Gerardo Berbeglia , Claudio Contardo , Jean-François Cordeau

Rule ensembles are designed to provide a useful trade-off between predictive accuracy and model interpretability. However, the myopic and random search components of current rule ensemble methods can compromise this goal: they often need…

Machine Learning · Computer Science 2021-01-22 Mario Boley , Simon Teshuva , Pierre Le Bodic , Geoffrey I Webb

As the use of black-box models becomes ubiquitous in high stake decision-making systems, demands for fair and interpretable models are increasing. While it has been shown that interpretable models can be as accurate as black-box models in…

Machine Learning · Computer Science 2020-02-19 Ulrich Aïvodji , Julien Ferry , Sébastien Gambs , Marie-José Huguet , Mohamed Siala

This paper describes an efficient rule generation algorithm, called rule generation from artificial neural networks (RGANN) to generate symbolic rules from ANNs. Classification rules are sought in many areas from automatic knowledge…

Neural and Evolutionary Computing · Computer Science 2010-09-28 S. M. Kamruzzaman

Classification rules can be severely affected by the presence of disturbing observations in the training sample. Looking for an optimal classifier with such data may lead to unnecessarily complex rules. So, simpler effective classification…

Statistics Theory · Mathematics 2017-01-19 Marina Antolín , Eustasio Del Barrio , Jean-Michel Loubes

Machine-learning models are ubiquitous. In some domains, for instance, in medicine, the models' predictions must be interpretable. Decision trees, classification rules, and subgroup discovery are three broad categories of supervised…

Machine Learning · Computer Science 2022-04-29 Vadim Arzamasov , Benjamin Jochum , Klemens Böhm

Tree ensembles are very popular machine learning models, known for their effectiveness in supervised classification and regression tasks. Their performance derives from aggregating predictions of multiple decision trees, which are renowned…

Optimization and Control · Mathematics 2025-01-14 Lorenzo Bonasera , Emilio Carrizosa

For optimization models to be used in practice, it is crucial that users trust the results. A key factor in this aspect is the interpretability of the solution process. A previous framework for inherently interpretable optimization models…

Optimization and Control · Mathematics 2026-02-13 Marc Goerigk , Michael Hartisch , Sebastian Merten , Kartikey Sharma

Set-valued prediction is a well-known concept in multi-class classification. When a classifier is uncertain about the class label for a test instance, it can predict a set of classes instead of a single class. In this paper, we focus on…

Machine Learning · Computer Science 2022-03-15 Thomas Mortier , Eyke Hüllermeier , Krzysztof Dembczyński , Willem Waegeman

Fair clustering has gained increasing attention in recent years, especially in applications involving socially sensitive attributes. However, existing fair clustering methods often lack interpretability, limiting their applicability in…

Machine Learning · Computer Science 2025-11-27 Mudi Jiang , Jiahui Zhou , Xinying Liu , Zengyou He , Zhikui Chen

Fuzzy rule-based systems have been mostly used in interpretable decision-making because of their interpretable linguistic rules. However, interpretability requires both sensible linguistic partitions and small rule-base sizes, which are not…

Machine Learning · Computer Science 2025-12-15 Javier Fumanal-Idocin , Raquel Fernandez-Peralta , Javier Andreu-Perez

In a standard classification framework a set of trustworthy learning data are employed to build a decision rule, with the final aim of classifying unlabelled units belonging to the test set. Therefore, unreliable labelled observations,…

Applications · Statistics 2019-11-20 Andrea Cappozzo , Francesca Greselin , Thomas Brendan Murphy

We propose and study a method for learning interpretable representations for the task of regression. Features are represented as networks of multi-type expression trees comprised of activation functions common in neural networks in addition…

Neural and Evolutionary Computing · Computer Science 2019-03-26 William La Cava , Tilak Raj Singh , James Taggart , Srinivas Suri , Jason H. Moore

Clustering serves as a vital tool for uncovering latent data structures, and achieving both high accuracy and interpretability is essential. To this end, existing methods typically construct binary decision trees by solving mixed-integer…

Machine Learning · Computer Science 2026-02-17 Hayato Suzuki , Shunnosuke Ikeda , Yuichi Takano

Risk scoring systems are widely used in high-stakes domains to assist decision-making. However, existing approaches often focus on optimizing predictive accuracy or likelihood-based criteria, which may not align with the main goal of…

Machine Learning · Computer Science 2026-04-07 Wenhao Chi , Ş. İlker Birbil

There are many approaches for training decision trees. This work introduces a novel gradient-based method for constructing decision trees that optimize arbitrary differentiable loss functions, overcoming the limitations of heuristic…

Machine Learning · Computer Science 2025-03-25 Andrei V. Konstantinov , Lev V. Utkin

Rule-based models are essential for high-stakes decision-making due to their transparency and interpretability, but their discrete nature creates challenges for optimization and scalability. In this work, we present the Fuzzy Rule-based…

Machine Learning · Computer Science 2025-09-25 Javier Fumanal-Idocin , Raquel Fernandez-Peralta , Javier Andreu-Perez