English
Related papers

Related papers: Rule Generation for Classification: Scalability, I…

200 papers

This paper introduces an explanation framework designed to enhance the quality of rules in knowledge-based reasoning systems based on dataset-driven insights. The traditional method for rule induction from data typically requires…

Artificial Intelligence · Computer Science 2025-02-04 Oshani Seneviratne , Brendan Capuzzo , William Van Woensel

The high performance of tree ensemble classifiers benefits from a large set of rules, which, in turn, makes the models hard to understand. To improve interpretability, existing methods extract a subset of rules for approximation using model…

Machine Learning · Computer Science 2025-01-03 Zhen Li , Weikai Yang , Jun Yuan , Jing Wu , Changjian Chen , Yao Ming , Fan Yang , Hui Zhang , Shixia Liu

Deep neural networks are widely used in practical applications of AI, however, their inner structure and complexity made them generally not easily interpretable. Model transparency and interpretability are key requirements for multiple…

Machine Learning · Computer Science 2026-01-13 Luca Bergamin , Roberto Confalonieri , Fabio Aiolli

We study decision rule approximations for generic multi-stage robust linear optimization problems. We consider linear decision rules for the case when the objective coefficients, the recourse matrices, and the right-hand sides are…

Optimization and Control · Mathematics 2021-05-04 Guanglin Xu , Grani A. Hanasusanto

Decision trees are popular Classification and Regression tools and, when small-sized, easy to interpret. Traditionally, a greedy approach has been used to build the trees, yielding a very fast training process; however, controlling sparsity…

Optimization and Control · Mathematics 2020-02-24 Rafael Blanquero , Emilio Carrizosa , Cristina Molero-Río , Dolores Romero Morales

We tackle the problem of building explainable recommendation systems that are based on a per-user decision tree, with decision rules that are based on single attribute values. We build the trees by applying learned regression functions to…

Machine Learning · Computer Science 2019-12-20 Eyal Shulman , Lior Wolf

Multi-label classification (MLC) is a supervised learning problem in which, contrary to standard multiclass classification, an instance can be associated with several class labels simultaneously. In this chapter, we advocate a rule-based…

Machine Learning · Computer Science 2020-12-09 Eneldo Loza Mencía , Johannes Fürnkranz , Eyke Hüllermeier , Michael Rapp

Classification is a common statistical task in many areas. In order to ameliorate the performance of the existing methods, there are always some new classification procedures proposed. These procedures, especially those raised in the…

Methodology · Statistics 2026-05-05 Yuan-chin Ivan Chang

Computing an optimal classification tree that provably maximizes training performance within a given size limit, is NP-hard, and in practice, most state-of-the-art methods do not scale beyond computing optimal trees of depth three.…

Machine Learning · Computer Science 2025-01-15 Catalin E. Brita , Jacobus G. M. van der Linden , Emir Demirović

With the abundance of available data, many enterprises seek to implement data-driven prescriptive analytics to help them make informed decisions. These prescriptive policies need to satisfy operational constraints, and proactively eliminate…

Optimization and Control · Mathematics 2022-07-22 Shivaram Subramanian , Wei Sun , Youssef Drissi , Markus Ettl

Plackett-Luce gradient estimation enables the optimization of stochastic ranking models within feasible time constraints through sampling techniques. Unfortunately, the computational complexity of existing methods does not scale well with…

Machine Learning · Computer Science 2022-04-29 Harrie Oosterhuis

Decision trees are one of the most useful and popular methods in the machine learning toolbox. In this paper, we consider the problem of learning optimal decision trees, a combinatorial optimization problem that is challenging to solve at…

Machine Learning · Computer Science 2022-07-01 Rahul Mazumder , Xiang Meng , Haoyue Wang

We study the problem of instance segmentation in biological images with crowded and compact cells. We formulate this task as an integer program where variables correspond to cells and constraints enforce that cells do not overlap. To solve…

Computer Vision and Pattern Recognition · Computer Science 2017-09-22 Chong Zhang , Shaofei Wang , Miguel A. Gonzalez-Ballester , Julian Yarkony

Probabilistic forecasting relies on past observations to provide a probability distribution for a future outcome, which is often evaluated against the realization using a scoring rule. Here, we perform probabilistic forecasting with…

Machine Learning · Statistics 2024-03-06 Lorenzo Pacchiardi , Rilwan Adewoyin , Peter Dueben , Ritabrata Dutta

In the current era of vast data and transparent machine learning, it is essential for techniques to operate at a large scale while providing a clear mathematical comprehension of the internal workings of the method. Although there already…

Machine Learning · Statistics 2024-02-05 David Rügamer

In most machine learning applications, classification accuracy is not the primary metric of interest. Binary classifiers which face class imbalance are often evaluated by the $F_\beta$ score, area under the precision-recall curve, Precision…

Machine Learning · Computer Science 2018-03-02 Alan Mackey , Xiyang Luo , Elad Eban

When predictive models are used to support complex and important decisions, the ability to explain a model's reasoning can increase trust, expose hidden biases, and reduce vulnerability to adversarial attacks. However, attempts at…

Machine Learning · Computer Science 2019-07-11 Dimitris Bertsimas , Arthur Delarue , Patrick Jaillet , Sebastien Martin

Algorithmic fairness involves expressing notions such as equity, or reasonable treatment, as quantifiable measures that a machine learning algorithm can optimise. Most work in the literature to date has focused on classification problems…

Machine Learning · Computer Science 2020-03-06 Daniel Steinberg , Alistair Reid , Simon O'Callaghan

In this paper, we study the nurse rostering problem that considers multiple units and many soft time-related constraints. An efficient branch and price solution approach that relies on a fast algorithm to solve the pricing subproblem of the…

Optimization and Control · Mathematics 2023-11-10 Wanzhe Hu , Xiaozhou He , Li Luo , Panos M. Pardalos

We present the design and implementation of a custom discrete optimization technique for building rule lists over a categorical feature space. Our algorithm produces rule lists with optimal training performance, according to the regularized…

Machine Learning · Statistics 2018-08-07 Elaine Angelino , Nicholas Larus-Stone , Daniel Alabi , Margo Seltzer , Cynthia Rudin