English
Related papers

Related papers: Optimal Counterfactual Search in Tree Ensembles: A…

200 papers

Counterfactual explanations interpret the recommendation mechanism via exploring how minimal alterations on items or users affect the recommendation decisions. Existing counterfactual explainable approaches face huge search space and their…

Information Retrieval · Computer Science 2022-07-15 Xiangmeng Wang , Qian Li , Dianer Yu , Guandong Xu

Beliefs and values are increasingly being incorporated into our AI systems through alignment processes, such as carefully curating data collection principles or regularizing the loss function used for training. However, the meta-alignment…

Artificial Intelligence · Computer Science 2023-07-14 Qiuyi , Zhang , Michael S. Lee , Sherol Chen

We study the problem of sharing as many branching conditions of a given forest classifier or regressor as possible while keeping classification performance. As a constraint for preventing from accuracy degradation, we first consider the one…

Machine Learning · Computer Science 2022-12-15 Atsuyoshi Nakamura , Kento Sakurada

Finding an optimal decision tree that minimizes classification error is known to be NP-hard. While exact algorithms based on MILP, CP, SAT, or dynamic programming guarantee optimality, they often suffer from poor anytime behavior -- meaning…

Artificial Intelligence · Computer Science 2025-08-11 Harold Silvère Kiossou , Siegfried Nijssen , Pierre Schaus

We resolve a long-standing open question, about the existence of a constant-factor approximation algorithm for the average-case \textsc{Decision Tree} problem with uniform probability distribution over the hypotheses. We answer the question…

Data Structures and Algorithms · Computer Science 2026-04-29 Michał Szyfelbein

Decision tree (and its extensions such as Gradient Boosting Decision Trees and Random Forest) is a widely used machine learning algorithm, due to its practical effectiveness and model interpretability. With the emergence of big data, there…

Machine Learning · Computer Science 2016-11-07 Qi Meng , Guolin Ke , Taifeng Wang , Wei Chen , Qiwei Ye , Zhi-Ming Ma , Tie-Yan Liu

Existing evolutionary algorithms for Constrained Multi-objective Optimization Problems (CMOPs) typically treat all constraints uniformly, overlooking their distinct geometric relationships with the true Constrained Pareto Front (CPF). In…

Neural and Evolutionary Computing · Computer Science 2026-04-07 Ruiqing Sun , Dawei Feng , Sheng Qi , Xing Zhou , Lianghao Li , Bo Ding , Yijie Wang , Rui Wang , Huaimin Wang

Formal XAI (explainable AI) is a growing area that focuses on computing explanations with mathematical guarantees for the decisions made by ML models. Inside formal XAI, one of the most studied cases is that of explaining the choices taken…

Machine Learning · Computer Science 2022-07-26 Marcelo Arenas , Pablo Barceló , Miguel Romero , Bernardo Subercaseaux

Solving Constraint Optimization Problems (COPs) can be dramatically simplified by boundary estimation, that is, providing tight boundaries of cost functions. By feeding a supervised Machine Learning (ML) model with data composed of known…

Artificial Intelligence · Computer Science 2021-11-08 Helge Spieker , Arnaud Gotlieb

This paper introduces Weighted Optimal Classification Forests (WOCFs), a new family of classifiers that takes advantage of an optimal ensemble of decision trees to derive accurate and interpretable classifiers. We propose a novel…

Optimization and Control · Mathematics 2024-12-02 Víctor Blanco , Alberto Japón , Justo Puerto , Peter Zhang

A linear program with linear complementarity constraints (LPCC) requires the minimization of a linear objective over a set of linear constraints together with additional linear complementarity constraints. This class has emerged as a…

Optimization and Control · Mathematics 2018-02-09 Bin Yu , John E. Mitchell , Jong-Shi Pang

Parameterized algorithms have been subject to extensive research of recent years and allow to solve hard problems by exploiting a parameter of the corresponding problem instances. There, one goal is to devise algorithms, where the runtime…

Logic in Computer Science · Computer Science 2019-05-07 Markus Hecher

The decision tree is one of the most popular and classical machine learning models from the 1980s. However, in many practical applications, decision trees tend to generate decision paths with excessive depth. Long decision paths often cause…

Machine Learning · Computer Science 2022-11-30 Jialu Zhang , Yitan Wang , Mark Santolucito , Ruzica Piskac

Real-world autonomous systems operate under uncertainty about both their pose and dynamics. Autonomous control systems must simultaneously perform estimation and control tasks to maintain robustness to changing dynamics or modeling errors.…

Systems and Control · Computer Science 2018-08-03 Patrick Slade , Zachary N. Sunberg , Mykel J. Kochenderfer

Optimization layers in deep neural networks have enjoyed a growing popularity in structured learning, improving the state of the art on a variety of applications. Yet, these pipelines lack interpretability since they are made of two opaque…

Machine Learning · Computer Science 2024-06-04 Germain Vivier-Ardisson , Alexandre Forel , Axel Parmentier , Thibaut Vidal

Tree ensembles are non-parametric methods widely recognized for their accuracy and ability to capture complex interactions. While these models excel at prediction, they are difficult to interpret and may fail to uncover useful relationships…

Machine Learning · Statistics 2026-04-01 Brian Liu , Rahul Mazumder , Peter Radchenko

Retrieving relevant targets from an extremely large target set under computational limits is a common challenge for information retrieval and recommendation systems. Tree models, which formulate targets as leaves of a tree with trainable…

Machine Learning · Statistics 2020-06-30 Jingwei Zhuo , Ziru Xu , Wei Dai , Han Zhu , Han Li , Jian Xu , Kun Gai

Model trees provide an appealing way to perform interpretable machine learning for both classification and regression problems. In contrast to ``classic'' decision trees with constant values in their leaves, model trees can use linear…

Machine Learning · Computer Science 2026-03-11 Sabino Francesco Roselli , Eibe Frank

Machine learning is increasingly used to guide branch-and-cut (B&C) for mixed-integer linear programming by learning score-based policies for selecting branching variables and cutting planes. Many approaches train on local signals from…

Optimization and Control · Mathematics 2026-02-02 Hongyu Cheng , Amitabh Basu

Counterfactual explanation is one branch of interpretable machine learning that produces a perturbation sample to change the model's original decision. The generated samples can act as a recommendation for end-users to achieve their desired…

Machine Learning · Computer Science 2023-03-28 Tri Dung Duong , Qian Li , Guandong Xu